A data analysis method, device and system

Abstract

The embodiments of the present application provide a data analysis method, device and system, which relate to the field of communication technology and are used to improve the use effect of data analysis information. The method includes: a data analysis network element receives effect information of data analysis information from a first network element. The data analysis network element determines updated data analysis information based on the effect information. This makes it easy for the data analysis network element to determine the quality of the use effect achieved by the data analysis information based on the effect information, and to gain insight into whether the data analysis model is accurate. It is easy for the data analysis network element to update the data analysis information in a timely manner based on the use effect achieved by the data analysis information, and obtain updated data analysis information. In this solution, the data analysis network element can actively update the data analysis information in a timely manner based on the effect information to improve the use effect of the updated data analysis information.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of communication technology, and in particular, to a data analysis method, device and system. Background Art

[0002] The network data analytics function (NWDAF) can provide data analysis information to the NWDAF service consumer (service consumer) (also referred to as the analytics consumer network function) network element. The analytics consumer network function network element can trigger some execution actions based on the data analysis information to optimize the network, slices, users, services, etc. For example, taking the analytics consumer network function as the policy control function (PCF) network element and the data analysis information as the average service experience as an example, the NWDAF can observe the average service experience of the service and then notify the PCF network element. The PCF network element can then adjust the quality of service (QoS) parameters of the service based on the average service experience to ensure the service experience.

[0003] However, in the prior art, NWDAF does not perceive and analyze the implementation logic of the consumer network function network element based on the data analysis information, and is unable to evaluate and analyze the effect information generated by the consumer network function network element triggering the execution action. This may result in that the data analysis information updated by NWDAF may not meet the business experience of analyzing the consumer network function network element. Summary of the invention

[0004] The embodiments of the present application provide a data analysis method, device and system to improve the use effect of data analysis information.

[0005] In order to achieve the above objectives, the present application provides the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a data analysis method, including: a data analysis network element receives effect information of data analysis information from a first network element, the effect information is obtained by the first network element evaluating the use effect achieved by the data analysis information. The data analysis network element determines updated data analysis information based on the effect information.

[0007] Among them, the effect information is used to describe the effect of using the data analysis information.

[0008] The embodiment of the present application provides a data analysis method, in which a data analysis network element receives effect information of data analysis information from a first network element, so that the data analysis network element can determine the quality of the use effect achieved by the data analysis information based on the effect information, and gain insight into whether the data analysis model is accurate. It is convenient for the data analysis network element to update the data analysis information in a timely manner according to the use effect achieved by the data analysis information, and obtain updated data analysis information. In this solution, the data analysis network element can actively update the data analysis information in a timely manner according to the effect information to improve the use effect of the updated data analysis information.

[0009] In one possible implementation, the data analysis network element determines updated data analysis information based on effect information, including: the data analysis network element determines that the usage effect of the data analysis information is lower than or equal to a first preset threshold or level based on the effect information, and the data analysis network element determines updated data analysis information based on the effect information.

[0010] In a possible implementation, if the effect information determines that the use effect of the data analysis information is higher than or equal to a second preset threshold, the data analysis network element determines that the data analysis information does not need to be updated.

[0011] In a possible implementation, the method provided in the embodiment of the present application further includes: the data analysis network element receives a first request from a first network element (e.g., an analysis consumer network function network element), the first request being used to request data analysis information. The first request includes a data analysis identifier corresponding to the data analysis information. The data analysis network element determines to provide the data analysis information to the first network element according to the first request.

[0012] In one possible implementation, before the data analysis network element receives effect information of the data analysis information from the first network element (e.g., analyzing the consumer network function network element), the method provided in the embodiment of the present application further includes: the data analysis network element sends a first message including a first indication to the first network element (e.g., analyzing the consumer network function network element). The first indication is used to instruct the first network element (e.g., analyzing the consumer network function network element) to feed back effect information to the data analysis network element. This makes it easier for the first network element to determine the effect information corresponding to the data analysis information fed back to the data analysis network element.

[0013] In a possible implementation manner, the first message may also include a data analysis identifier corresponding to the data analysis information.

[0014] In one possible implementation, the first message further includes one or more of data analysis information or report information, and the report information is used to determine parameters of the feedback effect information. The report information facilitates the first network element (e.g., the analysis consumer network function network element) to determine the parameters of the feedback effect information.

[0015] In a possible implementation, the method provided in the embodiment of the present application also includes: the data analysis network element sends updated data analysis information to the first network element (for example, an analysis consumer network function network element).

[0016] In one possible implementation, before the data analysis network element receives effect information from the first network element (e.g., the analysis effect evaluation network element), the method provided in the embodiment of the present application further includes: the data analysis network element sends a second message for requesting effect information to the first network element (e.g., the analysis effect evaluation network element), the second message including one or more of a data analysis identifier or report information corresponding to the data analysis information, the report information being used to determine parameters of the feedback effect information. Providing the data analysis identifier facilitates the first network element to determine which type of data analysis information effect information to feedback.

[0017] In a possible implementation, the method provided by the embodiment of the present application also includes: the data analysis network element receives a first applicable scope corresponding to the effect information from the first network element (for example, the analysis effect evaluation network element or the analysis consumer network function network element). The first applicable scope is the scope corresponding to when the data analysis information reaches the effect information. This makes it easier for the data analysis network element to determine that the effect information is the use effect achieved by the data analysis information within the first applicable scope.

[0018] In a possible implementation, the method provided by the embodiment of the present application also includes: the data analysis network element determines the second applicable scope corresponding to the data analysis information. Correspondingly, the second message also includes the second applicable scope. The second applicable scope is the scope of the data analysis information. By carrying the second applicable scope corresponding to the data analysis information in the second message, it is convenient for the first network element (for example, the analysis effect evaluation network element) to determine the effect information of the data analysis information within the second applicable scope. In this case, the first applicable scope is a subset or a full set of the second applicable scope. In other words, the first applicable scope is a partial applicable scope or the entire applicable scope of the second applicable scope, or the first applicable scope is included in the second applicable scope.

[0019] In a possible implementation, the method provided in the embodiment of the present application further includes: the data analysis network element receives information of a first network element (e.g., an analysis effect evaluation network element) from a second network element (e.g., an analysis consumer network function network element). The information of the first network element is used to determine the first network element, and the information of the first network element may be an address of the first network element or an identifier of the first network element.

[0020] In a possible implementation, the method provided in the embodiment of the present application further includes: the data analysis network element sends a second indication and / or a third indication to the second network element. The second indication is used to instruct the second network element to provide the data analysis network element with information of the analysis effect evaluation network element, and the third indication is used to instruct the second network element to provide the data analysis network element with a second applicable scope corresponding to the data analysis information.

[0021] In a possible implementation manner, the method provided in the embodiment of the present application also includes: the data analysis network element sends data analysis information to the second network element.

[0022] In a possible implementation, the data analysis network element determines the second applicable scope corresponding to the data analysis information, including: the data analysis network element receives the second applicable scope corresponding to the data analysis information from the second network element. The second applicable scope can be obtained by the data analysis network element according to the third applicable scope sent to the second network element.

[0023] In a possible implementation, the second network element is a network element that executes data analysis information. The method provided in the embodiment of the present application also includes: the data analysis network element sends updated data analysis information to the second network element.

[0024] In a possible implementation, the report information includes one or more of the following information: a threshold, a deviation, a cycle, a time period, or a maximum number of reports. The threshold is used to indicate that the effect information is sent when the effect information meets the threshold. The deviation is used to indicate the range in which the effect information is allowed to fluctuate above and below the threshold. The effect information is sent when the difference between the effect information and the threshold is outside the deviation range, that is, when the difference between the effect information and the threshold is within the deviation range, the effect information may not be sent. The cycle is used to indicate that the effect information is sent according to the cycle. The time period is used to indicate that the effect information is sent during the time period. The maximum number of reports is used to indicate the maximum number of times the effect information is sent. In this case, the threshold, deviation, cycle, time period, or maximum number of reports can be used in combination with each other. For example, if the report information includes a time period and a maximum number of reports, the report information is used to indicate the maximum number of times the first network element can feedback the effect information within the time period.

[0025] In one possible implementation, the data analysis network element determines updated data analysis information based on effect information, including: the data analysis network element sends a third message to a third network element based on the first applicable scope corresponding to the effect information, and the third message is used to request data within the first applicable scope. The data analysis network element receives data within the first applicable scope from the third network element. The data analysis network element determines updated data analysis information based on the data within the first applicable scope. By requesting data within the first applicable scope and updating the data analysis information based on the data within the first applicable scope, the use effect of the updated data analysis information within the first applicable scope can be improved.

[0026] In one possible implementation, when the data analysis identifier corresponding to the data analysis information is terminal mobility, the first network element is an access management network element, the second applicable scope is the first paging area corresponding to the terminal, and the effect information indicates that the access management network element can page the terminal in the second paging area.

[0027] In one possible implementation, when the data analysis identifier corresponding to the data analysis information is the load information of the fourth network element, and the first network element is a network storage network element or a network management network element, the effect information is the adjusted load information of the fourth network element or the load information of the fourth network element. The adjusted load information includes increased load information or decreased load information. At this time, the first network element indicates to the data analysis network element through the effect information that the load information of the fourth network element has increased or decreased. It should be understood that when the effect information is the load information of the fourth network element, the data analysis network element can autonomously determine whether the load information of the fourth network element has increased or decreased. Of course, the effect information can also be that the load information of the fourth network element has not changed.

[0028] In a possible implementation, when the data analysis identifier corresponding to the data analysis information is the service experience of the service, the first network element is an application function AF network element, and the effect information is the service experience after the service is adjusted or the service experience of the service, and the service experience is used to adjust the service quality QoS parameters of the service. The service experience after the service is adjusted can be an increase in the service experience of the service, or a decrease in the service experience of the service. Of course, if the first network element provides the service experience of the service, the data analysis network element can determine whether the service experience of the service is increased or decreased based on the service experience of the service. Of course, the effect information can also be that the service experience of the service has not changed.

[0029] In a possible implementation, the method provided in the embodiment of the present application further includes: the data analysis network element sends a fourth indication to the second network element (for example, analyzing the consumer network function network element), and the fourth indication is used to analyze the effect information of the consumer network function network element subscribing to the data analysis information from the first network element on behalf of the data analysis network element. The fourth indication can be carried in the same message as the data analysis information and sent to the second network element.

[0030] In a second aspect, an embodiment of the present application provides a data analysis method, including: a first network element determines effect information of data analysis information. The first network element sends the effect information to a data analysis network element.

[0031] An embodiment of the present application provides a data analysis method, which determines effect information of data analysis information through a first network element and sends the effect information to the data analysis network element. This can assist the data analysis network element in updating the data analysis information according to the effect information, thereby improving the use effect of the data analysis information.

[0032] In a possible implementation manner, the first network element may be an analysis effect evaluation network element, or the first network element may be an analysis consumer network function network element.

[0033] In a possible implementation, the method provided in the embodiment of the present application further includes: a first network element (e.g., an analysis consumer network function network element) receives a first message including a first indication from a data analysis network element, wherein the first indication is used to instruct the first network element to feed back effect information to the data analysis network element.

[0034] In a possible implementation, the first message further includes one or more of data analysis information or report information, and the report information is used to determine parameters of the feedback effect information.

[0035] The specific content of the report information can be referred to the description in the first aspect above, which will not be repeated here.

[0036] In a possible implementation, the method provided in the embodiment of the present application also includes: the first network element (for example, the analysis consumer network function network element) receives updated data analysis information from the data analysis network element.

[0037] In a possible implementation, the method provided in the embodiment of the present application further includes: the first network element (e.g., the analysis effect evaluation network element) receives a second message from the data analysis network element for requesting effect information. The second message includes one or more of a data analysis identifier or report information of the data analysis information, and the report information is used to determine parameters of the feedback effect information.

[0038] In one possible implementation, the second message also includes: a second applicable scope corresponding to the data analysis information, where the second applicable scope is the scope within which the data analysis information acts. This facilitates the first network element (e.g., the analysis effect evaluation network element) to determine that the data analysis information acts within the second applicable scope.

[0039] In a possible implementation, the method provided by the embodiment of the present application further includes: the first network element (for example, the network element analyzing the consumer network function or the network element analyzing the effect evaluation) sends a first applicable scope corresponding to the effect information to the data analysis network element, and the first applicable scope is the scope corresponding to when the data analysis information reaches the effect information. This facilitates the data analysis network element to determine the use effect of the data analysis information within the first applicable scope.

[0040] In a possible implementation, the report information includes one or more of the following information: a threshold, a deviation, a cycle, a time period, or a maximum number of reports. The threshold is used to indicate that the effect information is sent when the effect information meets the threshold. The deviation is used to indicate the range in which the effect information is allowed to fluctuate above and below the threshold. When the difference between the effect information and the threshold is outside the deviation range, the effect information is sent. In other words, when the difference between the effect information and the threshold is within the deviation range, the effect information may not be sent. The cycle is used to indicate that the effect information is sent according to the cycle. The time period is used to indicate that the effect information is sent during the time period. The maximum number of reports is used to indicate the maximum number of times the effect information is sent.

[0041] It should be noted that the threshold, deviation, cycle, time period or maximum number of reports in the embodiment of the present application can be used alone or in combination. Exemplarily, if the report information includes a time period and a maximum number of reports, the report information is used to indicate the maximum number of times the first network element can feedback effect information within the time period.

[0042] In a possible implementation, the method provided by the embodiment of the present application also includes: the first network element receives a fourth indication from the data analysis network element, and the fourth indication is used by the first network element to subscribe to the effect information of the data analysis information from the analysis effect evaluation network element on behalf of the data analysis network element. The fourth indication can be carried in the same message as the data analysis information and sent to the first network element. At this time, the first network element can be an analysis consumer network function network element.

[0043] In a third aspect, an embodiment of the present application provides a data analysis device, which can implement the method in the first aspect or any possible implementation of the first aspect, and thus can also achieve the beneficial effects in the first aspect or any possible implementation of the first aspect. The data analysis device can be a data analysis network element, or it can be a device that can support the data analysis network element to implement the method in the first aspect or any possible implementation of the first aspect, such as a chip used in a data analysis network element. The device can implement the above method through software, hardware, or by executing corresponding software through hardware.

[0044] In one example, the data analysis device includes: a communication unit, configured to receive effect information of data analysis information from a first network element, the effect information being obtained by the first network element evaluating the use effect achieved by the data analysis information; and a processing unit, configured to determine updated data analysis information according to the effect information.

[0045] Among them, the effect information is used to describe the effect of using the data analysis information.

[0046] In a possible implementation, the processing unit is configured to determine, based on the effect information, that the use effect of the data analysis information is lower than a preset threshold, and determine updated data analysis information based on the effect information.

[0047] In a possible implementation, before the communication unit is used to receive effect information of data analysis information from the first network element (e.g., analyzing the consumer network function network element), the communication unit is also used to send a first message including a first indication to the first network element (e.g., analyzing the consumer network function network element). The first indication is used to instruct the first network element to feed back effect information to the data analysis network element.

[0048] In a possible implementation, the first message further includes one or more of data analysis information or report information, and the report information is used to determine parameters of the feedback effect information.

[0049] In a possible implementation manner, the first message may further include a data analysis identifier corresponding to the data analysis information.

[0050] In a possible implementation, the communication unit is further configured to send updated data analysis information to the first network element (eg, an analysis customer network function network element).

[0051] In one possible implementation, before a communication unit is used to receive effect information from a first network element (e.g., an analysis and effect evaluation network element), the communication unit is also used to send a second message to the first network element (e.g., an analysis and effect evaluation network element) for requesting effect information, and the second message includes one or more of a data analysis identifier or report information of the data analysis information, and the report information is used to determine parameters of the feedback effect information.

[0052] In one possible implementation, the method provided by an embodiment of the present application also includes: the data analysis network element receives a first applicable scope corresponding to effect information from a first network element (for example, a consumer network function analysis network element or an effect evaluation analysis network element), and the first applicable scope is the scope when the data analysis information reaches the above-mentioned effect information.

[0053] In one possible implementation, the method provided by the embodiment of the present application also includes: the data analysis network element determines a second applicable scope corresponding to the data analysis information. The second message also includes a second applicable scope, which is the scope of the data analysis information. By carrying the second applicable scope corresponding to the data analysis information in the second message, it is convenient for the first network element (for example, the analysis effect evaluation network element) to determine the effect information of the data analysis information within the second applicable scope. In this case, the first applicable scope is a subset or a full set of the second applicable scope. In other words, the first applicable scope is a partial applicable scope or the entire applicable scope of the second applicable scope, or the first applicable scope is included in the second applicable scope.

[0054] In a possible implementation, the method provided in the embodiment of the present application also includes: the data analysis network element sends data analysis information to the second network element (for example, an analysis consumer network function network element).

[0055] In a possible implementation, the data analysis network element determines the second applicable scope corresponding to the data analysis information, including: the data analysis network element receives the second applicable scope corresponding to the data analysis information from the second network element. The second applicable scope can be determined by the second network element based on the third applicable scope provided by the data analysis network element. The second applicable scope is part or all of the applicable scope of the third applicable scope.

[0056] In a possible implementation, the second network element is a network element that executes data analysis information. The method provided in the embodiment of the present application also includes: the data analysis network element sends updated data analysis information to the second network element.

[0057] In a possible implementation, the communication unit is further configured to receive information of a first network element (e.g., an analysis effect evaluation network element) from a second network element. The information of the first network element is used to determine the first network element, and the information of the first network element may be an address of the first network element or an identifier of the first network element.

[0058] In a possible implementation, the communication unit is further used to send a second indication and / or a third indication to the second network element. The second indication is used to instruct the second network element to provide the data analysis network element with information of the analysis effect evaluation network element, and the third indication is used to instruct the second network element to provide the data analysis network element with a second applicable scope corresponding to the data analysis information.

[0059] In one possible implementation, the report information includes one or more of the following information: a threshold, a deviation, a cycle, a time period, or a maximum number of reports. The threshold is used to indicate that the effect information is sent when the effect information meets the threshold. The deviation is used to indicate the range in which the effect information is allowed to fluctuate above and below the threshold. The effect information is sent when the difference between the effect information and the threshold is outside the deviation range; the cycle is used to indicate that the effect information is sent according to the cycle. The time period is used to indicate that the effect information is sent in the time period. The maximum number of reports is used to indicate the maximum number of times the effect information is sent. In this case, the parameters of the threshold, deviation, cycle, time period, or maximum number of reports can be used in combination with each other. For example, if the report information includes the time period and the maximum number of reports, the report information is used to indicate the maximum number of times the first network element can feedback the effect information within the time period.

[0060] In one possible implementation, the data analysis network element determines updated data analysis information based on effect information, including: the data analysis network element sends a third message to a third network element based on the first applicable scope corresponding to the effect information, and the third message is used to request data within the first applicable scope. The data analysis network element receives data from the first applicable scope. The data analysis network element determines updated data analysis information based on the data within the first applicable scope. By requesting data within the first applicable scope and updating the data analysis information based on the data within the first applicable scope, the use effect of the updated data analysis information within the first applicable scope can be improved.

[0061] In a possible implementation, when the data analysis information is terminal mobility, the first network element is an access management network element, the second applicable scope is a first paging area corresponding to the terminal, and the effect information indicates that the access management network element can page the terminal in the second paging area.

[0062] In a possible implementation, when the data analysis information is the load information of the fourth network element, the first network element is a network storage network element or a network management network element, and the effect information is the load information of the fourth network element after adjustment or the load information of the fourth network element. Alternatively, the effect information is that the load information of the fourth network element has not changed.

[0063] In a possible implementation, when the data analysis information is a service experience of a service, the first network element is an application function AF network element, the effect information is a service experience after the service is adjusted or a service experience of the service, and the service experience is used to adjust the service quality QoS parameters of the service. Alternatively, the effect information is that the service experience of the service has not changed.

[0064] In a possible implementation, the communication unit is further configured to send a fourth indication to the first network element (e.g., the analysis consumer network function network element), the fourth indication being used to analyze effect information of the consumer network function network element subscribing to the data analysis information from the first network element on behalf of the data analysis device. The fourth indication can be carried in the same message as the data analysis information and sent to the first network element.

[0065] Exemplarily, when the data analysis device is a chip or chip system within a data analysis network element, the processing unit may be a processor, and the communication unit may be a communication interface. For example, the communication interface may be an input / output interface, a pin, or a circuit, etc. The processing unit executes the instructions stored in the storage unit so that the data analysis network element implements a data analysis method described in the first aspect or any possible implementation of the first aspect. The storage unit may be a storage unit within the chip (e.g., a register, a cache, etc.), or it may be a storage unit within the data analysis network element that is located outside the chip (e.g., a read-only memory, a random access memory, etc.).

[0066] In a fourth aspect, an embodiment of the present application provides a data analysis device, which can implement the method in the second aspect or any possible implementation of the second aspect, and thus can also achieve the beneficial effects in the second aspect or any possible implementation of the second aspect. The data analysis device can be a first network element, or a device that supports the first network element to implement the method in the second aspect or any possible implementation of the second aspect, such as a chip applied to the first network element. The device can implement the above method through software, hardware, or by executing corresponding software through hardware.

[0067] In one example, the data analysis device includes: a processing unit, configured to determine effect information of the data analysis information; and a communication unit, configured to send the effect information to a data analysis network element.

[0068] In a possible implementation, the communication unit is further configured to receive a first message including a first indication from the data analysis network element, wherein the first indication is used to instruct the data analysis device to feed back effect information to the data analysis network element.

[0069] In a possible implementation, the first message further includes one or more of data analysis information or report information, and the report information is used to determine parameters of the feedback effect information.

[0070] The specific content of the report information can be referred to the description in the first aspect above, which will not be repeated here.

[0071] In a possible implementation, the communication unit is further used to receive updated data analysis information from the data analysis network element.

[0072] In a possible implementation, the communication unit is further configured to receive a second message from the data analysis network element for requesting effect information. The second message includes one or more of a data analysis identifier of the data analysis information or report information, and the report information is used to determine parameters of the feedback effect information.

[0073] In a possible implementation, the second message further includes: a second applicable scope corresponding to the data analysis information, so that it is convenient for the data analysis device to determine that the data analysis information is effective within the second applicable scope.

[0074] In a possible implementation, the communication unit is further used to send a first applicable scope corresponding to the effect information to the data analysis network element. The first applicable scope is the scope corresponding to when the data analysis information reaches the effect information. This facilitates the data analysis network element to determine the use effect of the data analysis information within the first applicable scope.

[0075] In a possible implementation, the report information includes one or more of the following information: a threshold, a deviation, a cycle, a time period, or a maximum number of reports. The threshold is used to indicate that the effect information is sent when the effect information meets the threshold. The deviation is used to indicate the range within which the effect information is allowed to fluctuate above and below the threshold, and the effect information is sent when the difference between the effect information and the threshold is outside the deviation range. The cycle is used to indicate that the effect information is sent according to the cycle. The time period is used to indicate that the effect information is sent in the time period. The maximum number of reports is used to indicate the maximum number of times the effect information is sent.

[0076] In a possible implementation, the communication unit is further used to receive a fourth indication from the data analysis network element, where the fourth indication is used for the data analysis device to subscribe to the effect information of the data analysis information from the analysis effect evaluation network element on behalf of the data analysis network element. The fourth indication can be carried in the same message as the data analysis information and sent to the data analysis device.

[0077] Exemplarily, when the data analysis device is a chip or a chip system within the first network element, the processing unit may be a processor, and the communication unit may be a communication interface. For example, the communication interface may be an input / output interface, a pin or a circuit, etc. The processing unit executes the instructions stored in the storage unit so that the first network element implements a data analysis method described in the second aspect or any possible implementation of the second aspect. The storage unit may be a storage unit within the chip (for example, a register, a cache, etc.), or it may be a storage unit within the first network element that is located outside the chip (for example, a read-only memory, a random access memory, etc.).

[0078] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is run on a computer, the computer executes a data analysis method described in any possible implementation of the first aspect to the first aspect.

[0079] In the sixth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is run on a computer, the computer executes a data analysis method described in any possible implementation of the second aspect to the second aspect.

[0080] In a seventh aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute a data analysis method described in the first aspect or various possible implementations of the first aspect.

[0081] In an eighth aspect, the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute a data analysis method described in the second aspect or various possible implementations of the second aspect.

[0082] In the ninth aspect, an embodiment of the present application provides a data analysis device for implementing various methods in various possible designs of any one of the first to second aspects above. The data analysis device may be the above-mentioned data analysis network element, or a device including the above-mentioned data analysis network element. Alternatively, the data analysis device may be the above-mentioned first network element, or a device including the above-mentioned first network element. The data analysis device includes modules and units corresponding to the above-mentioned methods, and the modules and units may be implemented by hardware, software, or by executing corresponding software implementations by hardware. The hardware or software includes one or more modules or units corresponding to the above-mentioned functions.

[0083] In a tenth aspect, an embodiment of the present application provides a data analysis device, which includes: at least one processor and a communication interface. Wherein, when the data analysis device is running, the processor executes the computer execution instruction stored in the data analysis device, so that the data analysis device performs a method of any one of the various possible designs of any aspect of the first aspect or the second aspect mentioned above. For example, the data analysis device can be a data analysis network element, or a chip applied in a data analysis network element. For example, the data analysis device can be a first network element, or a chip applied in a first network element.

[0084] It should be understood that the data analysis device described in the tenth aspect may also include: a bus and a memory, the memory being used to store code and data. Optionally, at least one processor communication interface and the memory are coupled to each other.

[0085] In the eleventh aspect, an embodiment of the present application provides a data analysis device, which includes: at least one processor. Wherein, at least one processor is coupled to a memory, and when the data analysis device is running, the processor executes a computer execution instruction or program stored in the memory, so that the data analysis device performs a method as described in any of the various possible designs of the first aspect or any aspect of the first aspect. For example, the data analysis device can be a data analysis network element, or a chip used in a data analysis network element.

[0086] In a twelfth aspect, an embodiment of the present application provides a data analysis device, the data analysis device comprising: at least one processor. Wherein, at least one processor is coupled to a memory, and when the data analysis device is running, the processor executes a computer-executable instruction or program stored in the memory, so that the data analysis device performs a method as described in any of the various possible designs of the second aspect or any aspect of the second aspect. For example, the data analysis device may be a first network element, or a chip applied to the first network element.

[0087] In the thirteenth aspect, an embodiment of the present application provides a data analysis device, which includes a processor and a storage medium, wherein the storage medium stores instructions, and when the instructions are executed by the processor, a data analysis method described in the first aspect or various possible implementation methods of the first aspect is implemented.

[0088] In the fourteenth aspect, an embodiment of the present application provides a data analysis device, which includes a processor and a storage medium, wherein the storage medium stores instructions, and when the instructions are executed by the processor, a data analysis method described in the second aspect or various possible implementation methods of the second aspect is implemented.

[0089] In the fifteenth aspect, an embodiment of the present application provides a data analysis device, which includes one or more modules for implementing the methods of the first and second aspects mentioned above, and the one or more modules may correspond to each step in the methods of the first and second aspects mentioned above.

[0090] In a sixteenth aspect, an embodiment of the present application provides a chip, the chip comprising a processor and a communication interface, the communication interface and the processor are coupled, the processor is used to run a computer program or instruction to implement a data analysis method described in the first aspect or various possible implementations of the first aspect. The communication interface is used to communicate with other modules outside the chip.

[0091] In a seventeenth aspect, an embodiment of the present application provides a chip, the chip comprising a processor and a communication interface, the communication interface and the processor are coupled, the processor is used to run a computer program or instruction to implement a data analysis method described in the second aspect or various possible implementations of the second aspect. The communication interface is used to communicate with other modules outside the chip.

[0092] Specifically, the chip provided in the embodiment of the present application also includes a memory for storing computer programs or instructions.

[0093] In the eighteenth aspect, an embodiment of the present application provides a communication system, which includes: the device described in the third aspect or any possible implementation of the third aspect, and the device described in the fourth aspect or any possible implementation of the fourth aspect.

[0094] Any of the above-mentioned devices, computer storage media, computer program products, chips, or communication systems are used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding schemes in the corresponding methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0095] Figure 1 A schematic diagram of an optimized data analysis model provided in an embodiment of the present application;

[0096] Figure 2 A schematic diagram of the architecture of a communication system provided in an embodiment of the present application;

[0097] Figure 3 A 5G network architecture diagram provided for an embodiment of the present application;

[0098] Figure 4 Another 5G network architecture diagram provided for an embodiment of the present application;

[0099] Figure 5 A schematic diagram of the structure of a communication device provided in an embodiment of the present application;

[0100] Figure 6 to Figure 9 A flowchart of a data analysis method provided in an embodiment of the present application;

[0101] Fig.10 A schematic diagram of the structure of a data analysis device provided in an embodiment of the present application;

[0102] Fig.11 A schematic diagram of the structure of a chip provided in an embodiment of the present application. DETAILED DESCRIPTION

[0103] In order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first" and "second" are used to distinguish the same items or similar items with basically the same functions and effects. For example, the first network element and the second network element are only used to distinguish different network elements, and their order is not limited. Those skilled in the art can understand that the words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not necessarily limit them to be different.

[0104] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0105] The network architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. A person of ordinary skill in the art can appreciate that with the evolution of the network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0106] In the present application, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0107] The system architecture and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. It is known to those skilled in the art that with the evolution of network architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems. In the embodiments of the present application, the method provided is applied to an NR system or a 5G network as an example for explanation.

[0108] In order to optimize data analysis information, NWDAF can continuously obtain new live network data and input the acquired live network data into the trained service experience model to obtain inference results. Figure 1 As shown, NWDAF then compares the inference result with the actual result. Then, NWDAF determines whether the performance of the service experience model (for example, accuracy, error rate, recall rate, etc.) decreases during the inference phase, or NWDAF determines the performance of the service experience model during the training phase. If NWDAF finds that the performance of the service experience model has decreased, NWDAF can re-collect new existing network data, and then NWDAF retrains the service experience model based on the new existing network data. Then, NWDAF obtains data analysis information based on the updated service experience model. For example, NWDAF can update the service experience model, optimize the data analysis information of the service experience, and minimize the gap between the service experience results output by the service experience model and the actual service experience results. However, since NWDAF evaluates and analyzes the effect information (such as the average service experience increase or decrease value) generated by the consumer network function network element triggering the execution action, and thus cannot update the data analysis information in time according to the effect information, the data analysis information provided to the analysis of the consumer network function network element may also fail to meet the service experience of the analysis of the consumer network function network element. Based on this, the embodiment of the present application introduces the following Figure 2 The architecture shown:

[0109] like Figure 2 As shown, Figure 2A communication system provided by an embodiment of the present application is shown, and the communication system includes: a data analysis network element (for example: NWDAF network element) 10, an analysis consumer network function (analytics consumer network function) network element 20 communicating with the data analysis network element 10, and an analysis effect evaluation (analytics effect evaluation function) network element 30. In a possible implementation, the analysis consumer network function network element 20 and the analysis effect evaluation network element 30 can also communicate with each other. The analysis consumer network function network element can also be called a network data analysis service consumer function (NWDAF service consumer) or a consumer network function (consumer network function) network element. The analysis effect evaluation network element can also be called an effect information evaluation network element.

[0110] Among them, the data analysis network element 10 has the following functions: data collection, data analysis (including feature selection, algorithm selection, model training, etc., most of which are implemented by manufacturers) and determination of data analysis (Data Analytics) information, as well as data analysis information feedback (that is, the data analysis network element 10 sends the results of the data analysis to the analysis consumer network function network element 20).

[0111] It is worth noting that in the embodiment of the present application, the data analysis information may also be referred to as data analysis results. For example, the data analysis network element 10 outputs analysis results based on data analysis.

[0112] As an implementation method, the data analysis network element 10 in the embodiment of the present application can be deployed separately. Of course, the data analysis network element 10 can also be integrated in a network function (NF) network element, that is, the data analysis network element 10 can be included in the NF network element as a module. In other words, a certain NF network element has the function of the data analysis network element 10. Of course, the data analysis network element 10 can also be deployed in the same device as other NF network elements, and the embodiment of the present application does not limit this. For example, the data analysis network element 10 can be integrated in a session management network element or a user plane network element.

[0113] For data collection, the data analysis network element 10 can collect data from one or more network function (NF) network elements (for example, access management network element, session management network element, user plane network element, policy control network element), network management, application network elements, etc. For example, define the event exposure service of the network element, collect non-network management data, open up the two-way interface between the data analysis network element 10 and the network management network element, and allow the data analysis network element 10 and the network management network element to interact with each other in both directions. Open up the interface between the data analysis network element 10 and the third-party network element (for example, the application network element) to collect business data. For example, the data analysis network element 10 can use the existing minimum drive test (MDT) mechanism to collect terminal data (such as the wireless channel quality of the terminal, air interface quality, including reference signal received power (RSRP), reference signal received quality (RSRQ), signal to interference plus noise ratio (SINR), etc.) from the network management network element.

[0114] For data analysis, the data analysis network element 10 can train data analysis models, update data analysis models, and generate data analysis information based on data collected from one or more network elements (for example, the various analysis consumer network function network elements shown in Table 1). The process of the data analysis network element 10 training data analysis models and updating data analysis models based on data collected from one or more network elements can refer to the description of the prior art and will not be repeated here.

[0115] For data analysis information feedback, for example, a general service is defined to enable the data analysis network element 10 to feed back data analysis information to the NF network element, the network management network element, and the application function network element.

[0116] The analysis consumer network function network element 20 is used to trigger the behavior of the corresponding network element according to the data analysis information. The analysis effect evaluation network element 30 is used to evaluate and provide effect information of the data analysis information. It can be understood that the embodiment of the present application takes the network element that provides the effect information of the data analysis information as the analysis effect evaluation network element 30 as an example. Of course, the network element that provides the effect information of the data analysis information can also be called by other names (such as effect feedback provider), which is not limited by the embodiment of the present application.

[0117] It can be understood that in the embodiment of the present application, the data analysis network element is a network element that performs data analysis to obtain data analysis information, and the consumer network function analysis network element 20 is a network element that uses the data analysis information.

[0118] It should be noted that when the analysis consumer network function network element 20 itself has effect information for determining data analysis information, the analysis effect evaluation network element 30 can be omitted, that is, the analysis effect evaluation network element 30 is optional. In the case where the analysis consumer network function network element 20 itself does not have effect information for determining data analysis information, the communication system may further include the analysis effect evaluation network element 30.

[0119] Among them, the analysis consumer network function network element 20 can be one or more of an access management network element, a session management network element, a user plane network element, a policy control network element, a network management network element, or an application network element.

[0120] If the above-mentioned communication system is applied to a 5G network, the network element or entity corresponding to the user plane network element may be a user plane function (UPF) network element, the network element or entity corresponding to the access management network element may be an access and mobility management function (AMF) network element, the network element or entity corresponding to the session management network element may be a session management function (SMF) network element, the network element or entity corresponding to the policy control network element may be a policy control function (policy control function) network element, the network element or entity corresponding to the application network element may be an application function (AF) network element, and the network element or entity or service corresponding to the network management may be an operation, administration, and maintenance (OAM) network element or service (also referred to as operation, management and maintenance network element, or operation, management and maintenance service). In a 5G network, the data analysis network element 10 in the embodiment of the present application may be a network data analysis function (NWDAF) network element in the 5GC, or a management data analysis service (MDAS) of a network manager, or even a data analysis network element or data analysis entity on the radio access network (RAN) side.

[0121] In the evolved packet core (EPC), that is, the 4G core network, the network element or entity corresponding to the access management network element can be a mobility management entity (MME). The network element or entity corresponding to the user plane network element can be a public data network gateway (PDN GW, PGW) or a serving network element (SGW). The network element or entity corresponding to the policy control network element can be a policy and charging rules function (PCRF). That is to say, in the 4G core network, the MME has both session management function and mobility management function. The data analysis network element 10 can also be called a network data analysis network element in the 4G core network.

[0122] like Figure 3 As shown, in addition to the core network elements mentioned above, the 5G network may also include: (radio) access network ((R)AN), authentication server function (AUSF) network element, network slice selection function (NSSF) network element, network exposure function (NEF) network element, user data repository (UDR), unified data management (UDM) network element, data network (DN). Network repository function (NRF) network element, which is not reflected in the architecture diagram, is mainly used for network element discovery.

[0123] Among them, the terminal communicates with the AMF network element through the N1 interface (referred to as N1). The AMF network element communicates with the SMF network element through the N11 interface (referred to as N11). The SMF network element communicates with one or more UPF network elements through the N4 interface (referred to as N4). Any two UPF network elements among one or more UPF network elements communicate through the N9 interface (referred to as N9). The UPF network element communicates with the data network (DN) controlled by the AF network element through the N6 interface (referred to as N6). The terminal accesses the 5G core network (5G Core, 5GC) through the (R)AN, and the (R)AN and the AMF network element communicate through the N2 interface (referred to as N2). The SMF network element communicates with the PCF network element through the N7 interface (referred to as N7), and the PCF network element communicates with the AF network element through the N5 interface. The (R)AN communicates with the UPF network element through the N3 interface (referred to as N3). Any two AMF network elements communicate through the N14 interface (referred to as N14). The SMF network element communicates with the UDM through the N10 interface (N10 for short). The AMF network element communicates with the AUSF network element through the N12 interface (N12 for short). The AUSF network element communicates with the UDM network element through the N13 interface (N13 for short). The AMF network element communicates with the UDM network element through the N8 interface (N8 for short).

[0124] It should be understood that Figure 3 In the network architecture shown in FIG. 1 , the control plane network elements in 5GC can also interact using service-oriented interfaces. Figure 4 As shown, the AMF network element, SMF network element, UDM network element, or PCF network element uses a service based interface to interact. For example, the service based interface provided by the AMF network element to the outside may be Namf. The service based interface provided by the SMF network element to the outside may be Nsmf. The service based interface provided by the UDM network element to the outside may be Nudm. The service based interface provided by the PCF network element to the outside may be Npcf. It should be understood that the relevant description of the names of the various service based interfaces can refer to the 5G system architecture diagram in the prior art, which will not be repeated here.

[0125] It should be noted that Figure 3 or Figure 4 Only one UPF network element and one SMF network element are given as examples. Of course, there may be multiple UPF network elements and SMF network elements, such as SMF network element 1 and SMF network element 2, which is not specifically limited in the embodiment of the present application.

[0126] It should be noted that Figure 3 or Figure 4The (R)AN, AMF network element, SMF network element, UDM network element, UPF network element, PCF network element, authentication server function (AUSF) network element, etc. are just a name, and the name does not limit the device itself. In the 5G network and other future networks, the network elements or entities corresponding to the (R)AN, AMF network element, SMF network element, UDM network element, UPF network element and PCF network element may also be other names, and the embodiments of the present application do not make specific limitations on this. For example, the UDM network element may also be replaced by a home subscriber server (HSS) or a user subscription database (USD) or a database entity, etc., which are uniformly explained here and will not be repeated later.

[0127] Figure 5 The structure of the data analysis network element 10, the analysis consumer network function network element 20 and the analysis effect evaluation network element 30 in the embodiment of the present application can all refer to the following. Figure 5 The communication device includes at least one processor 51, a communication line 54 and at least one communication interface ( Figure 5 The communication interface 53 is used as an example for explanation).

[0128] The processor 51 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0129] The communication link 54 may include a pathway for transmitting information between the above-mentioned components.

[0130] The communication interface 53 is used to exchange information with other devices, for example, using any transceiver-like device to communicate with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area networks (WLAN), etc.

[0131] Optionally, the communication device may further include a memory 52 .

[0132] The memory 52 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, an optical disc storage (including a compressed optical disc, a laser disc, an optical disc, a digital versatile disc, a Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may be independent and connected to the processor via a communication line 54. The memory may also be integrated with the processor.

[0133] The memory 52 is used to store computer-executable instructions for executing the solution of the present application, and the execution is controlled by the processor 51. The processor 51 is used to execute the computer-executable instructions stored in the memory 52, thereby realizing a data analysis method provided in the following embodiment of the present application.

[0134] Optionally, the computer-executable instructions in the embodiments of the present application may also be referred to as application code, which is not specifically limited in the embodiments of the present application.

[0135] In a specific implementation, as an embodiment, the processor 51 may include one or more CPUs, such as Figure 5 CPU0 and CPU1 in.

[0136] In a specific implementation, as an embodiment, the communication device may include multiple processors, such as Figure 5 51 and processor 55 in the embodiment of the present invention. Each of these processors can be a single-CPU processor or a multi-CPU processor. The processor here can refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).

[0137] In the embodiments of the present application, the specific structure of the execution subject of a data analysis method is not particularly limited in the embodiments of the present application. As long as the program that records the code of the data analysis method of the embodiments of the present application can be run to communicate according to the data analysis method of the embodiments of the present application, for example, the execution subject of a data analysis method provided in the embodiments of the present application may be a data analysis network element, or a data analysis device applied in a data analysis network element, such as a chip, and the present application does not limit this. Alternatively, the execution subject of a data analysis method provided in the embodiments of the present application may be a first network element, or a data analysis device applied in a first network element, such as a chip, and the present application does not limit this. The following embodiments are described by taking the execution subjects of a data analysis method as the data analysis network element and the first network element as examples.

[0138] Combination Figure 2 The communication system shown in Figure 6 As shown, an embodiment of the present application provides a data analysis method, the method comprising:

[0139] Step 601: The first network element determines effect information corresponding to data analysis information.

[0140] For example, the first network element may be Figure 2 The analysis consumer network function network element 20 or the first network element shown may be an analysis effect evaluation network element 30 .

[0141] The effect information in the embodiment of the present application can be obtained by evaluating the use effect achieved by the first network element data analysis information.

[0142] For example, the effect information may be feedback from the first network element on the data analysis information obtained by the data analysis network element 10 during actual use. For example, as shown in Table 1 below, the data analysis information indicates that the access management network element pages UE1 in cell 1, cell 2, and cell 3. However, in the actual process, the access management network element does not page UE1 in cell 1 and cell 3, but pages UE1 in cell 2. Therefore, the effect information may be that UE1 is not paged in cell 1 and cell 3, but is paged in cell 2. Or the effect information may be that when UE1 is paged in cell 2, the signal quality of UE1 is greater than the signal quality of UE1 when UE1 is paged in cell 1.

[0143] For another example, the data analysis information may be service experience 1 of the service. If the first network element determines that the service experience 1 of the service provided by the data analysis network element 10 cannot meet the service requirements of the service (for example, the delay is delay 1), the effect information may be that the service experience 1 cannot meet the service requirements of the service. Alternatively, the effect information may be that when the service experience 1 is used, the delay of the service of the service is delay 2 (delay 2 is higher than delay 1). The service requirements may be bandwidth, delay, packet loss rate, etc.

[0144] For another example, the data analysis information is: scheduling resource 1 for the first network slice. If the first network element determines that resource 1 is scheduled for the first network slice, the slice requirement of the first network slice cannot be met (for example, the slice requirement of the first network slice is that the number of terminal accesses is N1), therefore, the effect information may be that the use of service experience 1 cannot meet the slice requirement of the first network slice. Or the effect information may be that when resource 1 is scheduled for the first network slice, the number of terminal accesses in the first network slice is N2 (N2 is less than N1). Alternatively, if the first network element determines that resource 1 is scheduled for the first network slice, the number of terminals actually accessed in the first network slice is less than the number of terminals allowed to access the first network slice, therefore, the effect information may be reduced to the first network slice scheduling resource. Or the first network element may determine that when using resource 2, the number of terminals actually accessed in the first network slice is close to the number of terminals allowed to access the first network slice, then the effect information may be: scheduling resource 2 for the first network slice.

[0145] As a specific implementation: In the embodiment of the present application, the data analysis network element 10 can actively send data analysis information to the first network element. Of course, the data analysis network element can also send data analysis information to the first network element based on the request for data analysis information from the first network element. For the content of the data analysis information, please refer to the content in Table 1.

[0146] The following is shown in Table 1, which shows the content of the data analysis information and the corresponding behavior triggered by the analysis consumer network function network element 20 according to the data analysis information.

[0147] Table 1 Contents of data analysis information and corresponding actions triggered by network elements based on data analysis information

[0148]

[0149]

[0150] In an embodiment of the present application, background traffic (BD) refers to the traffic generated during the transmission of service data that has no requirements for (or is not sensitive to) transmission timeliness. Or the background traffic refers to the traffic generated during the transmission of service data that has no requirements for transmission timeliness but has high (or sensitive) tariff requirements. Or the network slice used for background traffic transmission has no SLA requirements, that is, as long as the network allows the transmission of background traffic, there is no transmission quality (such as transmission delay, transmission bandwidth) requirements. Therefore, the PCF network element can determine to transmit background traffic when the network is idle.

[0151] As a possible specific implementation: the first network element can actively determine the effect information corresponding to the data analysis information, or it can determine the effect information corresponding to the data analysis information under the triggering of the data analysis network element 10, and the embodiment of the present application is not limited to this.

[0152] Step 602: The first network element sends effect information to the data analysis network element 10. Correspondingly, the data analysis network element 10 receives effect information of the data analysis information from the first network element.

[0153] In one possible implementation, step 602 may be implemented in the following manner: the first network element sends a first response to the data analysis network element 10, and correspondingly, the data analysis network element 10 receives the first response from the first network element. The first response includes effect information of the data analysis information. For example, the first response includes a data analysis identifier and effect information corresponding to the data analysis information.

[0154] Step 603: The data analysis network element determines updated data analysis information according to the effect information.

[0155] The embodiment of the present application provides a data analysis method, in which a data analysis network element receives effect information of data analysis information from a first network element, so that the data analysis network element can determine the quality of the use effect achieved by the data analysis information based on the effect information, and gain insight into whether the data analysis model is accurate. It is convenient for the data analysis network element to update the data analysis information in a timely manner according to the use effect achieved by the data analysis information, and obtain updated data analysis information. In this solution, the data analysis network element can actively update the data analysis information in a timely manner according to the effect information to improve the use effect of the updated data analysis information.

[0156] In the embodiment of the present application, the first network element may be the analysis consumer network function network element 20 or the first network element may be the analysis effect evaluation network element 30. However, the analysis consumer network function network element 20 may have the function of evaluating the use effect achieved by the data analysis information to obtain effect information, and the analysis consumer network function network element 20 may not have the function of evaluating the use effect achieved by the data analysis information to obtain effect information. In the case where the analysis consumer network function network element 20 may not have the function of evaluating the use effect achieved by the data analysis information to obtain effect information, the effect information may be provided with the help of a third-party network element (for example, the analysis effect evaluation network element 30). However, in different situations, there are differences in the process of the data analysis network element 10 requesting the analysis effect evaluation network element 30 or the analysis consumer network function network element 20 reporting the effect information, so they will be introduced separately as follows:

[0157] Embodiment 1: The first network element is the consumer network function analysis network element 20, and the consumer network function analysis network element 20 has the function of evaluating the use effect achieved by the data analysis information to obtain effect information.

[0158] like Figure 7 As shown, Figure 7 The embodiment shown takes the first network element as the consumer network function network element 20 as an example to illustrate another embodiment of the present application. Figure 7 Step 709 in the illustrated embodiment is as follows: Figure 6 A possible implementation of step 601 in the embodiment, step 710 is the same as step 602, and step 712 is a possible implementation of step 603, which will not be repeated here.

[0159] In a possible embodiment, Figure 7 As shown, the method provided in the embodiment of the present application may further include steps 701 to 708 before step 709.

[0160] Step 701: The analysis consumer network function network element 20 sends a first request to the data analysis network element 10. Correspondingly, the data analysis network element 10 receives the first request from the analysis consumer network function network element 20. The first request is used to request data analysis information.

[0161] Exemplarily, the first request may carry one or more of a data analysis identifier (Analytics ID), analysis filter information (Analytics Filter), or analysis report information (Analytics Reporting Information).

[0162] The data analysis identifier is used to identify the type of data analysis information. For example, the data analysis network element 10 analyzing the consumer network function network element 20 indicates the type of data analysis information required for analyzing the consumer network function network element 20. For example, the data analysis identifier can be specifically described in Table 1, which will not be repeated here.

[0163] Among them, the analysis filter information (Analytics Filter) indicates the scope of the data analysis information requested by the analysis consumer network function network element 20. For example, the analysis filter information includes one or more of the following: terminal identification (UE ID), area (area information), service identification (application ID), slice identification (for example, single network slice selection assistance information (S-NSSAI)), etc. In the embodiment of the present application, the analysis filter information is the terminal identification (for example, UE1~UE5), which indicates that the scope of the data analysis information requested by the analysis consumer network function network element 20 is UE1~UE5.

[0164] Exemplarily, the identifier of the terminal in the embodiment of the present application can be one or more of the following: internet protocol address (internet protocol, IP), subscription permanent identifier (subscription permanent identifier, SUPI), permanent equipment identifier (permanent equipment identifier, PEI), generic public subscription identifier (generic public subscription identifier, GPSI), international mobile subscriber identifier (international mobile subscriber identifier, IMSI), international mobile equipment identity (international mobile equipment identity, IMEI), IP address and mobile station international integrated service digital network number (mobile station international integrated service digital network number, MSISDN). In the following embodiments, any identification of the terminal involved can refer to the description here, and will not be repeated later.

[0165] Exemplarily, the area in the embodiment of the present application may be an area where one or more terminals are located. For example, the area where the terminal is located may be the area information or the attribution area information or the visited area information of the terminal. For example, the area information or the attribution area information or the visited area information of the terminal may be one or more of the following information: tracking area identifier (TAI), tracking area identifier list (list of TAI(s)), routing area identifier (RAI), routing area identifier list (list of RAI(s)), cell identifier (CellID), cell identifier list (list of Cell ID(s)), geographic area identifier (geographical area identifier), network code (NC), country code (country code, CC), city code (citycode), county code (county code). In the following embodiments, any area information or attribution area information or visited area information involving the terminal may refer to the description here, and will not be repeated later.

[0166] Among them, the analysis report information indicates the number of times, time periods, cycles, thresholds (that is, when the data analysis information meets the threshold, the data analysis network element 10 will feedback the data analysis information to the analysis consumer network function network element 20), the accuracy requirements of the data analysis information, etc. Of course, the analysis report information can also carry an offset value, which can be used in combination with the number of times, time periods, cycles, thresholds, etc. For example, if the number of times indicated by the analysis report information is 5 times and the offset value is 1, the data analysis network element can send data analysis information to the analysis consumer network function network element 20 4 to 6 times. For another example, if the time period indicated by the analysis report information is 1:10am to 2:00am and the offset value is +10 minutes, the data analysis network element 10 can send data analysis information to the analysis consumer network function network element 20 between 1:20am and 2:10am.

[0167] Exemplarily, the first request may be a Nnwdaf_AnalyticsSubscription_Subscribe (NWDAF analysis information subscription) service, that is, the analysis consumer network function network element 20 triggers the Nnwdaf_AnalyticsSubscription_Subscribe service to request data analysis information from the data analysis network element 10 .

[0168] Step 702: The data analysis network element 10 sends a first data subscription request to the data providing network element. Correspondingly, the data providing network element receives the first data subscription request from the data analysis network element 10. The first data subscription request is used to subscribe to data.

[0169] Exemplarily, the first data subscription request includes one or more of the following information: event identifier (EventID), event filter (Event Filter), or event reporting information (Event Reporting information).

[0170] Among them, the event identifier identifies the data type of the data requested by the data analysis network element 10 to the data providing network element, such as the terminal location (UE Location), terminal exception information (exception information), and service experience information (service experience Information).

[0171] Among them, event reporting information limits the number of times, time periods, and cycles that the data provider collects data.

[0172] Among them, the event filter limits the scope of data collection of network element data. For example, the event filter includes one or more of the following information: terminal identification (UE ID) 1, network area (network area) 1, time (time period) 1, service identification (application ID) 1, slice identification (S-NSSAI), etc.

[0173] It should be noted that the specific content of the event filter can be determined by the data analysis network element 10 based on the analysis filter information in step 701. The collection scope limited by the event filter can be the entire range or a part of the collection scope described by the analysis filter information.

[0174] The data providing network element in the embodiment of the present application may be one or more of the AMF network element, PCF network element, AF network element, UPF network element, SMF network element or OAM as shown in Table 1.

[0175] In one example, when the data providing network element is one or more of an AMF network element, a PCF network element, an AF network element, a UPF network element, and an SMF network element, the first data subscription request may be a Nnf_EventExposure_Subscribe (open subscription to events of network function network elements, for example, other network elements may subscribe to data from the network function network element through this service) service. For example, when the data providing network element is an AMF network element, the first data subscription request may be a Namf_EventExposure_Subscribe (open subscription to events of AMF network elements) service.

[0176] As another example, when the data providing network element is OAM, the data analysis network element 10 can call the existing network management service collection, such as performance management (PM) service, fault management (FM) service, MDT service, etc., and the existing technology can be referred to here.

[0177] Step 703: The data providing network element sends a first data subscription response to the data analysis network element 10. Accordingly, the data analysis network element 10 receives the first data subscription response from the data providing network element. The first data subscription response includes the data that the data analysis network element 10 requests to subscribe to.

[0178] As an example, if the data providing network element is one or more of the AMF network element, PCF network element, AF network element, UPF network element, and SMF network element, the first data subscription response can be the Nnf_EventExposure_Notify (event exposure notification of network function network element) service.

[0179] As another example, the data providing network element is OAM, and OAM can send the data to the data analysis network element 10.

[0180] Step 704: During the training phase, the data analysis network element 10 obtains data analysis information or obtains a data analysis model through training based on the collected data.

[0181] For example, as shown in Table 1, the data analysis information may be terminal mobility (UE Mobility) and terminal communication. UE Mobility may be understood as a moving track of a terminal, and the terminal moving track includes the location of one or more terminals.

[0182] For example, the data analysis model may be a service experience model or a UE abnormal behavior classification model.

[0183] It should be noted that if the data analysis network element 10 obtains data analysis information in step 704, the data analysis network element 10 can send the data analysis information to the analysis consumer network function network element 20 for use, and the data analysis network element 10 does not need to collect new data (New Data, also called inference data (Inference Data), see step 705). If the data analysis network element 10 obtains a data analysis model in step 704, that is, what is obtained in the training phase is a data analysis model rather than data analysis information, then the data analysis network element 10 needs to further obtain new data, and then obtain corresponding data analysis information based on the new data and the data analysis model.

[0184] Step 705: The data analysis network element 10 continues to obtain inference data for inference from the data providing network element.

[0185] For example, taking the data analysis model as a service experience model, the data analysis network element 10 continues to obtain network data for the service experience model (such as QoS flow data of services on the UPF network element, MDT data of terminals on the (R)AN), and terminal behavior data for terminal abnormal behavior classification (such as location information of terminals on the AMF network element, QoS flow data of terminals on the UPF network element)) from the data providing network element.

[0186] Step 706: The data analysis network element 10 obtains data analysis information based on the inference data and the data analysis model trained in step 704.

[0187] It should be noted that if the data analysis network element 10 obtains the data analysis model based on the collected data analysis in step 704, the data analysis network element 10 needs to execute steps 705 and 706 after executing step 704. If the data analysis network element 10 obtains the data analysis information based on the collected data analysis in step 704, steps 705 and 706 can be omitted.

[0188] Step 707 : The data analysis network element 10 sends a first message to the analysis consumer network function network element 20 . Correspondingly, the data analysis network element 10 receives the first message from the analysis consumer network function network element 20 .

[0189] Among them, the first message includes a first indication, and the first indication is used to instruct the analysis consumer network function network element 20 to feedback effect information to the data analysis network element 10.

[0190] As an implementation, the first message in the embodiment of the present application has the meaning of instructing the analysis consumer network function network element 20 to send effect information to the data analysis network element 10. If the first message has the meaning of instructing the analysis consumer network function network element 20 to feed back effect information to the data analysis network element 10, the first message may not carry the first instruction.

[0191] In a possible implementation, the first message also includes one or more of data analysis information or report information, and the report information is used to determine the parameters of the feedback effect information. Of course, the first message may also include a data analysis identifier corresponding to the data analysis information. When the first message also includes data analysis information, it means that the data analysis network element 10 can send a first indication to the analysis consumer network function network element 20 during the process of sending the data analysis information. In other words, the data analysis information and the first indication are carried in the same message (e.g., the first message).

[0192] When the first indication and the data analysis information are both carried in the first message, the first message may be a Nnwdaf_AnalyticsSubscription_Notify (data analysis information notification of NWDAF, that is, NWDAF can send data analysis information to the first network element through this service) service or a Nnwdaf_AnalyticsInfo_Request response (data analysis information response of NWDAF, that is, NWDAF can send data analysis information to the first network element through this service) service.

[0193] Of course, the first indication may also be sent to the analysis consumer network function network element 20 through different messages together with the data analysis information, which is not limited in the embodiments of the present application. When the first indication and the data analysis information are sent through different messages, the first message may be the Nnf_AnalyticsEffectSubscription_Subscribe (network element data analysis information effect information subscription, that is, NWDAF or other network elements can subscribe to the network element data analysis information effect information through this service) service, and the message carrying the data analysis information may be the Nnwdaf_AnalyticsSubscription_Notify (NWDAF data analysis information notification, that is, NWDAF can send data analysis results to other network elements through this service) service.

[0194] It is worth noting that when the first indication and the data analysis information are sent to the analysis consumer network function network element 20 through different messages, the method provided in the embodiment of the present application may also include before step 706: the data analysis network element 10 sends the data analysis information to the analysis consumer network function network element 20, and accordingly, the analysis consumer network function network element 20 receives the data analysis information from the data analysis network element 10.

[0195] As a possible example, if the first message does not carry the first indication but carries one or more of the report information or the data analysis information, the analysis consumer network function network element 20 may also determine to feedback the effect information to the data analysis network element 10 based on the first message.

[0196] Exemplarily, the report information includes one or more of the following information: a threshold, a deviation, a cycle, a time period or a maximum number of reports, wherein the threshold is used to indicate that the effect information is sent when the effect information meets the threshold; the deviation is used to indicate the range in which the effect information is allowed to fluctuate above and below the threshold, and the effect information is sent when the difference between the effect information and the threshold is outside the deviation range; the cycle is used to indicate that the effect information is sent according to the cycle; the time period is used to indicate that the effect information is sent during the time period; and the maximum number of reports is used to indicate the maximum number of times the effect information is sent.

[0197] In the embodiment of the present application, each parameter of the threshold, deviation, cycle, time period or maximum number of reports can be used separately, and of course each parameter can also be used in combination. Exemplarily, if the report information includes the time period and the maximum number of reports, the report information is used to indicate the maximum number of times the first network element can feedback effect information within the time period.

[0198] Step 708: Analyze the consumer network function network element 20 to determine the second application scope corresponding to the data analysis information.

[0199] The second applicable scope indicates that the analysis consumer network function network element 20 can use the data analysis information from the data analysis network element within the second applicable scope. In other words, the second applicable scope indicates the scope in which the analysis consumer network function network element 20 acts or uses the data analysis information. For example, the second applicable scope in the embodiment of the present application can be defined as: network area 2, time period 2, service identifier 2, slice identifier 2, terminal identifier 2, IP filtering information 2 (used to identify a service flow of the terminal), etc.

[0200] In a possible implementation, step 708 in the embodiment of the present application can be implemented in the following manner: the analysis consumer network function network element 20 can receive the second applicable scope corresponding to the data analysis information from the data analysis network element 10. That is to say, the data analysis network element 10 not only provides the analysis consumer network function network element 20 with the data analysis information, but also provides the analysis consumer network function network element 20 with the second applicable scope in which the data analysis information can be used.

[0201] In one possible implementation, step 708 in the embodiment of the present application can be implemented in the following manner: the data analysis network element 10 provides the third scope of application corresponding to the data analysis information to the analysis consumer network function network element 20. The analysis consumer network function network element 20 determines the second scope of application based on the third scope of application. Among them, the third scope of application includes the second scope of application. In other words, the second scope of application is part of the scope of application or the entire scope of application of the third scope of application. It should be understood that the data analysis network element 10 can provide the analysis consumer network function network element 20 with a larger scope of application (for example, the third scope of application) for the data analysis information, and then the analysis consumer network function network element 20 autonomously determines the second scope of application within the third scope of application.

[0202] Step 709: Analyze the use effect achieved by the consumer network function network element 20 in the first application scope as effect information. The first application scope is the scope when the data analysis information achieves the above effect information.

[0203] For example, on the one hand, the use effect achieved by the data analysis information within the first applicable scope can be expressed by "good", "bad", improvement range, reduction range, accuracy, recall rate, error rate, F-Score, etc., and the specific effect information can also be designed for a specific Analytics ID. On the other hand, the consumer network function network element 20 can also feedback the first applicable scope corresponding to the effect information to the data analysis network element 10 during the process of feeding back the effect information. If the consumer network function network element 20 does not feed back the first applicable scope corresponding to the effect information to the data analysis network element 10, it means that the first applicable scope corresponding to the effect information is equivalent to the content included in the Analytics Filter.

[0204] The first applicable scope in the embodiment of the present application is a subset or a full set of the second applicable scope. In other words, the first applicable scope is a partial applicable scope or the entire applicable scope of the second applicable scope, or the first applicable scope is included in the scope of the second applicable scope. In other words, the consumer network function network element 20 that analyzes the data analysis information obtained in step 708 can be applied to a sub-scope of the second applicable scope (for example, by using a random sampling technique for the second applicable scope to determine the first applicable scope). For example, the first applicable scope in the embodiment of the present application can be defined as: network area 1, time period 1, service identifier 1, slice identifier 1, terminal identifier 1, IP filtering information 1 (used to identify a service flow of the terminal), etc., then network area 1 is within the scope of network area 2, time period 1 is within the scope of time period 2, and so on.

[0205] Step 710 is the same as step 602 and will not be described again here.

[0206] It should be noted that if the analysis consumer network function network element 20 receives the report information, the analysis consumer network function network element 20 sends the effect information to the data analysis network element 10 according to the report information. For example, the analysis consumer network function network element 2 sends the effect information to the data analysis network element 10 according to the cycle or time period indicated by the report information. Or the analysis consumer network function network element 2 sends the effect information to the data analysis network element 10 according to the threshold indicated by the report information when the threshold is reached.

[0207] In a possible embodiment, Figure 7 As shown, the method provided in the embodiment of the present application may further include, after step 709:

[0208] Step 711: The analysis consumer network function network element 20 sends the first applicable scope corresponding to the effect information to the data analysis network element 10. Correspondingly, the data analysis network element 10 receives the first applicable scope from the analysis consumer network function network element 20.

[0209] It is understandable that the first applicable scope and the effect information corresponding to the effect information can be carried in the same message (for example, the first response). Of course, when they are carried in the same message, step 711 can be omitted.

[0210] In addition, the consumer network function analysis network element 20 may also determine the cycle, time or number of times of reporting effect information according to the report information.

[0211] Furthermore, if the data analysis network element 10 inquires about the effect information from the analysis consumer network function network element 20 through the Nnf_AnalyticsEffectSubscription_Subscribe (effect information subscription of data analysis information of network element, that is, the data analysis network element 10 or other network elements can subscribe to the effect information of data analysis information from the network element through this service) service, the consumer NF can provide the effect information of data analysis information to the data analysis network element 10 through the Nnf_AnalyticsEffectSubscription_Notify (effect information notification of data analysis information of network element, that is, the data analysis network element 10 or other network elements can subscribe to the effect information of data analysis information from the network element through this service) service.

[0212] Step 712: The data analysis network element 10 determines that the effect information is lower than or equal to the first preset level, and then the data analysis network element 10 determines updated data analysis information based on the effect information.

[0213] As another possible implementation, the data analysis network element 10 determines that the effect information is higher than or equal to the second preset level, and then the data analysis network element 10 determines that there is no need to update the data analysis information.

[0214] Taking the high and low usage levels of the effect information as an example, if the data analysis network element 10 determines that the usage level of the effect information is high, the data analysis network element 10 determines that there is no need to update the data analysis information. This can avoid re-collecting data, optimizing the data analysis model, and then updating the data analysis information. A high usage level of the effect information indicates that the effect information is higher than or equal to the second preset level. A low usage level of the effect information indicates that the effect information is lower than or equal to the first preset level. The usage level of the effect information can also be expressed as "AB" or "12" or "good usage effect and poor usage effect". Among them, "A" or "1" or "good usage effect" indicates high, and "B" or "2" or "poor usage effect" indicates low. Of course, the usage level of the effect information can also be identified in other ways, and the embodiments of the present application are not limited to this.

[0215] As a possible implementation method, the data analysis network element 10 in the embodiment of the present application determines the updated data analysis information based on the effect information, which can be specifically implemented in the following way: the data analysis network element 10 sends a third message to the third network element according to the first applicable scope corresponding to the effect information, and the third message is used to request the data within the first applicable scope. The data analysis network element 10 determines the updated data analysis information based on the data within the first applicable scope. Specifically, on the one hand, the data analysis network element 10 updates the data analysis model based on the data within the first applicable scope, and then re-collects the data and inputs it into the updated data analysis model to obtain the updated data analysis information. Or, on the other hand, the data analysis network element 10 inputs the data within the first applicable scope into the data analysis model to obtain the updated data analysis information.

[0216] It can be understood that the third network element can be a network element that provides data to the data analysis network element 10.

[0217] Regarding the specific implementation process of the data analysis network element 10 updating the data analysis information, please refer to the specific description of steps 702 to 706, which will not be repeated here.

[0218] It should be noted that in the embodiments of this application Figure 7 Taking step 707 before step 709 as an example, in this case, the analysis consumer network function network element 20 first determines the effect information under the triggering of the first message, and then sends the effect information to the data analysis network element 10. Of course, step 707 can also be located between step 709 and step 710, that is, the analysis consumer network function network element 20 sends the effect information to the data analysis network element 10 only under the triggering of the first message.

[0219] In the embodiment of the present application, the data analysis network element 10 can actively determine the data analysis information. In this case, step 701 can be omitted. Thereafter, the data analysis network element 10 can actively send the data analysis information to the analysis consumer network function network element 20. Of course, it can also send the data analysis information to the analysis consumer network function network element 20 at the request of the analysis consumer network function network element 20. Figure 7 In the illustrated embodiment, the data analysis network element 10 determines the data analysis information at the request of the analysis consumer network function network element 20 as an example.

[0220] In a possible embodiment, Figure 7 As shown, after the data analysis network element 10 obtains the updated data analysis information, the method provided in the embodiment of the present application further includes:

[0221] Step 713 : The data analysis network element 10 sends the updated data analysis information to the analysis consumer network function network element 20 . Accordingly, the analysis consumer network function network element 20 receives the updated data analysis information from the data analysis network element 10 .

[0222] In a possible implementation, the data analysis identifier corresponding to the data analysis information may be UE Mobility Analytics (i.e., terminal movement trajectory), which is used to optimize the paging area of ​​the terminal. At this time, the analysis consumer network function network element 20 may be an access management network element, and the second applicable scope is the first paging area corresponding to the terminal. The effect information indicates that the access management network element can page the terminal in the second paging area, i.e., the first applicable scope is the second paging area. That is, the effect information indicates that the data analysis network element 10 optimizes the paging area of ​​the terminal from the first paging area to the second paging area.

[0223] It should be understood that the first paging area is the range in which the data analysis network element 10 determines that the terminal should be paged based on data analysis, and the second paging area is the area in which the access management network element actually pages the terminal. For example, the first paging area is a TA List (TA List includes one or more TAs, and one TA includes dozens to hundreds of base stations or cells), and the second paging area is a base station list or a cell list, a base station list includes one or more base stations, and a cell list includes one or more cells. By optimizing the paging area of ​​the terminal from a TA List (usually including hundreds to tens of thousands of base stations or cells, so the paging signaling is numerous) to a base station list or a cell list (usually including dozens of base stations or cells, and the paging signaling is greatly reduced), the access management network element can page the terminal in the base station described in the base station list or the cell described in the cell list, thereby reducing the paging burden of the base station and saving the base station paging signaling. Only when the access management network element cannot page the terminal in the base station described in the base station list or the cell described in the cell list, will the paging area be expanded to the TA List.

[0224] For example, taking the access management network element as the AMF network element and the data analysis network element 10 as the NWDAF, the data analysis information provided by the NWDAF to the AMF network element is the UE Mobility Analytics of 10 terminals (assuming that they correspond to UE 1 to UE10). The AMF network element can select the UE Mobility Analytics of 5 terminals (assuming that they correspond to UE 1 to UE5) from the 10 terminals to update the paging areas of the UE 1 to UE5, while the paging areas of the other 5 terminals (assuming that they correspond to UE 6 to UE10) are not adjusted. The AMF network element updates the paging area based on the UE Mobility Analytics of UE 1 to UE5, so the AMF network element can (periodically, such as once a day) report the cells (Paged Location for the UE) that are finally paged to these 5 terminals as effect information to the NWDAF. According to the effect information fed back by the AMF network element, the NWDAF finds that most of the cells (Paged Location for the UE) where the UE 1 to UE5 are finally paged are not within the UE Mobility Analytics range sent by the data analysis network element to the AMF network element in step 706. In this case, the UE Mobility Analytics can be further optimized, such as adding the cell where the UE is paged to the UE Mobility Analytics and then sending it to the AMF network element. For example, the paging areas of UE1 included in the UE MobilityAnalytics range are cell 1 and cell 3, but the AMF network element finally pages UE1 in cell 2, so the NWDAF can also use cell 1 as the paging area of ​​UE1. Furthermore, according to the effect information fed back by the AMF network element, the NWDAF can find that the data of two of the terminals (UE 2 and UE 5) among UE 1 to UE5 need to be further collected in order to more accurately determine the UE Mobility Analytics of UE 2 and the UE Mobility Analytics of UE 5, so the location information of UE 2 and UE 5 is collected from the AMF network element serving UE 2 and UE 5 respectively (Event ID = LocationChanges). NWDAF finally obtains the updated UE Mobility Analytics of UE 2 based on the location information of UE 2 and the cell information of UE 2 that is paged to UE 2 fed back by the AMF network element. In addition, NWDAF finally obtains the updated UE Mobility Analytics of UE 5 based on the location information of UE 5 and the cell information of UE 5 that is paged to UE 5 fed back by the AMF network element.NWDAF sends the updated UE Mobility Analytics of UE 5 to the AMF network element corresponding to UE5. NWDAF sends the updated UE Mobility Analytics of UE 2 to the AMF network element corresponding to UE2.

[0225] Embodiment 2: The first network element is the analysis effect evaluation network element 30, and the second network element is the analysis consumer network function network element 20, and the analysis consumer network function network element 20 does not have the function of evaluating the use effect achieved by the data analysis information to obtain effect information.

[0226] like Figure 8 As shown, Figure 8 A data analysis method provided in an embodiment of the present application is described, wherein step 811 in the method corresponds to the above Figure 6 In step 601, step 812 corresponds to step 602, and step 814 is a possible implementation of step 603, which will not be repeated here. In a possible embodiment, the method provided in the embodiment of the present application may also include steps 801 to 810 before step 811.

[0227] Steps 801 to 806 are the same as steps 701 to 706 and will not be repeated here.

[0228] Step 807 : The data analysis network element 10 sends data analysis information to the analysis consumer network function network element 20 .

[0229] Exemplarily, the data analysis network element 10 sends data analysis information to the analysis consumer network function network element 20 through a service-based data analysis subscription notification (Nnwdaf_AnalyticsSubscription_Notify) service operation.

[0230] As a possible example, the Nnwdaf_AnalyticsSubscription_Notify service operation may also carry at least one of a second indication or a third indication. The second indication is used to indicate the second applicable scope of the data analysis information provided by the analysis consumer network function network element 20 to the data analysis network element 10. The third indication is used to indicate that the analysis consumer network function network element 20 provides the information of the analysis effect evaluation network element 30 to the data analysis network element 10.

[0231] Of course, the second indication or the third indication may also be sent separately to the analysis consumer network function network element 20, which is not limited in this embodiment of the present application.

[0232] The second indication and the third indication in the embodiment of the present application may be the same indication, that is, the indication has the functions of instructing the analysis consumer network function network element 20 to provide information of the analysis effect evaluation network element 30 to the data analysis network element 10 and instructing the analysis consumer network function network element 20 to provide the data analysis network element 10 with the second applicable scope of data analysis information.

[0233] It should be noted that if the data analysis network element 10 does not send the third instruction to the analysis consumer network function network element 20, the analysis consumer network function network element 20 may also determine to provide the data analysis network element 10 with information of the analysis effect evaluation network element 30 based on the second instruction.

[0234] Step 808 is the same as step 708 and will not be repeated here.

[0235] Step 809 , the analysis consumer network function network element 20 sends the information of the analysis effect evaluation network element 30 and the second application scope of the data analysis information to the data analysis network element 10 .

[0236] Step 810 : The data analysis network element 10 sends a second message to the analysis effect evaluation network element 30 . Correspondingly, the analysis effect evaluation network element 30 receives the second message from the data analysis network element 10 .

[0237] The second message is used to request effect information, and the second message includes one or more of the data analysis identifier or report information corresponding to the data analysis information, and the report information is used to determine the parameters of the feedback effect information. Optionally, the second message may also include indication information, and the indication information is used to request effect information. Of course, if the second message itself has the meaning of requesting effect information, the indication information can be omitted, thereby saving signaling overhead.

[0238] In a possible implementation, if the data analysis network element 10 also determines the second applicable scope corresponding to the data analysis information, the second message may also include the second applicable scope. By carrying the second applicable scope in the second message, it is convenient for the analysis effect evaluation network element 30 to determine that the data analysis information acts within the second applicable scope.

[0239] It should be noted that the data analysis network element 10 may determine the second applicable scope corresponding to the data analysis information independently, or may determine the second applicable scope corresponding to the data analysis information through the above step 809. If the data analysis network element 10 has not determined the second applicable scope corresponding to the data analysis information, the second message may not carry the second applicable scope. In this case, the data analysis network element 10 defaults the scope corresponding to the data analysis information to be the applicable scope corresponding to the data analysis information carried by the data analysis network element 10 when sending the data analysis information to the analysis consumer network function network element 20 in step 807.

[0240] It should be noted that the third indication and the process of analyzing the second scope of application of the data analysis information sent by the consumer network function network element 20 to the data analysis network element 10 in step 809 are optional. If the third indication and the process of analyzing the second scope of application of the data analysis information sent by the consumer network function network element 20 to the data analysis network element 10 in step 809 are omitted, the data analysis network element 10 defaults to the second scope of application of the Analytics Filer in step 801, that is, the data analysis network element 10 defaults to analyzing that the consumer network function network element 20 applies the data analysis information to the scope specified by the Analytics Filter.

[0241] Step 811: The analysis effect evaluation network element 30 determines effect information of the data analysis information.

[0242] Specifically, if the analysis effect evaluation network element 30 receives the second applicable scope of the data analysis information, the analysis effect evaluation network element 30 determines the effect information according to the second applicable scope of the data analysis information. It is understandable that the analysis effect evaluation network element 30 can also determine the data analysis information according to the data analysis identifier.

[0243] Step 812: The analysis effect evaluation network element 30 sends effect information to the data analysis network element 10. Correspondingly, the data analysis network element 10 receives the effect information from the analysis effect evaluation network element 30.

[0244] Although the analysis effect evaluation network element 30 receives the second application scope of the data analysis information, the analysis effect evaluation network element 30 may select a local application scope from the second application scope as the use effect achieved by the data analysis information when evaluating the use effect achieved by the data analysis information. Figure 8 As shown, the method provided in the embodiment of the present application may also include:

[0245] Step 813: The analysis effect evaluation network element 30 sends the first applicable scope corresponding to the effect information to the data analysis network element 10.

[0246] The first applicable scope in the embodiment of the present application may be a partial scope of the second applicable scope or the entire scope of the second applicable scope.

[0247] Step 814 is the same as step 712 and will not be described again here.

[0248] It should be understood that if the first applicable scope corresponding to the effect information and the effect information are carried in the same message, step 813 can be omitted.

[0249] Step 815 is the same as step 713 and will not be described again here.

[0250] In one possible implementation, Figure 8 In the illustrated embodiment, the data analysis identifier corresponding to the data analysis information may be the service experience of the service, and the service experience of the service is used to adjust the QoS parameters of the service. The analysis effect evaluation network element 30 may be an AF network element, and the analysis consumer network function network element 20 may be a PCF network element. The effect information may be the service experience after the service adjustment or the service experience of the service has not changed.

[0251] Exemplarily, the service experience of a service is specifically used to adjust the service experience of a service in a certain network area from an observed first value (e.g., 3.0 points) (the service experience is too low and does not meet the service requirements) to a second value (e.g., 4.0 points), or to adjust the service experience of a service in a certain network area from an observed third value (e.g., 5.0 points) (the service experience is too high, the service requirements are met in excess, and network resources are wasted) to a second value. Among them, the first value is less than the second value and less than the third value. Specifically, the service experience after the service adjustment can be a service experience of improved or increased service, or a service experience of reduced or decreased service.

[0252] For example, taking the service as payment service and the data analysis network element 10 as NWDAF, NWDAF provides the PCF network element with a service experience for the payment service that can be applied to the two network areas (Network Area 1 and Network Area 2) of Tracking Area (TA) 1 and TA2. However, when the PCF network element uses the payment service in the TA1 area (NetworkArea 1), it adjusts the QoS parameters of the payment service in TA1 based on the service experience, but the PCF network element does not adjust the QoS parameters of the payment service in TA2. The PCF network element notifies NWDAF that the service experience is applied to TA1 (corresponding to the second applicable scope mentioned above). Since NWDAF learns from the PCF network element that the service experience of the payment service acts on TA1, NWDAF can subscribe to the AF network element: whether the service experience of each payment service flow in TA1 has changed, whether the service experience has increased or decreased, or whether the service experience has changed; or whether the average service experience of the payment service in TA1 has increased or decreased, or whether the average service experience has changed.

[0253] Furthermore, NWDAF subscribes to network data of the payment service in the TA1 area from other network elements, such as obtaining traffic information (such as bandwidth, latency, jitter, packet loss rate, etc.) corresponding to the service flow of the payment service from the UPF network element or RAN, and obtaining MDT data of the terminal when using the payment service from OAM. NWDAF retrains the service experience model based on the collected network data and MDT data, and generates updated observed service experience data analysis information (Observed Service Experience Analytics, OSE Analytics) based on the updated service experience model. NWDAF sends the updated observed service experience data analysis information to the PCF network element, which decides to re-update the QoS parameters of the payment service in TA1 or TA2.

[0254] exist Figure 8 In the illustrated embodiment, since the analysis consumer network function network element 20 cannot determine the use effect of the data analysis information, the analysis consumer network function network element 20 can provide the analysis consumer network function network element 20 with the scope of application of the data analysis information (for example, the second applicable scope), and the data analysis network element 10 subscribes to the effect information to the analysis effect evaluation network element 30.

[0255] Embodiment 3: Fig. 9 In the example, the first network element is the analysis effect evaluation network element 30, the second network element is the analysis consumer network function network element 20, and the analysis consumer network function network element 20 does not have the function of evaluating the use effect achieved by the data analysis information to obtain the effect information, and the analysis consumer network function network element 20 represents the data analysis network element 10 to subscribe to the analysis effect evaluation network element 30 for the effect information, which shows another data analysis method provided by the embodiment of the present application. Fig. 9 In the method shown, step 910 corresponds to the above step 601, step 911 corresponds to the above step 602, and step 913 is a possible implementation of step 603. Specifically, the method includes:

[0256] Steps 901 to 906 are the same as steps 701 to 706 and will not be repeated here.

[0257] Step 907 : The data analysis network element 10 sends the data analysis information and the fourth instruction to the analysis consumer network function network element 20 . Accordingly, the analysis consumer network function network element 20 receives the data analysis information and the fourth instruction from the data analysis network element 10 .

[0258] Among them, the fourth instruction is used to instruct the analysis consumer network function network element 20 to subscribe to the effect information of the data analysis information from the analysis effect evaluation network element 30 on behalf of the data analysis network element 10.

[0259] In this embodiment, the fourth indication and the data analysis information are carried in the same message as an example. Of course, the fourth indication and the data analysis information can also be carried in different messages and sent to the analysis consumer network function network element 20, which will not be repeated here.

[0260] Step 908 is the same as step 708 and will not be repeated here.

[0261] Step 909: the analysis consumer network function network element 20 sends a first subscription operation to the analysis effect evaluation network element 30, and the analysis effect evaluation network element 30 receives the first subscription operation from the analysis consumer network function network element 20. The first subscription operation is used to subscribe to effect information of data analysis information.

[0262] Exemplarily, the first subscription service operation may be Nnf_AnalyticsEffectSubscription_Subscribe. The first subscription service operation may carry information of the data analysis network element 10, a data analysis identifier corresponding to the data analysis information, and a second applicable scope corresponding to the data analysis information. It is understandable that the second applicable scope corresponding to the data analysis information in the first subscription service operation may be optional.

[0263] Steps 910 to 914 are the same as steps 811 to 815 and will not be repeated here.

[0264] For example, the data analysis identifier corresponding to the data analysis information is the load information of the fourth network element (for example, UPF network element), the analysis effect evaluation network element 30 is a network storage network element or a network management network element, and the effect information is the load information of the fourth network element after adjustment or the load information of the fourth network element. For example, NWDAF can provide the SMF network element with the UPF load (Load) information of multiple UPFs in the area (that is, the load of these UPFs, the larger the Load, the heavier the load). When a terminal establishes a PDU session (Session) in the area, the SMF network element can select a UPF network element with a load lower than the load threshold from multiple UPFs to provide services to the terminal, thereby alleviating the load of the UPF network elements in the area whose load is higher than the load threshold.

[0265] In combination with the above example, the specific data analysis process of the embodiment of the present application is as follows: the SMF network element obtains the Load information of multiple UPFs that can be applied to the two areas of TA1 and TA2 (Network Area 1 and Network Area 2) from the NWDAF, and can only select a UPF network element with a load lower than the load threshold to serve the PDU Session for the terminal in the TA1 area (Network Area 1) based on the size of the UPF Load when establishing the PDU Session, but does not make adjustments to the TA2 area. If the NWDAF determines that the SMF network element applies the Load information of multiple UPFs to TA1, then the NWDAF can subscribe to the network storage network element or the network management network element: the increase or decrease value of the UPF Load on TA1. If the increase value of the UPF Load in TA1 fed back by the network storage network element or the network management network element is greater than or equal to the first threshold, the NWDAF can decide to update the UPF Load Analytics sent to the SMF network element, so that the session of the newly connected terminal will not be selected on the UPF network element in TA1, thereby reducing the load of the UPF network element in TA1.

[0266] Furthermore, NWDAF can subscribe to network data that affects UPF LoadAnalytics in the TA1 area from the network storage network element or the network management network element, such as obtaining the UPF status (REGISTERED (already registered on NRF), SUSPENDED (although already registered on NRF, it is not operational and cannot be discovered by other network elements), UNDISCOVERABLE (although already registered on NRF and operational, it cannot be discovered by other network elements)) from the network storage network element, and obtaining the resource utilization rate of the UPF network element and the resource configuration information of the UPF network element from OAM. Then, NWDAF regenerates the updated load information of multiple UPF network elements in TA1 based on the resource utilization rate of the UPF network element, the resource configuration information of the UPF network element, and the UPF status. NWDAF sends the updated load information of multiple UPF network elements in TA1 to the SMF network element to help the SMF reselect the UPF network element for new sessions in the area.

[0267] It is understandable that in Figure 8 or Fig. 9 In the illustrated embodiment, the analysis effect evaluation network element 30 may first send the effect information to the analysis consumer network function network element 20, and then the analysis consumer network function network element 20 may send the effect information to the data analysis network element 10, but this embodiment of the present application does not limit this.

[0268] The above mainly introduces the scheme of the embodiment of the present application from the perspective of the interaction between various network elements. It can be understood that in order to realize the above functions, each network element, such as a data analysis network element, a consumer network function analysis network element, an analysis effect evaluation network element, etc., includes a hardware structure and / or software module corresponding to each function. It should be easy for those skilled in the art to realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed in this article, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0269] The embodiment of the present application can divide the functional units according to the data analysis network element, the consumer network function analysis network element, and the effect evaluation network element of the above method examples. For example, each functional unit can be divided according to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0270] Combined with the above Figures 6 to 9 , the method of the embodiment of the present application is explained, and the data analysis device for executing the above method provided by the embodiment of the present application is described below. Those skilled in the art can understand that the method and the device can be combined and referenced with each other, and the data analysis device provided by the embodiment of the present application can execute the steps executed by the data analysis network element, the analysis consumer network function network element, and the analysis effect evaluation network element in the above analysis method.

[0271] Fig.10 The data analysis device involved in the above embodiment is shown, and the data analysis device may include: a communication unit 102 and a processing unit 101.

[0272] In a possible implementation, the communication unit may include a receiving unit and a sending unit, wherein the receiving unit is used to receive a signal and the sending unit is used to send a signal.

[0273] In one example, the data analysis device is a data analysis network element, or a chip used in a data analysis network element. In this case, the communication unit 102 is used to support the data analysis device to communicate with an external network element, for example, to perform the signal transceiving operation of the data analysis network element 10 in the above method embodiment. The processing unit 101 is used to perform the signal processing operation of the data analysis network element 10 in the above method embodiment. For example, the communication unit 102 is used to perform the above embodiment. Figure 6 The receiving action performed by the data analysis network element in step 602. The processing unit 101 is used to support the data analysis device to perform Figure 6 The action performed by the data analysis network element in step 603.

[0274] In a possible embodiment, the communication unit 102 is further used to support the data analysis device to perform the receiving action performed by the data analysis network element in steps 701, 703, 705, 710, and 711 in the above embodiments, and the communication unit 102 is further used to support the data analysis device to perform the sending action performed by the data analysis network element in steps 702, 707, and 713 in the above embodiments. The processing unit 101 is further used to support the data analysis device to perform the actions performed by the data analysis network element in steps 704, 706, and 712 in the above embodiments.

[0275] In another example, the data analysis device is a network element for analyzing a consumer network function, or a chip used to analyze a consumer network function network element. In this case, the communication unit 102 is used to support the data analysis device to communicate with an external network element, for example, to perform the signal transceiver operation of analyzing the consumer network function network element 20 in the above method embodiment. The processing unit 101 is used to perform the signal processing operation of analyzing the consumer network function network element 20 in the above method embodiment. For example, the processing unit 101 is used to support the data analysis device to perform the action performed by the first network element in step 601 in the above embodiment, and the communication unit 102 is used to support the data analysis device to perform the sending action performed by the first network element in step 602 in the above embodiment.

[0276] In a possible embodiment, the communication unit 102 is further used to support the data analysis device to perform the sending action performed by the analysis consumer network function network element in step 701, step 710, and step 711 in the above embodiment. The processing unit 101 is also used to support the data analysis device to perform step 708 and step 709 in the above embodiment. The communication unit 102 is also used to support the data analysis device to perform the receiving action performed by the analysis consumer network function network element in step 707 and step 713 in the above embodiment.

[0277] In another example, the data analysis device is an analysis effect evaluation network element, or a chip used in an analysis effect evaluation network element. In this case, the communication unit 102 is used to support the data analysis device to communicate with external network elements, for example, to perform the signal receiving and sending operations of the analysis effect evaluation network element 30 in the above method embodiment. The processing unit 101 is used to perform the signal processing operations of the analysis effect evaluation network element 30 in the above method embodiment. For example, the processing unit 101 is used to support the data analysis device to perform the action performed by the first network element in step 601 in the above embodiment, and the communication unit 102 is used to support the data analysis device to perform the sending action performed by the first network element in step 602 in the above embodiment.

[0278] In a possible embodiment, the communication unit 102 is also used to support the data analysis device to perform the receiving action performed by the analysis effect evaluation network element in step 810 of the above embodiment, and to support the data analysis device to perform the sending action performed by the analysis effect evaluation network element in steps 812 and 813 of the above embodiment.

[0279] In a possible embodiment, the communication unit 102 is also used to support the data analysis device to perform the receiving action performed by the analysis effect evaluation network element in step 909 in the above embodiment, and to support the data analysis device to perform the sending action performed by the analysis effect evaluation network element in steps 911 and 912 in the above embodiment.

[0280] In the case of an integrated unit, Fig.10 The communication unit shown can also be replaced by a communication module, and the processing unit can also be replaced by a processing module. The processing module is used to control and manage the actions of the data analysis device. For example, the processing module is used to execute the steps of information / data processing in the data analysis device. The communication module is used to support the data analysis device to perform the steps of sending or receiving information / data. In a possible embodiment, the data analysis device may also include a storage module for storing program codes and data of the data analysis device.

[0281] Among them, the processing module can be a processor or a controller, for example, a central processing unit, a general processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic boxes, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements a computing function, such as a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, etc. The communication module can be a transceiver, a transceiver circuit or a communication interface, etc. The storage module can be a memory.

[0282] When the processing module is the processor 51 or the processor 55, the communication module is the communication interface 53, and the storage module is the memory 52, the data analysis device involved in the present application can be Figure 5 The communication device shown.

[0283] Fig.11 1 is a schematic diagram of the structure of a chip 150 provided in an embodiment of the present application. The chip 150 includes one or more than two (including two) processors 1510 and a communication interface 1530 .

[0284] Optionally, the chip 150 further includes a memory 1540, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor 1510. A portion of the memory 1540 may also include a non-volatile random access memory (NVRAM).

[0285] In some embodiments, the memory 1540 stores the following elements, execution modules or data structures, or a subset thereof, or an extended set thereof.

[0286] In the embodiment of the present application, the corresponding operation is performed by calling the operation instruction stored in the memory 1540 (the operation instruction may be stored in the operating system).

[0287] One possible implementation is that the structures of the chips used by the data analysis network element, the consumer network function analysis network element, and the effect evaluation analysis network element are similar, and different devices can use different chips to achieve their respective functions.

[0288] The processor 1510 controls the processing operation of any one of the data analysis network element, the consumer network function analysis network element, and the effect evaluation analysis network element. The processor 1510 may also be referred to as a central processing unit (CPU).

[0289] The memory 1540 may include a read-only memory and a random access memory, and provides instructions and data to the processor 1510. A portion of the memory 1540 may also include an NVRAM. For example, in an application, the memory 1540, the communication interface 1530, and the memory 1540 are coupled together via a bus system 1520, wherein the bus system 1520 may include a power bus, a control bus, and a status signal bus in addition to a data bus. However, for the sake of clarity, in Fig.11 Various buses are labeled as bus system 1520.

[0290] The method disclosed in the above embodiment of the present application can be applied to the processor 1510, or implemented by the processor 1510. The processor 1510 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 1510. The above processor 1510 can be a general-purpose processor, a digital signal processor (digital signal processing, DSP), an ASIC, a field-programmable gate array (field-programmable gate array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software modules in the decoding processor can be executed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 1540, and the processor 1510 reads the information in the memory 1540 and completes the steps of the above method in combination with its hardware.

[0291] In one possible implementation, the communication interface 1530 is used to execute Figure 6-Figure 9 The data analysis network element, the consumer network function analysis network element, and the effect evaluation network element in the embodiment shown in the figure receive and send steps. The processor 1510 is used to execute Figure 6-Figure 9 The processing steps of the data analysis network element, the consumer network function analysis network element, and the effect evaluation network element in the illustrated embodiment.

[0292] The above communication unit may be a communication interface of the device, used to receive signals from other devices. For example, when the device is implemented in the form of a chip, the transceiver unit is a communication interface of the chip used to receive or send signals from other chips or devices.

[0293] In one aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the instructions are executed, the following is implemented: Figure 6 The function of the data analysis network element.

[0294] In a possible embodiment, when the instruction is executed, the following may also be implemented: Figure 7 to Figure 9 The function of the data analysis network element.

[0295] In one aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the instructions are executed, the following is implemented: Figure 6 The function of the first network element.

[0296] In a possible embodiment, when the instructions are executed, the computer-readable storage medium can also implement the following Figure 7 Analyze the functions of consumer network functional elements in the paper.

[0297] In a possible embodiment, when the instructions are executed, the computer-readable storage medium can also implement the following Figure 8 or Fig. 9 The functions of network elements are evaluated in the analysis effect.

[0298] In one aspect, a computer program product is provided, wherein the computer program product includes instructions, and when the instructions are executed, the following are implemented: Figure 6 The function of the data analysis network element.

[0299] In a possible embodiment, when the instructions are executed, the computer program product including the instructions can also implement the following Figure 7 to Figure 9 The function of the data analysis network element.

[0300] In another aspect, a computer program product comprising instructions is provided. The computer program product comprises instructions. When the instructions are executed, the following are implemented: Figure 6 The function of the first network element.

[0301] In a possible embodiment, when the instructions are executed, the computer program product including the instructions can also implement the following Figure 7 Analyze the functions of consumer network functional elements in the paper.

[0302] In a possible embodiment, when the instructions are executed, the computer program product including the instructions can also implement the following Figure 8 or Fig. 9 The functions of network elements are evaluated in the analysis effect.

[0303] In one aspect, a chip is provided, which is applied to a data analysis network element, and the chip includes at least one processor and a communication interface, wherein the communication interface is coupled to the at least one processor, and the processor is used to run instructions to implement the following Figure 6 to Figure 9 The function of the data analysis network element.

[0304] In another aspect, a chip is provided, which is applied to a first network element, and the chip includes at least one processor and a communication interface, wherein the communication interface is coupled to the at least one processor, and the processor is used to run instructions to implement the following Figure 6 The function of the first network element.

[0305] In a possible embodiment, when the processor is used to execute instructions, the chip can also implement the following Figure 7 Analyze the functions of consumer network functional elements in the paper.

[0306] In a possible embodiment, when the processor is used to execute instructions, the chip can also implement the following Figure 8 or Fig. 9 The functions of network elements are evaluated in the analysis effect.

[0307] The embodiment of the present application provides a communication system, which includes: a data analysis network element and a consumer network function analysis network element. The data analysis network element is used to perform the following steps: Figure 6 to Figure 9 Any of the functions performed by the data analysis network element, the analysis consumer network function network element is used to perform Figure 6 A function performed by the first network element in Figure 7 The steps performed by the analysis consumer network function network element.

[0308] The embodiment of the present application provides a communication system, which includes: a data analysis network element and an analysis effect evaluation network element. The data analysis network element is used to perform the following steps: Figure 6 to Figure 9 Any step performed by the data analysis network element, the analysis effect evaluation network element is used to perform Figure 6 The steps performed by the first network element in Figure 8 or Fig. 9 The steps performed by the analysis consumer network function network element.

[0309] Optionally, the communication system may further include a consumer network analysis function network element, configured to execute 8~ Fig. 9 The corresponding function in .

[0310] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed on a computer, the process or function described in the embodiment of the present application is executed in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user device or other programmable device. The computer program or instruction may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer program or instruction may be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium, for example, a floppy disk, a hard disk, a tape; it may also be an optical medium, for example, a digital video disc (DVD); it may also be a semiconductor medium, for example, a solid state drive (SSD).

[0311] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other changes to the disclosed embodiments by viewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "one" or "an" does not exclude multiple situations. A single processor or other unit may implement several functions listed in the claims. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0312] Although the present application has been described in conjunction with specific features and embodiments thereof, it is obvious that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely exemplary illustrations of the present application as defined by the appended claims, and are deemed to have covered any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A data analysis method, characterized in that: include: The data analysis network element receives first information from the first network element, where the first information is related to an action taken by the first network element, and the first information includes a data analysis identifier related to the action, and effect information of the data analysis information related to the action, where the effect information is obtained by evaluating the use effect of the data analysis information; Wherein, when the data analysis identifier corresponding to the data analysis information is terminal mobility, the first network element is an access management network element, the second applicable scope is a first paging area corresponding to the terminal, and the effect information indicates that the access management network element can page the terminal in the second paging area, wherein the second applicable scope is the scope of the data analysis information; or, When the data analysis identifier corresponding to the data analysis information is load information of a fourth network element, the first network element is a network storage network element or a network management network element, and the effect information is load information of the fourth network element after adjustment or load information of the fourth network element; or When the data analysis identifier corresponding to the data analysis information is a service experience of a service, the first network element is an application function AF network element, the effect information is the service experience after the service is adjusted or the service experience of the service does not change, and the service experience is used to adjust the quality of service QoS parameters of the service; The data analysis network element determines updated data analysis information based on the first information.

2. The method according to claim 1, characterized in that Before the data analysis network element receives the first information from the first network element, the method further includes: The data analysis network element sends a first message to the first network element, where the first message includes a first indication, wherein the first indication is used to instruct the first network element to feed back the effect information to the data analysis network element.

3. The method according to claim 2, characterized in that The first message also includes one or more of the data analysis information or the report information, and the report information is used to determine parameters for feeding back the effect information.

4. The method according to claim 2 or 3, characterized in that: The method further comprises: The data analysis network element sends the updated data analysis information to the first network element.

5. The method according to claim 1, characterized in that Before the data analysis network element receives the first information from the first network element, the method further includes: The data analysis network element sends a second message to the first network element, where the second message is used to request the effect information. The second message includes one or more of a data analysis identifier or report information corresponding to the data analysis information, and the report information is used to determine parameters for feedback of the effect information.

6. The method according to claim 2 or 5, characterized in that: The method further comprises: The data analysis network element receives a first applicable scope corresponding to the effect information from the first network element, where the first applicable scope is a scope corresponding to when the data analysis information reaches the effect information.

7. The method according to claim 5, characterized in that The method further comprises: The data analysis network element determines a second application scope corresponding to the data analysis information, where the second application scope is a scope within which the data analysis information is effective; The second message also includes the second applicable scope.

8. The method according to claim 5 or 7, characterized in that: The method further comprises: The data analysis network element sends the data analysis information to the second network element.

9. The method according to claim 7, characterized in that: The data analysis network element determines a second application scope corresponding to the data analysis information, including: The data analysis network element receives a second applicable scope corresponding to the data analysis information from the second network element.

10. The method according to claim 8, characterized in that The second network element is a network element that executes the data analysis information, and the method further includes: The data analysis network element sends the updated data analysis information to the second network element.

11. The method according to claim 3 or 5, characterized in that: The report information includes one or more of the following information: a threshold, a cycle, a time period or a maximum number of reports, wherein: The threshold is used to indicate that when the effect information meets the threshold, the effect information is sent. The period is used to indicate that the effect information is sent according to the period, The time period is used to indicate that the effect information is sent during the time period. The maximum number of reports is used to indicate the maximum number of times the effect information is sent.

12. The method according to claim 1 or 2, characterized in that: The data analysis network element determines the updated data analysis information according to the effect information, including: The data analysis network element sends a third message to a third network element according to the first applicable scope corresponding to the effect information, where the third message is used to request data within the first applicable scope; The data analysis network element receives data within the first applicable scope from the third network element; The data analysis network element determines the updated data analysis information according to the data within the first applicable scope.

13. A data analysis device, characterized in that: include: A communication unit, used to receive first information from a first network element, the first information is related to an action taken by the first network element, the first information includes a data analysis identifier related to the action, and effect information of the data analysis information related to the action, the effect information is obtained by evaluating the effect of using the data analysis information; wherein, when the data analysis identifier corresponding to the data analysis information is terminal mobility, the first network element is an access management network element, the second applicable scope is a first paging area corresponding to the terminal, and the effect information indicates that the access management network element can page the terminal in the second paging area, wherein the second applicable scope is the scope of action of the data analysis information; or, When the data analysis identifier corresponding to the data analysis information is load information of a fourth network element, the first network element is a network storage network element or a network management network element, and the effect information is load information of the fourth network element after adjustment or load information of the fourth network element; or When the data analysis identifier corresponding to the data analysis information is a service experience of a service, the first network element is an application function AF network element, the effect information is the service experience after the service is adjusted or the service experience of the service does not change, and the service experience is used to adjust the quality of service QoS parameters of the service; A processing unit is used to determine updated data analysis information according to the first information.

14. The device according to claim 13, characterized in that The communication unit is used to send a first message to the first network element before receiving the first information from the first network element. The first message includes a first indication, wherein the first indication is used to instruct the first network element to feed back the effect information to the data analysis device.

15. The device according to claim 14, characterized in that The first message also includes one or more of the data analysis information or the report information, and the report information is used to determine parameters for feeding back the effect information.

16. The device according to claim 14 or 15, characterized in that The communication unit is further used to send the updated data analysis information to the first network element.

17. The device according to claim 13, characterized in that The communication unit is used to send a second message to the first network element before receiving the first information from the first network element. The second message is used to request the effect information. The second message includes one or more of the data analysis identifier or report information corresponding to the data analysis information. The report information is used to determine the parameters for feeding back the effect information.

18. The device according to claim 14 or 17, characterized in that The communication unit is further used to receive a first applicable scope corresponding to the effect information from the first network element, where the first applicable scope is a scope corresponding to when the data analysis information reaches the effect information.

19. The device according to claim 17, characterized in that The processing unit is further used to determine a second application scope corresponding to the data analysis information, where the second application scope is a scope within which the data analysis information is effective; The second message also includes the second applicable scope.

20. The device according to claim 17 or 19, characterized in that The communication unit is also used to send the data analysis information to the second network element.

21. The device according to claim 19, characterized in that The processing unit receives the second applicable scope corresponding to the data analysis information from the second network element through the communication unit.

22. The device according to claim 20, characterized in that The second network element is a network element that executes the data analysis information, and the communication unit is further used for: Send the updated data analysis information to the second network element.

23. The device according to claim 15 or 17, characterized in that The report information includes one or more of the following information: a threshold, a cycle, a time period or a maximum number of reports, wherein: The threshold is used to indicate that when the effect information meets the threshold, the effect information is sent. The period is used to indicate that the effect information is sent according to the period, The time period is used to indicate that the effect information is sent during the time period. The maximum number of reports is used to indicate the maximum number of times the effect information is sent.

24. The device according to claim 13 or 14, characterized in that The processing unit is specifically configured to send a third message to a third network element according to the first applicable scope corresponding to the effect information, wherein the third message is used to request data within the first applicable scope; The communication unit is further configured to receive data within the first applicable scope from the third network element; The processing unit is used to determine the updated data analysis information according to the data within the first applicable scope.

25. A computer-readable storage medium, characterized in that: The readable storage medium stores instructions, and when the instructions are executed, the method according to any one of claims 1 to 12 is implemented.

26. A chip, characterized in that: The chip includes a processor and a communication interface, the communication interface is coupled to the processor, the processor is used to run a computer program or instruction to implement the method according to any one of claims 1 to 12, and the communication interface is used to communicate with other modules outside the chip.

27. A data analysis device, characterized in that: include: A processor, the processor is coupled to a memory, and the processor is used to run instructions stored in the memory to execute the method according to any one of claims 1 to 12.

28. A communication system, characterized in that: The system comprises: a data analysis network element, configured to perform the operation of the data analysis network element in any one of the methods of claims 1 to 12; The first network element is used to determine effect information corresponding to the data analysis information, and to send the effect information to the data analysis network element.

29. A data analysis device, characterized in that: The device comprises: at least one processor, and the at least one processor is used to run computer instructions or programs stored in a memory to implement the method according to any one of claims 1 to 12.

Images