Resource management method and device

Abstract

The invention provides a resource management method and device, relates to the technical field of communication, and is used for improving the performance of a communication system. The method comprises: a data analysis function network element obtaining a first service experience data set of a service, each piece of first service experience data in the first service experience data set being used for indicating the service quality of the service executed by all users or a plurality of users in a network, the service running in the network; obtaining first service quality requirement information of the service, wherein the first service quality requirement information refers to a requirement for the first service experience data; determining a second network data set of the network according to the first service experience data set, a first network data set of the network and the first service quality requirement information, when the network is in the state of any second network data in the second network data set, the service can meet the first service quality requirement.

Description

[0001] This application is a divisional application. The application number of the original application is 201811428448.8, and the original application date is November 27, 2018. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The embodiments of the present application relate to the field of communication technology, and in particular, to a resource management method and device. Background Art

[0003] With the continuous emergence of various communication services, different communication services have significantly different requirements for network performance. The fifth-generation mobile communication (5G) system introduces the concept of network slicing (NS) to cope with the differences in the requirements of different communication services for network performance. That is, the 5G network divides the actual network resources and functions to form different network slices to meet these different requirements, which can reduce the network operation investment cost and enrich the network operation model.

[0004] At present, for network slices of different tenants, the network management device determines the service level agreement (SLA) template of the network slices of different tenants according to the service level requirements of each tenant, and deploys the corresponding network slices according to the SLA template. However, the granularity of the SLA template determined by the network management device based only on the service level requirements of each tenant is very coarse, and it is difficult to guarantee the performance of the network slice. At the same time, when the network management device allocates network resources to network slices of different tenants, it can only determine the approximate resource deployment situation according to the SLA template, which is likely to cause resource waste or insufficient deployment resources, thereby reducing the performance of the network slice. Summary of the invention

[0005] The embodiments of the present application provide a resource management method and device, which solve the problem in the prior art that unreasonable network slice resource deployment leads to low performance of network slices.

[0006] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0007] In a first aspect, a resource management method is provided, the method comprising: a data analysis function network element obtains a first service experience data set of a service, each first service experience data in the first service experience data set is used to indicate the service quality of all users or multiple users in the network performing the service, and the service runs on the network; the data analysis function network element obtains first service quality requirement information of the service, the first service quality requirement information refers to the requirement for the first service experience data; the data analysis function network element determines the second network data set of the network according to the first service experience data set, the first network data set of the network and the first service quality requirement information, wherein each first network data in the first network data set includes the first performance parameter of the network, each second network data in the second network data set includes the second performance parameter of the network, and when the network is in the state of the second network data, the service can meet the first service quality requirement information. In the above technical solution, the data analysis function network element analyzes and obtains the relationship between the first service experience and the network performance parameter based on a large amount of historical first service experience data and a large amount of historical network performance parameters, and determines that the network performance parameter corresponding to the first service quality requirement is set according to the relationship. That is, using big data analysis methods, we analyze and obtain the settings of network performance parameters to meet the overall experience requirements of the services provided by network tenants or business servers.

[0008] In a possible implementation of the first aspect, the network is a network slice, a network slice instance, or a network slice sub-instance. In the above possible implementation, the data analysis function network element can use a big data analysis method to analyze and obtain settings of performance parameters of a slice network or a slice instance network or a slice sub-instance network, so as to meet the overall experience requirements of the services provided by the slice network or the slice instance network or the slice sub-instance network tenant or the service server.

[0009] In a possible implementation of the first aspect, the data analysis function network element is a network data analysis device or a network management device. In the above possible implementation, the data analysis function of the present invention can be set in different network devices.

[0010] In a possible implementation of the first aspect, when the data analysis function network element is a network data analysis device, the method further includes: the data analysis function network element sends the second network data set to a network management device or a network storage device, so that the network management device or the network storage device adjusts or sets the network according to the second network data set. In the above possible implementation, different network devices are triggered to adjust or set the network according to the second network data set.

[0011] In a possible implementation manner of the first aspect, the data analysis function network element obtains first service quality requirement information of the service, including: the data analysis function network element obtains the first service quality requirement information of the service from a service server of the service.

[0012] In a possible implementation manner of the first aspect, the method further includes: the data analysis function network element obtains the first network data set from a network management device or a network storage device.

[0013] In a possible implementation of the first aspect, the data analysis function network element obtains a first service experience data set of a service, including: the data analysis function network element obtains a second service experience data set of the service, each second service experience data in the second service experience data set is used to indicate the service quality of the service of a single user; the data analysis function network element obtains the first service experience data set of the service according to the second service experience data set. In the above possible implementation, the data analysis function network element itself calculates the overall service experience data of the service according to the user-level experience data, which helps to improve the credibility of the obtained overall service experience data.

[0014] In a possible implementation of the first aspect, before the data analysis function network element obtains the second service experience data set of the service, the method further includes: the data analysis function network element obtains the third service experience data set of the service, each third service experience data in the third service experience data set is used to indicate the service experience of the service corresponding to a single user; the data analysis function network element obtains the third service experience data set corresponding to the third network data set of the network, each third network data in the third network data set includes the flow-level network data corresponding to the service; wherein the data analysis function network element obtains the second service experience data set of the service, including: the data analysis function network element obtains the second service experience data set according to the third service experience data set and the third network data set. In the above possible implementation, the data analysis function network element obtains the relationship between the user-level service experience and the flow-level network data according to a large amount of historical user-level service experience data and a corresponding large amount of historical flow-level network data, and calculates or infers the current or future user-level service experience data according to the relationship.

[0015] In a possible implementation of the first aspect, the data analysis function network element obtains a second service experience data set of the service, including: the data analysis function network element obtains the second service experience data set from a service server of the service. In the above possible implementation, directly obtaining user-level experience data from the service server can improve the efficiency of the execution of the method to a certain extent.

[0016] In a possible implementation of the first aspect, the data analysis function network element obtains a first service experience data set of the service, including: the data analysis function network element obtains the first service experience data set from a service server of the service. In the above possible implementation, directly obtaining the overall experience data of the service from the service server can improve the efficiency of the execution of the method to a certain extent.

[0017] In a possible implementation of the first aspect, when the data analysis function network element is a network management device, the method further includes: the data analysis function network element adjusts or sets the network according to the second network data set. In the above possible implementation, a method for adjusting or setting network performance parameter settings according to big data analysis statistical results is provided, which helps to improve the rationality of network settings and adjustments, thereby improving the service experience of the services running therein.

[0018] In a possible implementation manner of the first aspect, the data analysis function network element obtains a first service experience data set for the service, including: the data analysis function network element obtains the first service experience data set from a network data analysis device or a service server for the service.

[0019] In a possible implementation manner of the first aspect, each first service experience data in the first service experience data set includes at least one of the following information: service identification information of the service, network identification information of the network, first time information, first location information, and information on the proportion of users who meet the service experience requirements.

[0020] In a possible implementation of the first aspect, each second network data in the second network data set includes at least one item of the following information: identification information of the network, second time information, second location information, network equipment information, network interface information, and end-to-end performance information of the network.

[0021] In a possible implementation of the first aspect, the network device information includes at least one of the following information of at least one network device: device identification information, registered user number information, online user number information, resource information, performance parameter measurement information, key performance indicator information, and associated identification information of a single user executing the service in the device.

[0022] In a possible implementation of the first aspect, the network interface information includes at least one item of the following information of at least one network interface: identification information of a device corresponding to the network interface, latency information of the network interface, topology information of a device corresponding to the network interface, data packet throughput information of the network interface, and link usage information of the network interface.

[0023] In a possible implementation manner of the first aspect, each second service experience data in the second service experience set includes at least one of the following information: user identification information, user association identification information, user service quality evaluation data, and service description information.

[0024] In a second aspect, a resource management device is provided, which includes: an acquisition unit, used to acquire a first service experience data set of a service, each first service experience data in the first service experience data set is used to indicate the service quality of all users or multiple users in the network performing the service, wherein the service runs on the network; the acquisition unit, also used to acquire first service quality requirement information of the service, the first service quality requirement information refers to the requirement for the first service experience data; a processing unit, used to determine a second network data set of the network based on the first service experience data set, the first network data set of the network, and the first service quality requirement information, wherein each first network data in the first network data set includes a first performance parameter of the network, each second network data in the second network data set includes a second performance parameter of the network, and when the network is in the state of the second network data, the service can meet the first service quality requirement information.

[0025] In a possible implementation of the second aspect, the network is a network slice, a network slice instance, or a network slice sub-instance.

[0026] In a possible implementation manner of the second aspect, the resource management apparatus includes a network data analysis device or a network management device.

[0027] In a possible implementation of the second aspect, when the resource management device is a network data analysis device, the device also includes: a sending unit, used to send the second network data set to the network management device or the network storage device, so that the network management device or the network storage device adjusts or sets the network according to the second network data set.

[0028] In a possible implementation manner of the second aspect, the acquiring unit is further configured to: acquire first service quality requirement information of the service from a service server of the service.

[0029] In a possible implementation manner of the second aspect, the acquiring unit is further configured to: acquire the first network data set from a network management device or a network storage device.

[0030] In a possible implementation of the second aspect, the acquisition unit is further used to: obtain a second service experience data set for the service, each second service experience data in the second service experience data set is used to indicate the service quality of the service of a single user; and obtain a first service experience data set for the service according to the second service experience data set.

[0031] In a possible implementation of the second aspect, the acquisition unit is further used to: obtain a third service experience data set for the service, each third service experience data in the third service experience data set is used to indicate the service experience of the service corresponding to a single user; obtain a third network data set of the network corresponding to the third service experience data set, each third network data in the third network data set includes flow-level network data corresponding to the service; wherein the acquisition unit is also used to obtain a second service experience data set for the service, including: obtaining a second service experience data set according to the third service experience data set and the third network data set.

[0032] In a possible implementation manner of the second aspect, the acquiring unit is further configured to: acquire a second service experience data set from a service server of the service.

[0033] In a possible implementation manner of the second aspect, the acquiring unit is further configured to: acquire the first service experience data set from a service server of the service.

[0034] In a possible implementation manner of the second aspect, when the resource management apparatus is a network management device, the processing unit is further used to: adjust or set the network according to the second network data set.

[0035] In a possible implementation manner of the second aspect, the acquisition unit is further used to: acquire the first service experience data set from the network data analysis device or the service server of the service.

[0036] In a possible implementation manner of the second aspect, each first service experience data in the first service experience data set includes at least one of the following information: service identification information of the service, network identification information of the network, first time information, first location information, and information on the proportion of users who meet the service experience requirements.

[0037] In a possible implementation of the second aspect, each second network data in the second network data set includes at least one item of the following information: identification information of the network, second time information, second location information, network equipment information, network interface information, and end-to-end performance information of the network.

[0038] In a possible implementation of the second aspect, the network device information includes at least one item of the following information of at least one network device: device identification information, registered user number information, online user number information, resource information, performance parameter measurement information, key performance indicator information, and associated identification information of a single user executing the service in the device.

[0039] In a possible implementation of the second aspect, the network interface information includes at least one item of the following information of at least one network interface: identification information of a device corresponding to the network interface, latency information of the network interface, topology information of a device corresponding to the network interface, data packet throughput information of the network interface, and link usage information of the network interface.

[0040] In a possible implementation manner of the second aspect, each second service experience data in the second service experience data set includes at least one of the following information: user identification information, user association identification information, user service quality evaluation data, and service description information.

[0041] According to a third aspect, a data analysis function network element is provided, which includes a processor, a memory, a communication interface and a bus, wherein the processor, the memory and the communication interface are connected through the bus; the memory is used to store program codes, and the communication interface is used to support the data analysis function network element to communicate, and when the program code is executed by the processor, the data analysis function network element executes the steps in the resource management method provided by the first aspect or any possible implementation method of the first aspect.

[0042] In a fourth aspect, a service monitoring method is provided, the method comprising: a data analysis function network element obtains a third service experience data set of the service from a service server of the service, each third service experience data in the third service experience data set is used to indicate the service quality of a single user corresponding to the service; a third network data set corresponding to the network of the third service experience data set is obtained, each third network data in the third network data set includes flow-level network data corresponding to the service; and second service experience data is determined based on the first service experience data set and the third network data set.

[0043] In a possible implementation manner of the fourth aspect, determining the second business experience data according to the third business experience data set and the third network data set includes: obtaining a fourth network data set; and determining the second business experience data according to the third business experience data set, the third network data set, and the fourth network data set.

[0044] In a possible implementation manner of the fourth aspect, the method further includes: determining a business experience model of the business based on a third business experience data set and a third network data set, the business experience model being used to characterize a changing relationship between the business experience data of the business and the network data corresponding to the business; and determining third business experience data based on the business experience model.

[0045] In a possible implementation manner of the fourth aspect, each third service experience data in the third service experience data set includes at least one of the following information: user identification information, user association identification information, user service quality evaluation data, and service description information.

[0046] In a fifth aspect, a service monitoring device is provided, which includes: an acquisition unit, used to obtain a third service experience data set of the service from a service server of the service, each third service experience data in the third service experience data set is used to indicate the service quality of a single user corresponding to the service; the acquisition unit is also used to obtain a third network data set of the network corresponding to the third service experience data set, each third network data in the third network data set includes flow-level network data corresponding to the service; a processing unit, used to determine the second service experience data based on the third service experience data set and the third network data set.

[0047] In a possible implementation manner of the fifth aspect, the acquisition unit is further configured to acquire fourth network data; and determine the second service experience data according to the third service experience data set, the third network data set, and the fourth network data.

[0048] In a possible implementation of the fifth aspect, the processing unit is further used to determine a business experience model of the business based on a third business experience data set and a third network data set, wherein the business experience model is used to characterize the relationship between the business experience data of the business and the network data corresponding to the business; and determine the second business experience data based on the business experience model.

[0049] In a possible implementation manner of the fifth aspect, the first service experience data set includes at least one of the following information: user identification information, user association identification information, user service quality evaluation data, and service description information.

[0050] In the sixth aspect, a data analysis function network element is provided, which includes a processor, a memory, a communication interface and a bus, and the processor, the memory and the communication interface are connected through the bus; the memory is used to store program code, and the communication interface is used to support the data analysis function network element to communicate, and when the program code is executed by the processor, the data analysis function network element executes the steps in the resource management method provided by the above-mentioned fourth aspect or any possible implementation method of the fourth aspect.

[0051] According to another aspect of the present application, a communication system is provided, which includes a data analysis function network element and a service server, wherein the data analysis function network element is a data analysis function network element provided by the second aspect or any possible implementation method of the second aspect.

[0052] In another aspect of the present application, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is executed on a computer, the computer executes the steps of the resource management method provided by the first aspect or any possible implementation of the first aspect.

[0053] In another aspect of the present application, a computer-readable storage medium is provided, in which instructions are stored. When the computer-readable storage medium is executed on a computer, the computer executes the steps in the service detection method provided by the fourth aspect or any possible implementation of the fourth aspect.

[0054] In another aspect of the present application, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the steps of the resource management method provided by the first aspect or any possible implementation of the first aspect.

[0055] In another aspect of the present application, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the steps of the service detection method provided in the fourth aspect or any possible implementation of the fourth aspect.

[0056] Another aspect of the present application provides a chip system, which includes a memory, a processor, a bus and a communication interface, wherein the memory stores code and data, the processor is connected to the memory through a bus, and the processor runs the code in the memory so that the chip system executes the steps in the resource management method provided by the first aspect or any possible implementation of the first aspect.

[0057] In another aspect of the present application, a chip system is provided, which includes a memory, a processor, a bus and a communication interface, wherein the memory stores code and data, the processor is connected to the memory through a bus, and the processor runs the code in the memory so that the chip system executes the steps in the service detection method provided by the fourth aspect or any possible implementation of the fourth aspect.

[0058] It can be understood that the device, computer storage medium or computer program product of any of the resource management methods provided above is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0059] The embodiment of the present invention also provides a method and device for resource management.

[0060] On the other hand, an embodiment of the present application provides a method for resource management, the method comprising: a first network element determines whether the network meets network quality requirements, and the first network element sends first indication information to a network management device, wherein the first indication information is used to indicate whether the network meets network quality requirements.

[0061] According to the above method, the first network element can trigger the network management network element to adjust network resources according to the network quality requirements determined by itself. In other words, a serial method for adjusting network resources by the first network element and the network management network element is provided.

[0062] In one possible design, before the first network element sends the first indication information to the network management device, the method also includes: the first network element performs user access control on the network.

[0063] In a possible design, the first network element performs user access control on the network, including:

[0064] The first network element receives user number information from a network management device or a network data analysis device, wherein the user number information includes registered user number information and / or online user number information; the first network element performs user number access control on the network according to the user number information.

[0065] In one possible design, the network's satisfaction with network quality requirements includes: the network cannot meet the network quality requirements; or the network's satisfaction with network quality requirements is lower than a preset value; or the degree to which the network satisfies the network quality requirements.

[0066] In one possible design, the first network element determines whether the network satisfies the network quality requirement, including:

[0067] The first network element receives first network experience data of the network from a network data analysis device, where the first network experience data is used to indicate the service quality of the network; the first network element determines whether the network meets the network quality requirement according to the first network experience data.

[0068] On the other hand, the present application also discloses a resource management method, which includes: a network management device receives first indication information from a first network element, wherein the first indication information is used to indicate whether the network meets network quality requirements, and the network management device adjusts network resources according to the first indication information.

[0069] According to the above method, the network management network element can adjust network resources according to the trigger condition sent by the first network element, and the trigger condition is the satisfaction of the network quality requirement determined by the first network element. In other words, a serial method for adjusting network resources by the first network element and the network management network element is provided.

[0070] In one possible design, the network management device adjusts network resources according to the first indication information, including: the network management device determines that the network cannot meet network quality requirements according to the first indication information, and the network management device adjusts the network resources.

[0071] In one possible design, the network management device adjusts network resources according to first indication information, including: the network management device receives second network experience data from a network data analysis device, where the second network experience data is used to indicate the service quality of the network; the network management device adjusts network resources according to the first indication information and the second network experience data.

[0072] In one possible design, the method includes: a network management device obtains second network experience data according to a first indication.

[0073] On the other hand, the present application also discloses a resource management method, which includes: a network management device receives network experience data from a network data analysis device, where the network experience data is used to indicate the service quality of the network; and the network management device adjusts network resources according to the network experience data.

[0074] According to the above method, the network management device adjusts or sets the network based on the network quality analysis information provided by the network data analysis device, so as to better provide the rationality and accuracy of the network settings.

[0075] In one possible design, the network experience data includes experience data at a network granularity and / or experience data at a business granularity, wherein the experience data at a network granularity is used to indicate the network service quality at a network granularity, and the experience data at a business granularity is used to indicate the network service quality at a business granularity.

[0076] In a possible design, it also includes: the network management device receives first indication information from the first network element, and the first indication information is used to indicate whether the network meets the network quality requirements.

[0077] In one possible design, the network's satisfaction with network quality requirements includes: the network cannot meet the network quality requirements; or the network's satisfaction with network quality requirements is lower than a preset value; or the degree to which the network satisfies the network quality requirements.

[0078] In one possible design, the network management device adjusts network resources according to network experience data, including: the network management device adjusts network resources according to first indication information and network experience data.

[0079] In one possible design, the network management device adjusts network resources according to the first indication information and network experience data, including: the network management device determines that the network cannot meet network quality requirements according to the first indication information, and the network management device adjusts the network resources.

[0080] On the other hand, the present application also discloses a method for resource management, which includes: a first network device determines a network status of a network, the network status includes a test status or a stable status, wherein the test status is used to indicate that the network is a newly built network or the network is in a test phase, and the stable status is used to indicate that the network is in a stable state or the network has completed the test phase; the first network device sends network status indication information to a second network device, and the network status indication information is used to indicate the network status of the network to the second network device; or, the network status indication information is used to indicate the time information for reporting data to the second network device, wherein the time information for reporting data is determined by the first network device according to the network status.

[0081] According to the above method, the first network device can implement network status interaction with the second network device, so that the second network device can adopt different data reporting strategies according to different network statuses.

[0082] In a possible design, it also includes: the first network device receives data from the second network device, and the data is sent by the second network device to the first network device according to the network status indication information.

[0083] In one possible design, the first network device includes a network management device.

[0084] In one possible design, the second network device includes a network data analysis device.

[0085] In one possible design, the data includes network experience data, where the network experience data is used to indicate the service quality of the network.

[0086] In a possible design, it also includes: the first network device adjusts network resources according to the network experience data so that the network can meet network quality requirements.

[0087] In one possible design, the first network device adjusts network resources according to network experience data, including: the first network device sends resource adjustment notification information to the access network device or the core network device according to the network experience data, and the resource adjustment notification information is used to notify the access network device or the core network device to adjust the network resources.

[0088] On the other hand, the present application also discloses a method for resource management, the method comprising: the second network device receives network status indication information from the first network device, the network status indication information is used to indicate the network status of the network to the second network device; or the second indication information is used to indicate the time information of reporting data to the second network device. The network status includes a test status or a stable status, the test status is used to indicate that the network is a newly built network or the network is in the test phase, the stable status is used to indicate that the network is in a stable state or the network has completed the test phase, and the time information of reporting data is determined by the first network device according to the network status; the second network device sends data to the first network device according to the network status indication information.

[0089] According to the above method, the first network device can implement network status interaction with the second network device, so that the second network device can adopt different data reporting strategies according to different network statuses.

[0090] In a possible design, it also includes: the second network device obtains training data from a third network device according to the network status indication information, and the third network device is different from the second network device; and the second network device generates data according to the training data.

[0091] In one possible design, the first network device includes a network management device.

[0092] In one possible design, the second network device includes a network data analysis device.

[0093] In one possible design, the data includes network experience data, where the network experience data is used to indicate the service quality of the network.

[0094] On the other hand, an embodiment of the present application provides a resource management device, which has the function of implementing the first network element behavior in the above method. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In one possible design, the structure of the above device includes a processor and a transceiver, and the processor is configured to process the device to perform the corresponding functions in the above method. The transceiver is used to implement communication between the above device and a network management device / network data analysis device. The device may also include a memory, which is used to couple with a processor and store necessary program instructions and data for the device.

[0095] On the other hand, an embodiment of the present application provides a resource management device, which has the function of implementing the behavior of the network management device in the above method. The function can be implemented by hardware, or it can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In one possible design, the structure of the above device includes a processor and a transceiver, and the processor is configured to process the device to perform the corresponding functions in the above method. The transceiver is used to implement communication between the above device and the network data analysis device / first network element. The device may also include a memory, which is used to couple with the processor and store the necessary program instructions and data for the device.

[0096] On the other hand, an embodiment of the present application provides a resource management device, which has the function of implementing the behavior of the first network device in the above method. The function can be implemented by hardware, or it can be implemented by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In one possible design, the structure of the above device includes a processor and a transceiver, and the processor is configured to process the device to perform the corresponding functions in the above method. The transceiver is used to implement communication between the above device and the second network device / network data analysis device. The device may also include a memory, which is used to couple with the processor and store the necessary program instructions and data for the device.

[0097] On the other hand, an embodiment of the present application provides a resource management device, which has the function of implementing the behavior of the second network device in the above method. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In a possible design, the structure of the above device includes a processor and a transceiver, and the processor is configured to process the device to perform the corresponding function in the above method. The transceiver is used to implement communication between the above device and the first network device. The device may also include a memory, which is used to couple with the processor and store the necessary program instructions and data of the device.

[0098] On the other hand, an embodiment of the present application provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer executes the above-mentioned methods.

[0099] On the other hand, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the above-mentioned methods.

[0100] On the other hand, the present application provides a chip system, which includes a processor for supporting the above-mentioned device to implement the functions involved in the above-mentioned aspects, for example, generating or processing the information involved in the above-mentioned method. In a possible design, the chip system also includes a memory, which is used to store program instructions and data necessary for the data sending device. The chip system can be composed of a chip, or it can include a chip and other discrete devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0101] Figure 1 A schematic diagram of the structure of a communication system provided in an embodiment of the present application;

[0102] Figure 2 A schematic diagram of a resource management method provided in an embodiment of the present application Figure 1 ;

[0103] Figure 3 A schematic diagram of a resource management method provided in an embodiment of the present application Figure 2 ;

[0104] Figure 4 A schematic diagram of a resource management method provided in an embodiment of the present application Figure 3 ;

[0105] Figure 5 A flowchart of a service monitoring method provided in an embodiment of the present application;

[0106] Figure 6 A schematic diagram of the structure of a network data analysis device provided in an embodiment of the present application Figure 1 ;

[0107] Figure 7 A schematic diagram of the structure of a network data analysis device provided in an embodiment of the present application Figure 2 ;

[0108] Figure 8 A schematic diagram of the structure of the network management device provided in the embodiment of the present application Figure 1 ;

[0109] Fig. 9 A schematic diagram of the structure of the network management device provided in the embodiment of the present application Figure 2 ;

[0110] Fig.10 A schematic diagram of a resource management method provided in an embodiment of the present application Figure 4 ;

[0111] Fig.11 A schematic diagram of a resource management method provided in an embodiment of the present application Figure 5 ;

[0112] Fig. 12A , 12B A schematic diagram of the structure of a resource management device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0113] In the present application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, ab, ac, bc or abc, where a, b, c can be single or multiple. In addition, in the embodiments of the present application, the words "first", "second" and the like do not limit the quantity and execution order.

[0114] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0115] First, in order to facilitate understanding of the embodiments of the present application, some technical terms involved in the embodiments of the present application are described:

[0116] Network slice (NS), also known as sliced ​​network or simply slice, refers to the customization of different logical networks based on the service requirements of different tenants' services on physical or virtual network infrastructure. A network slice can be a complete end-to-end network including terminal equipment, access network, transmission network, core network and service server, or a complete end-to-end network including only core network but supplemented by terminal equipment, access network, transmission network and service server, which can provide complete communication services and have certain network capabilities. A network slice can be a communication resource that ensures that the bearer service or service can meet the requirements of the service level agreement, or it can be considered as a combination of network functions and communication resources required to complete a certain communication service or certain communication services. A network slice is identified by single network slice selection assistance information (S-NSSAI). S-NSSAI consists of slice / service type (SST) and slice differentiator (SD). Among them, SST and SD can be defined by the standard or customized by the operator; SD is optional information to supplement SST to distinguish multiple network slices of the same SST, for example, it can be used to characterize the ownership relationship of network slices.

[0117] A network slice instance (NSI), also known as a slice instance network, is an instantiated network created by an operator on the infrastructure according to a network slice template. It is composed of different network function entities and physical resources. Different network slice instances are logically isolated. A network slice can instantiate one or more NSIs, and each NSI is identified by a network slice instance identifier (NSI ID). In other words, one S-NSSAI corresponds to one or more NSI IDs.

[0118] A network slice subnet instance (NSSI), also known as a slice subinstance network, is a group of network function elements and the orchestration and configuration of the resources of these function elements, which are used to form a local logical network. The introduction of network slice subinstances is mainly to facilitate the management of a network slice instance. For example, a network slice is divided into two network slice subinstances according to core network elements and access network elements, and the core network resources and network resources are orchestrated and configured respectively for easy management.

[0119] Service level agreement (SLA): is a contract between a service provider and its customers that documents the application services provided by the service provider and defines the performance standards that the service provider is obligated to meet. SLA can establish customer expectations of the service provider in terms of performance and quality. SLA can include a series of qualitative or quantitative details such as availability, performance indicator baselines, reliability, response time, etc.

[0120] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0121] like Figure 1 As shown, a schematic diagram of a communication system architecture provided in an embodiment of the present application is provided. The communication system includes a network data analysis device, an application function (AF) network element, a core network (CN) network element, a radio access network (RAN / AN) network element, a transmission network element (TN), a network management device, a terminal device and a network exposure function (NEF) network element. Figure 1 In the example of AF network elements including AF1 and AF2, the data analysis function related to the present application can be deployed in a network data analysis device or in a network management device, that is, the data analysis function network element can be a network data analysis device or a network management device. In actual applications, the data analysis function network element can also be other network elements.

[0122] Among them, the core network elements may include policy control function (PCF) network elements, session management function (SMF) network elements, access and mobility management function (AMF) network elements, user plane function (UPF) network elements, network storage function (NRF) network elements. Network management equipment may include network operation and maintenance (OAM) network elements, network slice management function (NSMF) network elements, etc.

[0123] The network data analysis device (such as Network Data Analytics Function, NWDAF) can be deployed inside the core network, that is, the network data analysis device is also a core network element, and it may not be deployed inside the core network. The embodiments of this application do not make specific restrictions on this. In addition, the network data analysis device and the network management device can be deployed separately or together with other network elements in the network. This application does not make any restrictions on this. Figure 1 The following is an example of separate deployment of network data analysis equipment and network management equipment.

[0124] In addition, the network data analysis device can communicate directly with the network elements that need to communicate through the service-based interface. For example, the network data analysis device can communicate with network elements such as PCF, SMF, AMF, UPF, NRF and RAN through the service-based interface by calling different services of the service-based interface. It can be understood that in the above Figure 1 In the communication system shown, the functions and interfaces of each network element are only exemplary. When each network element is applied in the embodiments of the present application, not all functions are necessary. In addition, the present application does not exclude communication between network network elements based on point-to-point interfaces, such as the network data analysis equipment is connected to the PCF network element through the N23 interface. The PCF is connected to the AF network element through the N5 interface, to the SMF network element through the N7 interface, and to the AMF network element through the N15 interface. The PCF can formulate dynamic QoS policies and distribute corresponding policies to network elements such as the SMF and AMF. The UPF is connected to the SMF network element through the N4 interface and to the RAN network element through the N3 interface. The AN is connected to the AMF network element through the N2 interface. The UE is connected to the AMF network element through the N1 interface. Figure 1 Only a portion of the interfaces listed above are shown.

[0125] Terminal devices include but are not limited to: user equipment (UE), user unit, user station, mobile station, mobile station, remote station, remote terminal equipment, mobile terminal equipment, user terminal equipment, wireless communication equipment, user agent, user device, cellular phone, cordless phone, session initiation protocol (SIP) phone, wireless local loop (WLL) station, personal digital assistant (PDA), handheld device with wireless communication function, computing device, processing device connected to a wireless modem, vehicle-mounted equipment, wearable device, terminal equipment in the Internet of Things, home appliances, virtual reality equipment, terminal equipment in the future 5G network or terminal equipment in the future evolved public land mobile network (PLMN), etc.

[0126] A tenant is a customer who rents a communication operator's network and uses the network to provide one or more services to its users. The tenant can be a vertical industry tenant, or a tenant from the OTT industry or other third-party tenant. In addition, the operator network rented by the tenant can be a network slice, or a slice network instance in a slice network, or other types of networks, which are not specifically limited in the implementation of this application.

[0127] The application function network element is a server that provides a certain type of service to users, so it can also be called an application server or a service server.

[0128] An access network element may be a network element that communicates with a terminal device. An access network element may provide communication coverage for a specific geographical area, and may communicate with a terminal device located within the coverage area (cell). An access network element may communicate with any number of terminal devices. There may be multiple air interface connections between the access network element and the terminal device. For example, there are two air interface connections between the access network element and the terminal device, which are used to transmit data stream A and data stream B, respectively. An access network element may support communication protocols of different standards, or may support different communication modes. For example, the access network element may be a 5G base station or a next-generation base station (gNB), an evolved node B (eNodeB), or a wireless fidelity access point (WiFi AP), or a worldwide interoperability for microwave access base station (WiMAX BS), or a wireless controller in a cloud radio access network (CRAN), or the network device may be an access network device in a future evolved PLMN, etc.

[0129] The PCF network element has the function of policy control and decision-making, and provides policies for the network. The AMF network element is used for mobility management, lawful interception, or access authorization and authentication. The SMF network element is used to implement session and bearer management, address allocation, etc. The user plane function network element is used for routing and forwarding user plane data, threshold control, traffic monitoring, verification, etc. The network storage function network element is used to provide service discovery or network element discovery functions, as well as to maintain the characteristics of the network element and the functions of the services supported by the network element.

[0130] The transmission network element has the function of transmitting network data, for example, the transmission network element may be a routing forwarder.

[0131] Network operation, maintenance and management (OAM) equipment has network management functions, including deployment and setting of networks (such as network slices or network slice instances), measurement and statistics of device-level or network-level performance parameters, fault monitoring, fault reporting, fault location, and fault repair.

[0132] The network data analysis device has data statistics and analysis functions, and can be used to collect and analyze relevant data from network elements, third-party service servers, terminal devices or network management systems, and provide data analysis results to network elements, third-party service servers, terminal devices or network management systems based on relevant data. The analysis results can assist the network in selecting service quality parameters for services, or assist the network in performing traffic routing, or assist the network in selecting background traffic transmission strategies, etc. In an embodiment of the present application, the data analysis device can also be used to provide network (e.g., network slices or network slice instances) analysis results so that the network can execute the deployment or adjustment strategy of the network (e.g., network slices or network slice instances) according to the analysis results.

[0133] The network capability exposure network element NEF has the function of providing or opening the functions of the operator network to external servers or external devices, and it acts as an intermediary for internal and external communications in the network. For example, when a third-party untrusted service server needs to communicate with the internal network, it needs to be forwarded and processed by the network capability exposure network element. Of course, if the internal network service server or the third-party trusted service server communicates with the internal network, it does not need to go through the network capability exposure network element.

[0134] In the embodiments of the present application, all or part of the network elements of the access network equipment and the core network may belong to the 3rd Generation Partnership Project (3GPP) network, or may belong to a non-3GPP network, such as an enterprise internal network. All or part of the network elements of the core network may be physical entity network elements or virtualized network elements, which are not limited here.

[0135] The network to which the resource management method provided in the embodiment of the present application is applied may be a network slice (e.g., a slice in a 5G network), or a network slice instance within a network slice (e.g., a network slice instance in a 5G network slice), or a 4G network corresponding to a dedicated core network (DCN), or a network of other granularity, such as a network distinguished by a PLMN identifier, etc. The embodiment of the present application does not make any specific limitation on this.

[0136] Figure 2 A schematic diagram of a resource management method provided in this application embodiment, see Figure 2 , the method includes the following steps.

[0137] S201: A network data analysis device obtains a first service experience data set of a service, wherein each first service experience data in the first service experience data set is used to indicate the service quality of all users or multiple users in the network performing the service, and the service runs on the network.

[0138] Among them, each first service experience data in the first service experience data set may include at least one of the following information: service identification information of the service, network identification information of the network, first time information, first location information, and information on the proportion of users who meet the service experience standards. The service identification information of the service is used to uniquely identify the service; the network identification information of the network is used to uniquely identify the network and the network is the network on which the service runs. For example, when the network is a slice network or a slice instance network, the network identification information may be NSSAI, S-NSSAI or NSI, etc.; the first time information is used to identify the time corresponding to the first service experience data, that is, the first service experience data is used to indicate the service quality of all users or multiple users of the service within the first time, for example, the first time information is 8 am or from 8 am to 6 pm; the first location information is used to identify the location corresponding to the first service experience data, that is, the first service experience data is used to indicate the service quality of all users or multiple users of the service within the first time. The service quality of all users or multiple users performing the service, for example, the first location information is service cell A; the proportion of users who meet the service experience standard may refer to the ratio of users whose service quality meets the standard among multiple users performing the service. For example, if the service is a voice service, the proportion of users who meet the service experience standard is the proportion of users who meet the voice service MOS score standard (for example, if the tenant requires a MOS score greater than or equal to 3, then the user's MOS score below 3 is not up to standard, and greater than or equal to 3 is up to standard). Assuming that the total number of users performing the voice service is 100 and the number of users who meet the MOS score standard is 80, the proportion of users who meet the voice service experience standard is 80%.

[0139] For example, the service identification information of the service is service_1, the network identification information is NSSAI_1, the first time information is 8 a.m., the first location information is service cell A, and the proportion of users who meet the service experience standard is 80%. The meaning of the first service experience data can be understood as: the network on which service_1 runs is NSSAI_1, and the network NSSAI_1 covers service cell A. Assuming that the total number of users executing service_1 in service cell A is 100, then at 8 a.m., when 100 users execute the service, 80 users have service quality that meets the standard, and 20 users do not meet the standard.

[0140] Optionally, the network data analysis device may obtain the first service experience data set of the service in the following three ways, as shown below.

[0141] First, the network data analysis device obtains a first service experience data set of the service from a service server of the service.

[0142] During the operation of the service, the service server of the service can obtain the second service experience data by its own measurement and calculation method, and the second service experience data is used to indicate the service quality of the single user corresponding to the service (for example, the service server can determine the service quality of each single user performing the service according to its own measurement and calculation method). The service server of the service can also obtain the second service quality requirement information of the service, and the second service quality requirement information refers to the service quality requirement of the user level of the service (for example, the MOS score of the single-user voice service is required to be greater than 3). The service server determines a first service experience data of the service based on a large amount of second service experience data and second service quality requirement information, and the service server can generate multiple first service experience data through multiple similar determination processes, and the multiple first service experience data constitute a first service experience data set. For example, in one determination process, the business server determines that the voice service MOS of 80 users out of 100 users is greater than 3, and the business server determines that a first business experience data is 80%; in another determination process, the business server determines that the voice service MOS of 90 users out of 100 users is greater than 3, and the business server determines that a first business experience data is 90%; similarly, after multiple determination processes, the business server can generate a first business experience data set.

[0143] The service server sends the first service experience data set of the service to the network data analysis device. Exemplarily, the service server of the service can actively send the first service experience data set of the service to the network data analysis device; or, the network data analysis device sends a first request message to the server of the service, and the first request message is used to request to obtain the first service experience data set of the service, so that when the service server receives the first request message, it can send the first service experience data set of the service to the network data analysis device.

[0144] Each second service experience data is used to indicate the service quality of a single user corresponding to the service. Specifically, the service quality of a single user corresponding to the service includes but is not limited to the service quality data of the service of the user during a single service process, or the service quality data of the service of the user in a certain time period, or the service quality data of the service of the user at a certain time point. The second service experience data and the third experience data below are used to distinguish the service experience data in terms of time sequence.

[0145] Each second service experience data includes at least one of the following information: user identification information, user association identification information, user service quality evaluation data, and service description information. The user identification information is used to uniquely identify the user. For example, the user identification information may be one or more of the following: Internet Protocol address (IP), subscription permanent identifier (SUPI), permanent equipment identifier (PEI), generic public subscription identifier (GPSI), international mobile subscriber identifier (IMSI), international mobile equipment identity (IMEI), IP 5-tuple, and mobile international integrated service digital network number. number, MSISDN), etc.; the user's associated identification information is used to associate the second service experience data and the flow-level network data corresponding to the second service experience data (here for distinction, it can be referred to as the fourth network data). For example, the user's associated identification information can be the IP address of the user terminal used by the user or the temporary identifier assigned by the network to a single service flow of the user terminal, wherein the temporary identifier can be allocated to the service flow by the PCF network element or the NWDAF network element or the NRF network element or other server network element during the establishment of the single service flow of the user, and the allocated temporary identifier is allocated by the PCF network element or the NWDAF network element or the NRF network element or other server network element during the establishment of the service flow. Sent to each network element corresponding to this service flow, the temporary identifier is used to associate various flow-level network data and user-level experience data corresponding to the service flow; the user's service quality evaluation data refers to the data used to evaluate the user's service quality, for example, if the service is a voice service, the evaluation data can be the MOS score of a certain voice service of the user, voice fluency, etc.; the service description information can include one or more of the following information: the service identifier of the service flow, IP filtering information, media bandwidth requirements, traffic routing information, jitter buffer requirements, media encoding type requirements, encoding rate requirements of media encoding type requirements, TCP congestion window requirements, TCP receive window requirements, buffer requirements and value requirements of at least one data type.

[0146] Optionally, the service server of the service may obtain each second service experience data including data after normalization processing, so as to ensure the security of user information. The normalization processing here refers to the operation of mapping the physical value of the parameter to a fixed value space, such as using the maximum and minimum value normalization method, the Z-Score normalization method, etc. to map the physical value of each feature to a fixed value space.

[0147] In addition, the second service quality requirement information of the service is used to indicate the requirements for the second service experience data of the service, that is, the requirements of the tenant or service server for the service quality of each single user of the service, which can be provided by the tenant to the service server, and the second service quality requirement information of the service can be included in the SLA. Of course, the second service quality requirement information of the service can also be configured in the service server. For example, if the service is a voice service, the second service quality requirement information of the service provided by the tenant is that the voice service MOS score of each user is greater than or equal to 5 points.

[0148] It should be noted that the service server determines the method or algorithm used to generate the first service experience data set of the service based on the second service experience data set and the second service quality requirement information of the service, and the type of the generated first service experience data set can be customized, and the embodiments of the present application do not specifically limit this.

[0149] Further, when the service server of the service obtains the second service experience data set (i.e., the set of service experience data at the user level), multiple second service experience data may be obtained according to the time dimension to form the second service experience data set, or multiple second service experience data may be obtained according to the space dimension to form the second service experience data set, or multiple second service experience data may be obtained according to the time dimension and the space dimension to form the second service experience data set. When the service server of the service obtains the second service experience data set according to the time dimension, the second service experience data of each user of the service at a certain time point (e.g., 8 o'clock in the morning) may be obtained, or the second service experience data of each user of the service in a certain time period (e.g., 8 o'clock in the morning to 6 o'clock in the afternoon) may be obtained. When the service server of the service obtains the second service experience data set according to the space dimension, the second service experience data of each user in the entire network running the service may be obtained, or the second service experience data of each user in a certain area (e.g., a certain latitude and longitude range or a registration area (RA) or a tracking area (TA)) may be obtained, or the second service experience data of each user at a certain location (e.g., a certain cell or a certain latitude and longitude point) may be obtained. When the service server of the service obtains the second service experience data set according to the time dimension and the space dimension, the second service experience data of each user of the service in a certain space at a certain time point or a certain time period can be obtained. For example, the data analysis network element can obtain the second service experience data of each user of the service in the service cell A at 8 am to form a second service experience data set, or obtain the second service experience data of each user of the service in the service cell A from 8 am to 6 pm to form a second service experience data set, etc. It is explained that when the service server obtains the second service experience data set according to the above-mentioned time dimension, space dimension, time or space dimension, each first service experience data obtained by the service server according to the second service experience data also has the characteristics of time dimension, space dimension, time or space dimension. For example, when the data analysis network element can obtain the second service experience data of each user of the service in the service cell A from 8 am to 6 pm to form a second service experience data set, the first network data obtained according to the second service experience data set corresponds to the service quality of all users or multiple users performing services in the service cell A from 8 am to 6 pm.

[0150] Second, the network data analysis device obtains a second service experience data set of the service from the service server, and obtains a first service experience data set of the service according to the second service experience data set.

[0151] Among them, during the operation of the service, the service server providing the service can directly obtain the service experience data of the user level, that is, the second service experience data, and multiple second service experience data form a second service experience data set. The service server sends the second service experience data set to the network data analysis device. Exemplarily, the service server of the service can actively send the second service experience data set to the network data analysis device; or, the network data analysis device sends a second request information to the server of the service, and the second request information is used to request to obtain the second service experience data set, so that when the service server receives the second request information, the second service experience data set can be sent to the network data analysis device.

[0152] In addition, the network data analysis device obtains the first service experience data set of the service based on the second service experience data set, including: the network data analysis device obtains the second service quality requirement information from the service server of the service, the second service quality requirement information is the requirement for the second service experience data, that is, the user-level service quality requirement information of the service; based on a large amount of second service experience data and the second service quality requirement information, the first service experience data set of the service is determined. For example, the data analysis network element determines whether the second service experience data of each user at a certain time and location meets the user-level service quality requirements, thereby determining the proportion of users who meet the service requirements at that time and location.

[0153] It should be noted that the second business experience data set sent by the business server of the business to the network data analysis device may be a second business experience data set obtained by the business server in the manner described in S201 above, that is, multiple second business experience data obtained in a manner of time dimension, space dimension, or a combination of time dimension and space dimension.

[0154] In addition, the method or algorithm used by the network data analysis device to determine the first service experience data set of the service based on the second service experience data set and the second service quality requirement information, and the type of the generated first service experience data set can be customized, and the embodiments of the present application do not make specific limitations on this.

[0155] The third type is that the network data analysis device obtains a third service experience data set of the service, obtains a third network data set corresponding to the third service experience data set based on the third service experience data set, each third network data in the third network data set refers to flow-level network data corresponding to one of the third service experience data, and obtains second service experience data based on the third service experience data set and the third network data set. Multiple second service experience data form a second service experience data set.

[0156] Among them, each third service experience data is also used to indicate the service quality of a single user corresponding to the service, and the specific content of the third service experience data is similar to the content of the second service experience data, except that the third service experience data is earlier than the second service experience data in time sequence, that is, the third service experience data is the service quality data of a single user performing the service in history. For example, both the second service experience data and the third service experience data include the user's MOS score and voice fluency. Assuming that the user's MOS score and voice fluency in the third service experience data are sampled at 8 o'clock in the morning, the user's MOS score and voice fluency in the second service experience data can be collected at 9 o'clock in the morning.

[0157] In addition, the flow-level network data of the service (such as the fourth network data or the third network data) corresponding to the user-level service experience data of the service (such as the second service experience data or the third service experience data) refers to the network flow data corresponding to each user's single service process. The network flow here can be specifically QoS flow in the 5G network, and the network flow data can specifically include the quality of service (quality of service, QoS) parameters provided by the network device for the user's single service process, such as guaranteed flow bit rate (Guaranteed Flow Bit Rate, GFBR), maximum flow bit rate (Maximum Flow Bit Rate, MFBR), uplink or downlink maximum packet loss rate (Uplink or Downlink Maximum Packet Loss Rate, UL or DL ​​Max PLR), packet delay budget (Packet Delay Budget, PDB), packet error rate (Packet Error Rate, PER), average window size (Average Window Size), maximum data burst number (Maximum Data Burst Volume), etc. The historical network data of the flow level of each second service experience data corresponding to the service (i.e., the fourth network data) may refer to the flow-level network data of the service within the sampling time corresponding to the second service experience data. Similarly, each third service experience data corresponds to the flow-level historical network data of the service (ie, the third network data) may refer to the flow-level network data of the service within the sampling time corresponding to the third service experience data.

[0158] Specifically, the network data analysis device can establish a single-user service experience model based on the third service experience data set and the third network data set, that is, establish the relationship between the user-level experience data of the service and the flow-level network data, and obtain the second service experience data based on the model relationship. Multiple second service experience data can constitute the second experience data set.

[0159] For example, first, the network data analysis device can obtain a single-user service experience model through the following two steps:

[0160] A. The network data analysis device obtains training data of the service, where the training data corresponds to the third service experience data set and the third network data set mentioned above.

[0161] The network data analysis equipment first collects data from service servers (such as AF), access network elements (such as RAN), user plane function elements (such as UPF), terminal equipment (such as UE), mobility management function elements (such as AMF), session management function elements (such as SMF), policy control function elements (such as PCF) and other network elements, and then associates the data of each network element through service identifier, service flow identifier, terminal identifier, session identifier of the service flow, association identifier on each network element, time and other information to obtain complete training data. The training data includes:

[0162] (1) A set of third-party service experience data from the AF network element;

[0163] (2) Other time-varying parameter data that affect the third-party service experience data, namely, the third-party network data set, including:

[0164] i. TCP congestion window data, TCP receive window data, jitter buffer data, media coding type and coding rate data, buffer data, and data of at least one data type from the AF network element;

[0165] ii. Data from RAN network element flow bit rate data, packet loss rate data, latency data, wireless channel quality data, and at least one data type;

[0166] iii. Stream bit rate data, packet loss rate data, latency data, and data of at least one data type from the UPF network element;

[0167] iv. Stream bit rate data, packet loss rate data, delay data, data of at least one data type, TCP congestion window data, TCP receive window data, jitter buffer data, media coding type and coding rate data, cache data, CPU occupancy, memory occupancy and at least one data type of data from the UE;

[0168] v. Wait.

[0169] B. Exemplarily, the network data analysis device obtains a relationship model between the third service experience data and the third network data based on a linear regression method, that is, a service experience model of a single user, as follows:

[0170] h(x)=w0x0+w1x1+w2x2+w3x3+···+w D x D (1)

[0171] In formula (1), h(x) is the third service experience data of a certain service, such as the historical MOS value of the user's voice service; X = (x1, x2, x3, ..., x D ) is a feature vector. For example, x1 represents the delay, x2 represents the packet loss rate, x3 represents the stream bit rate, ..., x D Identifies the TCP congestion window, x0 is a constant 1; W = (w1, w2, w3, ..., w D ) is the parameter vector, also called the weight vector, w i Identifies the weight of the influence of the i-th parameter on the third service experience data.

[0172] Among them, the above linear regression is only an exemplary data analysis algorithm, and the network data analysis device can obtain a single user service experience model based on other algorithms, and the present invention does not make specific restrictions. Thirdly, the network data analysis device infers or calculates the second service experience data based on the trained single user service experience model and the flow-level network data (i.e., the fourth network data) corresponding to the second service experience data.

[0173] For example, if the network data analysis device has learned the h(x) model, then according to the independent variable X=(x1, x2, x3, ..., x D ) specific value, the network data analysis device can calculate the specific value of h(x) corresponding to the subsequent time point.

[0174] It should be noted that each third network data or each fourth network data may also include data after normalization processing, etc., and the embodiment of the present application does not make specific limitations on this.

[0175] S202: The network data analysis device obtains the first service quality requirement information of the service. S202 and S201 may be performed in any order. Figure 2 The example in which S202 is located after S201 is used for explanation.

[0176] The first service quality requirement information of the service refers to the requirement for the first service experience data, that is, the service quality requirement of the service server or tenant for all users or multiple users of the service, which can be provided by the tenant or service server. The first service quality requirement information actually expresses the requirements for the overall experience of the service, which can be included in the SLA. For example, when the first service quality requirement is expressed as the proportion of users who meet the service experience standard, the first service quality requirement may be a requirement that the proportion of users who meet the standard is higher than a preset value.

[0177] The network data analysis device may obtain the first service quality requirement information of the service from the service server or the network tenant of the service.

[0178] Optionally, the network data analysis device may obtain the second service quality requirement information or the first service quality requirement information from the service server or the network tenant alone; or, the network data analysis device may obtain the second service quality requirement information and the first service quality requirement information from the service server or the network tenant at the same time. For example, both may be included in the same message or the same information element and obtained by the network data analysis device.

[0179] Exemplarily, the network data analysis device may be a NWDAF network element, the service server may be an AF network element, and the AF may provide the first service quality requirement information of the service to the NWDAF by initiating a Naf_ServiceDataCollection Response or a Naf_ServiceDataCollectionSubscription_Notify operation to the NWDAF.

[0180] S203: The network data analysis device determines a second network data set of the network according to the first service experience data set, the first network data set of the network, and the first service quality requirement information.

[0181] Each first network data in the first network data set includes the first performance parameter of the network, each second network data in the second network data set includes the second performance parameter of the network, and when the network is in each second network data state, the service can meet the first service quality requirement. Each first network data or each second network data includes device-level performance parameters, interface-level performance parameters, and network-level performance parameters, wherein the network-level performance parameters may include network end-to-end performance parameters. The parameter types contained in the first network data and the second network data may be the same, wherein the first and second are used to distinguish the two in terms of timing, and the time corresponding to the first network data is before the time corresponding to the second network data, that is, the first network data is historical data before the second network data. For example, if both the first network data and the second network data include the end-to-end delay information of the network, assuming that the delay information in the first network data is used to indicate the delay of a slice network at 8 am, then the delay information in the second network data can be used to indicate the delay of the slice network at 9 am. For another example, assuming that the delay information in the first network data is used to indicate the delay of a certain slice network at 8 a.m. on the first day, the delay information in the second network data can be used to indicate the delay of the slice network at 8 a.m. on the second day. The main purpose of step 203 is that based on a large amount of historical first network data and a large amount of historical first service experience data, the network data analysis device can statistically analyze at least one second network data, wherein when the network is set to one of the second network data, the service in the network can meet the first service quality requirement of the service, that is, in layman's terms, seek a method for setting network performance parameters according to the first service quality requirement.

[0182] To illustrate one point, assuming that the network data analysis device obtains the first service experience data set and the corresponding first network data set according to the time dimension, space dimension, or time dimension and space dimension, then the second network data set obtained by the network data analysis device may also have the characteristics of time dimension, space dimension, time dimension and space dimension. For example, when the first service experience data set and the first network data set are the first service experience data set and the first network data set corresponding to the service cell A from 8 am to 9 am, then the second network data set obtained by the network data analysis device based on the first service experience data set and the first network data set corresponds to at least one second network data of the service cell A from 8 am to 9 am.

[0183] Exemplarily, the first network data set of the network may be obtained by the network data analysis device from the network management device or the network storage device or directly from each corresponding network device. The network management device may be Figure 1 The OAM network element or NSMF network element shown, the network storage device can be Figure 1The NRF network element shown.

[0184] Each first network data may include at least one of the following information: identification information of the network, third time information, third location information, network device information, network interface information, and end-to-end performance information of the network. The third time information is used to identify the time corresponding to each first network data, that is, the first network data is used to indicate a set of performance parameters of the network within the third time, for example, the third time information is 8 a.m. or 8 a.m. to 6 p.m.; the third location information is used to identify the location corresponding to the first network data, that is, the first network data is used to indicate a set of performance parameters of the network at the third location, for example, the third location information is service cell A; the network device information is used to indicate the performance parameter information of at least one network device included in the network, for example, the performance parameter information of AMF and the performance parameter information of SMF in the network; the network interface information is used to indicate the performance parameter information on at least one network interface in the network, for example, the performance parameter information of the N3 interface and the N6 interface; the end-to-end performance information of the network refers to the performance parameter information that the network can provide at the entire network level.

[0185] The network device information, network interface information and the end-to-end performance information of the network are described in detail below.

[0186] Among them, the network device information includes the performance parameter information of at least one network device in the network, and each network device information includes at least one of the following information: device identification information, registered user number information, online user number information, resource information, performance parameter measurement information, key performance indicators (KPI) information, and associated identification information of a single user executing the service in the device. The resource information here may include but is not limited to at least one of the following information: CPU resources, storage resources, and bandwidth resources; CPU resources, storage resources, and bandwidth resources may all include used resources and / or remaining resources. It should be noted that the resource information type of each network device may be the same or different. For example, the resource type of the base station may only be bandwidth resources, and the resource information of the base station is bandwidth resource information; for another example, the resource type of the UPF may be storage resources, and the resource information of the UPF is storage resource information. Similarly, the performance parameter type and KPI parameter type of each network device may also be the same or different, and this application does not limit it.

[0187] For example, the network device types in the network include RAN, AMF, SMF and UPF, etc., then each first network data may include information of at least one RAN, at least one AMF, at least one SMF and at least one UPF, etc. For ease of understanding, RAN is used as an example for explanation, and the information of RAN may include at least one of the following information of at least one RAN device: RAN identification, information on the number of registered users included in the RAN, the number of online users on the RAN, RAN resource information, RAN performance parameter measurement information, RAN KPI information, and associated identification information of at least one user executing the service in the RAN (for example, UE IP address or UE ID).

[0188] It should be noted that the network equipment information corresponding to network elements such as AMF, SMF and UPF in the network is similar to the above-mentioned RAN information. Please refer to the above description for details, and the embodiments of this application will not be repeated here.

[0189] In addition, the network interface information includes performance parameter information on at least one network interface, and each network interface information may include at least one of the following information: device identification information of the device corresponding to the network interface, and performance parameter information of the network interface. The performance parameter information of the network interface includes at least one of the following information: latency information of the network interface, topology information of the device corresponding to the network interface, data packet throughput information of the network interface, and link usage information of the network interface. The performance parameter types of each network interface may be the same or different, and this application does not impose any restrictions.

[0190] For example, if the network includes interfaces of types such as N2, N3, N6, and N9, the network interface information may include information of at least one N2, at least one N3, at least one N6, at least one N9, etc. For ease of understanding, the N3 interface type is used as an example for explanation. Since N3 is the interface between the UPF and the RAN, the information of an N3 interface may include: the identifiers of the UPFs and the RAN on both sides of the N3 interface, the latency information of the N3 interface, the topology information between the UPF and the RAN corresponding to the N3 interface, the packet throughput information of the N3 interface, and the link usage information of the N3 interface.

[0191] It should be noted that the network interface information corresponding to other interfaces included in the network is similar to the network interface information corresponding to the above-mentioned N3 interface. Please refer to the above description for details, and the embodiments of the present application will not be repeated here.

[0192] Furthermore, the end-to-end performance information of the network includes at least one of the following information: end-to-end delay within the network, the number of registered users of the service in the network, uplink data traffic, downlink data traffic, the number of PDU sessions in the network, virtual resource usage information in the network, etc.

[0193] Exemplarily, the first network data of a 5G network, a network slice, a network slice instance, or a network slice sub-instance may include the contents shown in Tables 1 to 3 below:

[0194] Table 1: Performance parameters and performance indicators on NG-RAN

[0195]

[0196]

[0197] Table 2 Performance indicators of 5GC NF network elements

[0198]

[0199]

[0200] Table 3 End-to-end network or network slice instance performance indicators

[0201]

[0202] In practical applications, the first network data may also include other parameters not defined in the existing standards, or the first network data may also be data after normalization processing, etc., which is not specifically limited in the embodiments of the present application. The normalization processing mainly uses the maximum and minimum value normalization method, the Z-Score normalization method, etc. to map the physical data value of each data type to a fixed numerical space. This processing is convenient for improving the convergence speed of model training in the process of big data analysis on the one hand, and provides a feature data transmission method on the other hand.

[0203] It should be noted that the first network data set here can also be obtained according to the time dimension, the space dimension, or a combination of the time dimension and the space dimension. The specific acquisition process is similar to the acquisition process of the above-mentioned first business experience data set. Please refer to the above-mentioned relevant description, and the embodiment of the present application will not be repeated here.

[0204] In addition, each first network data and each corresponding first service experience data are correspondingly associated with the second service experience data set in the above text in terms of time and location, etc. For example, the second service experience data set refers to a set of multiple second service experience data whose corresponding time is from 8 am to 6 pm and whose corresponding location is service cell A. Then, the time corresponding to the first network data and the first service experience data is also from 8 am to 6 pm and whose corresponding location is service cell A.

[0205] The specific content of each second network data is similar to the content of the first network data. The first and second here are to distinguish the two network data in terms of time sequence, wherein the first network data is earlier than the second network data in terms of time sequence, that is, the first network data is the historical network data before the second network data. Specifically, each second network data may include at least one of the following information: identification information of the network, second time information, second location information, network device information, network interface information, and end-to-end performance information of the network. The second time information is used to identify the time corresponding to the second network data, that is, the second network data is used to indicate the set of performance parameters of the network within the second time. The second location information is used to identify the time corresponding to the second network data, that is, the second network data is used to indicate the set of performance parameters of the network corresponding to the second location. The meaning of other second network data is explained with reference to the explanation of the aforementioned first network data, and will not be repeated here.

[0206] Specifically, the network data analysis device can determine each second network data in the second network data set of the network according to the following process: the network data analysis device establishes a service overall experience model based on the first service quality requirement information of the service, the first service experience data set and the first network data set, that is, establishes a relationship between the first service experience data and the corresponding first network data, thereby determining each second network data based on the relationship, and the determined multiple second network data form the second network data set. For example, the network data analysis device performs model training based on the first service quality requirement information of the service, a large amount of first service experience data and a large amount of first network data, thereby obtaining a service overall experience model, and then determines the second network data set based on the service overall experience model.

[0207] Exemplarily, first, the network data analysis device may obtain a relationship model between the first service experience data of the service and the first network data based on a linear regression method, that is, an overall experience model of the service, as follows:

[0208] g(y)=m0y0+m1y1+m2y2+m3y3+···+m D y D (2)

[0209] In formula (2), g(y) is the first service experience data of a certain service, such as the proportion of users who meet the MOS standard for voice services; Y = (y1, y2, y3, ..., y D ) The feature vector is the first network data corresponding to the first service experience data, that is, the first parameter of the network performance. For example, y1 represents the uplink packet loss rate of NG RAN, y2 represents the average air interface delay, y3 represents the average number of registered users of AMF, ..., y DIndicates the uplink / downlink utilization rate of the N6 interface, y0 is a constant 1; M = (m1, m2, m3, ..., m D ) is the parameter vector, also called the weight vector identifier, m i Identify the weight of the i-th parameter in the first network data affecting the first service experience data set.

[0210] The above-mentioned linear regression refers to an exemplary data analysis algorithm, and the network data analysis device can obtain the overall experience model of the service based on other algorithms, and the present invention does not make specific limitations.

[0211] Thirdly, the network data analysis device determines the value of the feature vector corresponding to a first service quality requirement according to the overall experience model, that is, obtains the second network data set. For example, given the model of g(y), according to the value of g(y) being 80%, obtain Y=(y1, y2, y3, ..., y D ) value combination. For another example, given the model of g(y), according to the value of g(y) being 80%, we can obtain Y=(y1, y2, y3, ..., y D ) value combination.

[0212] Among them, the above-mentioned determination of the value of the feature vector corresponding to a first service quality requirement based on the overall experience model belongs to a multiple criteria decision making (MCDM) problem, and the network data analysis device can obtain the value of the feature vector based on the existing MCDM method, that is, obtain the second network data set. Generally speaking, a combination of multiple sets of feature vectors that meet the first service quality requirement can be obtained, that is, a combination of multiple sets of second network data can be obtained.

[0213] S204: The network data analysis device sends a second network data set to the network management device or the network storage device.

[0214] In an optional implementation, after the network data analysis device determines the second network data set, the network analysis device may send the second network data set to the network management device. In this implementation, the network management device may adjust or set the network according to the second network data set. Specifically, the network management device may adjust the network according to a second network data in the second network set so that the service in the network can meet the first service quality requirement of the service, for example, the network management device sets the network-level data to the second network data.

[0215] In an optional implementation, in the above step S204, the network data analysis device may also send the second network data set to a network storage device (e.g., an NRF network element). In this implementation, the network storage device may obtain network adjustment policy information based on the second network data set, and send the network adjustment policy information to the network management device, so that the network management device adjusts the network according to the network adjustment policy information. The network adjustment policy information may specifically include a second network data in the second network data set.

[0216] Among them, in the above two implementation methods, the network can be specifically a slice network or a slice instance network or a slice sub-instance network.

[0217] S205: Optionally, the network management device adjusts the network according to the second network data set so that the service can meet the first service quality requirement of the service.

[0218] When the network management device receives the second network data set sent by the network data analysis device, the network management device can adjust the network according to a second network data in the second network data set, that is, adjust the state of the network to the state at the time of the second network data, so that the overall experience of the service meets the first service quality requirement of the service.

[0219] Exemplarily, to meet the first service quality requirement of the service, it is assumed that the network data analysis device obtains three sets of second network data settings in step 203, as shown in the following Table 4:

[0220] Table 4

[0221]

[0222] The network management device can then decide how to specifically adjust the network based on the three sets of second network data settings. Specific methods include but are not limited to the following:

[0223] In a possible design, the network management may randomly select a set of second network data from three sets of second network data and set the network performance parameters according to the selected second network data. For example, the second network data corresponding to sequence number 1 may be randomly selected to set the network.

[0224] In another possible design, the network management device may also select a set of second network data that makes the smallest comprehensive change to the current network parameters, and set the network performance parameters according to the selected second network data. For example, if the current network performance parameter combination is NG RAN uplink packet loss rate of 10%, air interface delay of 2ms, AMF average number of registered users of 60k, and N6 interface uplink and downlink utilization rates of 40%, the network management device is likely to select the second network data corresponding to sequence number 3 to set the network.

[0225] In another possible design, the network management device may also select a set of second network data according to the bottleneck parameters of the current network, and set the network performance parameters according to the selected second network data. For example, assuming that the air interface delay parameter is the bottleneck parameter of the network, the network management device may set the network according to the second network data corresponding to sequence number 1 that has the smallest air interface delay requirement.

[0226] One point to be clarified is that the present invention does not limit the specific method of how the network management device adjusts or sets the network according to the selected second network data. For example, how the network management device adjusts the air interface delay of the slice network from the current 8ms to the air interface delay contained in the selected second network data being less than 3ms. The present invention does not make specific limitations. For example, the network management device may increase the bandwidth resources of the air interface to achieve the purpose of reducing the air interface delay, or may increase the number of access network devices to reduce the user capacity of a single device to achieve the purpose of reducing the air interface delay.

[0227] In addition, the network management device adjusts or sets the network according to the second network data, which does not necessarily mean that the network resources are insufficient and the corresponding network resources need to be increased. It may also be that the network resources are redundant and the network management device can reduce the corresponding network resources.

[0228] Optionally, when the data analysis function network element sends the second network data set to the network storage device in the above S204, the network storage device may also trigger adjustment of the network according to the second network data set so that the service meets the first service quality requirement of the service. The method for the network storage device to trigger adjustment of the network includes but is not limited to:

[0229] In a possible implementation, the network storage device can obtain network adjustment policy information based on the second network data set, and send the network adjustment policy information to the network management device, so that the network management device adjusts the network according to the network adjustment policy information. Specifically, the network adjustment policy information can be one of the second network data. For example, in the prior art, the network storage device can obtain the resource information and status information of each network element of the network, then the network storage device can select a set of second network data from the second network data set based on its own existing resource information and status information, and send the selected second network data to the network management device, so that the network management device adjusts or sets the network according to the second network data selected by the network storage device.

[0230] In an embodiment of the present application, the data analysis function network element may be a network data analysis device, which obtains a first service experience data set for the service, determines a second network data set for the network based on the first service experience data set for the service, the first network data set for the network, and the first service quality requirement information, and sends the second network data set for the network to a network management device, so that the network management device adjusts the network according to the second network data set, so that the service meets the first service quality requirement of the service, thereby improving the performance of the network.

[0231] Figure 3 A schematic diagram of a resource management method provided in this application embodiment, see Figure 3 , the method includes the following steps.

[0232] S301: A network data analysis device obtains a first service experience data set of a service, where each first service experience data in the first service experience data set is used to indicate the service quality of all users or multiple users in the network performing the service, and the service runs on the network.

[0233] It should be noted that the specific process of the network data analysis device obtaining the first service experience data set of the service in step S301 is consistent with the description in the above step S201, and the first service experience data set of the service in step S301 is consistent with the description of the first service experience data set of the service in the above step S201. For details, please refer to the description in the above step S201, and the embodiments of the present application will not be repeated here.

[0234] S302: The network data analysis device sends a first service experience data set of the service to the network management device.

[0235] Exemplarily, the network management device may be the above Figure 1 After the network data analysis device obtains the first service experience data set of the service, the network data analysis device may send the first service experience data set of the service to the network management device, so that the network management device obtains the first service experience data set of the service.

[0236] S303: The network management device obtains the first service quality requirement information of the service. S303, S301 and S302 may be performed in any order. Figure 3 The example of S303 being located after S302 is used for explanation.

[0237] The specific meaning of the first service quality requirement information is similar to the first service quality requirement information described in S202 above, and will not be repeated here.

[0238] Among them, the network management device can obtain the first service quality requirement information of the service from the service server or network tenant of the service; or, the network management device obtains the first service quality requirement information of the service from the network data analysis device. The first service quality requirement information of the service in the network data analysis device can be obtained from the service server or network tenant of the service, or can be obtained by the network data analysis device through other means. The embodiments of the present application do not make specific limitations on this.

[0239] Optionally, the network management device may obtain the second service quality requirement information or the first service quality requirement information from the service server alone; or the network management device may obtain the second service quality requirement information and the first service quality requirement information from the service server at the same time, for example, both may be included in the same message or the same information element and obtained by the network management device. The specific meaning of the second service quality requirement information is similar to the second service quality requirement information described in S201 above, and will not be repeated here.

[0240] S304: The network management device determines a second network data set of the network according to the first service experience data set of the service, the first network data set of the network, and the first service quality requirement information.

[0241] It should be noted that in this embodiment, the network management device actually acts as the data analysis function network element mentioned in the present invention, and the technical terms and related implementation processes involved in step S304 are the same as those in the present invention. Figure 2 Step S203 in the embodiment described is similar, the only difference is that the execution subject is changed from the network data analysis device to the network management device, that is, the operation performed by the network management device in step 304 can be specifically referred to the relevant description of the network data analysis device in the above step S203, and the embodiment of the present application will not be repeated here. S305: The network management device adjusts the network according to the second network data set so that the service meets the first service quality requirement of the service.

[0242] It should be noted that the technical terms and related implementation processes involved in step S305 are the same as those in Figure 2 Step S205 in the described embodiment is similar, and specific details may be referred to the relevant description in the above step S205, which will not be repeated herein in the embodiment of the present application.

[0243] In an embodiment of the present application, a network data analysis device obtains a first service experience data set of the service and sends the first service experience data set of the service to a network management device. As a data analysis functional network element, the network management device determines a second network data set of the network based on the first service experience data set of the service, the first network data set of the network, and the first service quality requirement information. The network management device adjusts the network based on the second network data set obtained by its own analysis, so that the service meets the first service quality requirement of the service, thereby improving the performance of the network. In addition to the above method of determining the second network data set of the network similar to step S203, in another possible design of step 304 of the present embodiment, the method of determining the second network data set of the network also includes:

[0244] 1) If the network management device determines, based on the first service experience data set of the service, that the network cannot meet the first service quality requirement, the network management device triggers adjustment of the network.

[0245] Specifically, the network management device sends network resource adjustment notification information to the access network device or the core network device, and the corresponding access network device or the core network device adjusts the corresponding network resources according to the resource adjustment notification information. Among them, the access network device includes the access network management device, and the core network device includes the core network management device.

[0246] 2) The network management device cyclically executes the above step S301 and this step 1), and determines the second network data set of the network according to the first service experience data continuously received.

[0247] The set of first service experience data received again by the network management device in 2) is actually the set of service experience data corresponding to the time point / segment after the network adjustment in 1).

[0248] In the process of this design method, the network management device uses the first service experience data received in 1) as a trigger condition for network adjustment to perform network adjustment operations, and determines whether the network adjustment is in place based on the first service experience data continuously collected after the network adjustment. When the collected first service experience data shows that the first service quality requirement can be met, the network data corresponding to the first service experience data is the second network data.

[0249] Figure 4 A schematic diagram of a resource management method provided in an embodiment of the present application, which can be applied to the above Figure 1 In the network shown, see Figure 4 , the method includes the following steps.

[0250] S401: A network management device obtains a first service experience data set of a service, where each first service experience data in the first service experience data set is used to indicate a service quality of all users or multiple users in a network performing the service, and the service runs on the network.

[0251] The network management device can be the above Figure 1 OAM network element or NSMF network element in.

[0252] Optionally, the network management device may obtain the first service experience data set of the service from a network data analysis device or a service server of the service.

[0253] It should be noted that the specific process of the network data analysis device obtaining the first business experience data set of the business in step S401 is consistent with the description in the above step S201; the specific process of the business server obtaining the first business experience data set of the business in step S401 is consistent with the description in the above step S201; the first business experience data set of the business in step S401 is consistent with the description of the first business experience data set of the business in the above step S201, and the details can be found in the description in the above step S201, which will not be repeated here in the embodiments of the present application.

[0254] S402-S404: The specific implementation method refers to steps S303-S305. Specifically, S402 refers to step S303, S403 refers to step S304, and S404 refers to step S305.

[0255] In an embodiment of the present application, the data analysis function network element may be a network management device, which directly obtains a first service experience data set of the service, and determines a second network data set of the network based on the first service experience data set of the service, the first network data set of the network, and the first service quality requirement information, and adjusts the network based on the second network data set, so that the service meets the first service quality requirement of the service, thereby improving the performance of the network.

[0256] This application Figure 2 , Figure 3 and Figure 4 Among the different resource management methods provided, Figure 2 In the provided resource management method, the network data analysis device acts as a data analysis function network element and performs a large amount of data statistics and analysis work to obtain network performance parameter settings that meet the service-first service quality requirements. The network management device does not need to perform statistical training on a large amount of data, and can directly decide how to adjust the network based on the recommended network performance parameter settings, thereby reducing the power consumption of the network management device. The data analysis and network adjustment are performed by two network elements respectively, which is more efficient. Figure 3 and Figure 4 In the resource management method provided, the network management device acts as a data analysis function network element and performs a large amount of data statistics and analysis work to obtain network performance parameter settings that meet the service first service quality requirements. The only difference is that Figure 3 In the method described, the network management device needs to obtain a large amount of first service experience data from the network data analysis device. Figure 4 In the method described above, the network management device can directly obtain a large amount of first service experience data of the service from the service server. The advantage of the former is that the first service experience data set of the service obtained by the network management device comes from the network rather than the external service server, which is more reliable to some extent, while the advantage of the latter is that it is more efficient.

[0257] Figure 5 A flow chart of a service monitoring method provided in an embodiment of the present application is shown in FIG. Figure 5 , the method includes the following steps.

[0258] S501: The data analysis function network element obtains a third service experience data set from a service server of the service. Each third service experience data in the third service experience data set is used to indicate the service quality of a single user corresponding to the service.

[0259] The data analysis function network element may be a network data analysis device. For example, the network data analysis device may be a NWDAF.

[0260] In addition, each third service experience data includes at least one of the following information: user identification information, user association identification information, user service quality evaluation data, and service description information. Among them, the user's identification information is used to uniquely identify the user, for example, the user's identification information may be a user account, IMSI, etc.; the user's associated identification information is used to associate the user-level experience data of the user with the flow-level network data running the user's service, for example, the user's associated identification information may be the IP address of the user terminal used by the user or a temporary identifier assigned by the network to the service flow of the user terminal, wherein the temporary identifier may be assigned by the PCF network element or the NWDAF network element or the NRF network element or other server network element to the service flow during the service flow establishment process, and is used to identify the corresponding flow-level network data on each network element corresponding to the service flow, and the temporary identifier is distributed by the PCF network element to each network element corresponding to the service flow during the service flow establishment process; the user's service quality evaluation data refers to data used to evaluate the user's service quality, for example, if the service is a voice service, the evaluation data may be the MOS score of a certain voice service of the user, voice fluency, etc.; the service description information refers to information used to describe the user data flow corresponding to the service, such as the total data volume and delay of the user data flow.

[0261] The third service experience data obtained by the data analysis function network element from the service server of the service can be normalized data, which can ensure the security of user information. The normalization processing here refers to the operation of mapping the physical value of the parameter to a fixed value space, such as using the maximum and minimum value normalization method, the Z-Score normalization method, etc. to map the physical value of each feature to a fixed value space.

[0262] Specifically, during the operation of the service, the service server of the service can obtain the service experience data of the user level, that is, the third service experience data, by its own measurement and calculation methods, and multiple third service experience data form a third service experience data set. The service server sends the third service experience data set to the network data analysis device. Exemplarily, the service server of the service can actively send the third service experience data set to the data analysis function network element; or, the data analysis function network element sends a request message to the server of the service, and the request message is used to request to obtain the third service experience data set, so that when the service server receives the request message, the third service experience data set can be sent to the data analysis function network element.

[0263] It should be noted that the third service experience data here and the second service experience data below are to distinguish the service experience data in terms of timing, and the timing corresponding to the third service experience data here is earlier than the timing corresponding to the second service experience data below. The specific meaning of the third service experience data here is similar to the meaning of the third service experience data described in the above step S201, and will not be repeated here.

[0264] S502: The data analysis function network element obtains a third network data set of the network corresponding to the third service experience data set.

[0265] Each third network data in the third network data set may include at least one of the following information: identification information of the network, fourth time information, fourth location information, network device information, network interface information, and end-to-end performance information of the network. The first network data here differs from the second network data below only in the timing sequence, and the specific meaning of the third network data is similar to the meaning of the third network data described in the above step S203, which will not be repeated here.

[0266] Specifically, when the data analysis function network element is a network data analysis device, the network data analysis device can directly obtain the third network data set of the service flow level from the corresponding network network element; the network data analysis device can also obtain the third network data set from a network management device or a network storage device.

[0267] It should be noted that the specific process of the data analysis function network element obtaining the third network data set can be found in the relevant description in the above step S203, and the embodiment of the present application will not be repeated here.

[0268] S503: The data analysis function network element determines second service experience data according to the third service experience data set and the third network data set.

[0269] Specifically, the data analysis function network element determines the second service experience data set, which may include: acquiring fourth network data at a flow level; and determining the second service experience data according to the third service experience data set and the third network data set, as well as the fourth network data.

[0270] The data analysis function network element may also obtain second service quality requirement information of the service, where the second service quality requirement information refers to the service quality requirement of the user level of the service (eg, the MOS score requirement for a single-user voice service is greater than 3).

[0271] Furthermore, the data analysis function network element determines a user-level service experience model for the service based on the third service experience data set, the third network data set and the second service quality requirement information, and the service experience model is used to characterize the relationship between the user-level service experience data of the service and the flow-level network data corresponding to the service; and determines the second service experience data based on the service experience model.

[0272] It should be noted that the specific meaning of the second service quality requirement information here is similar to the specific meaning of the second service quality requirement information in the above step S201, the specific meaning of the fourth network data is similar to the specific meaning of the fourth network data in the above step S201, and the specific process of the data analysis function network element determining the second service experience data is similar to the specific process of the network data analysis device in the above step S201 obtaining the second service experience data in the second way. Please refer to the relevant description in the above S201 for details, and the embodiments of the present application will not be repeated here.

[0273] In the service detection method provided in the embodiment of the present application, the data analysis function network element obtains a first service experience data set from the service server of the service, and obtains a first network data set of the flow level of the service corresponding to the first service experience data set, and determines a user-level service experience model of the service according to the first service experience data set and the first network data set, thereby determining the second service experience data according to the service experience model. Since the second experience data is determined according to the service experience model instead of being directly obtained from the service server of the service, this can avoid tenants sending false user-level experience data in order to save costs and obtain better service quality, thereby ensuring fairness between operators and tenants.

[0274] It can be understood by those skilled in the art that the above method embodiments are described in a progressive manner. To avoid repetition, the relevant explanations and descriptions of the same thing in different embodiments can refer to and be referenced to the relevant descriptions in the above embodiments. For example, Figure 3-Figure 5 For explanations and descriptions of relevant technical terms in Figure 2 Description of relevant technical terms in the embodiments of the present invention.

[0275] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the interaction between various network elements. It can be understood that in order to realize the above functions, various network elements, such as data analysis function network elements (for example, network data analysis equipment and network management equipment), etc., include hardware structures and / or software modules corresponding to the execution of various functions. Those skilled in the art should easily realize that, in combination with the network elements and algorithm steps of each example described in the embodiments disclosed in this document, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0276] The embodiments of the present application can divide the data analysis function network elements (for example, network data analysis equipment and network management equipment) into functional modules according to the above method examples. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical functional division. There may be other division methods in actual implementation.

[0277] In the case of dividing each functional module into corresponding functional modules, Figure 6 A possible structural diagram of the network data analysis device involved in the above embodiment is shown. The network data analysis device includes: an acquisition unit 601, a processing unit 602 and a sending unit 603.

[0278] Among them, Figure 2 In the method embodiment shown, the acquisition unit 601, or the acquisition unit 601 and the processing unit 602 are used to support the network data analysis device to perform Figure 2 S201 and S202 in the processing unit 602 is used to support the network data analysis device to perform Figure 2S203 in; the sending unit 603 is used to support the network data analysis device to execute Figure 2 S204 in the above Figure 2 All relevant contents of each step involved in the illustrated method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0279] exist Figure 3 In the method embodiment shown, the acquisition unit 601, or the acquisition unit 601 and the processing unit 602 are used to support the network data analysis device to perform Figure 3 S301 in; the sending unit 603 is used to support the network data analysis device to execute Figure 3 S302 in the above Figure 3 All relevant contents of each step involved in the illustrated method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0280] exist Figure 5 In the method embodiment shown, the acquisition unit 601 is used to support the network data analysis device to perform Figure 5 S501 and S502 in the processing unit 602 is used to support the network data analysis device to perform Figure 5 Optionally, the sending unit 603 may be used to support the network data analysis device to send a request message for requesting a third service experience data set to the service server. Figure 5 All relevant contents of each step involved in the illustrated method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0281] In hardware implementation, the processing unit 602 may be a processor, the acquiring unit 601 may be a receiver, the sending unit 603 may be a transmitter, and the receivers and receivers may constitute a transceiver or a communication interface.

[0282] Figure 7 , which is a possible logical structure diagram of the network data analysis device involved in the above-mentioned embodiments provided in the embodiments of the present application. The network data analysis device includes: a processor 702, a communication interface 703, a memory 701 and a bus 704. The processor 702, the communication interface 703 and the memory 701 are interconnected via the bus 704. In the embodiments of the present application, the processor 702 is used to control and manage the actions of the network data analysis device. For example, the processor 702 can be used to support the network data analysis device to execute Figure 2 One or more steps of S201-S203, Figure 3 S301 or Figure 5S503 in the embodiment, and / or other processes for the technology described herein. The communication interface 703 is used to support the network data analysis device to communicate. The memory 701 is used to store program codes and data of the network data analysis device.

[0283] Among them, the processor 702 can be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the contents disclosed in this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, and so on. The bus 704 can be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 7 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0284] In the case of dividing each functional module into corresponding functional modules, Figure 8 A possible structural diagram of the network management device involved in the above embodiment is shown. The network management device includes: an acquisition unit 801, a processing unit 802 and a sending unit 803.

[0285] Among them, Figure 2 In the method embodiment shown, the acquisition unit 801 is used to support the network management device to receive Figure 2 The processing unit 802 is used to support the network management device to execute the second network data set sent in S204; Figure 2 Optionally, the sending unit 803 is used to support the step of the network management device sending the first network data set to the network data analysis device. Figure 2 All relevant contents of each step involved in the illustrated method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0286] exist Figure 3 In the method embodiment shown, the acquisition unit 801 is used to support the network management device to receive Figure 3 The processing unit 802 is used to support the network management device to execute the first service experience data set of the service sent in S302 and S303; Figure 3Optionally, the sending unit 803 is used to support the step of the network management device sending the first network data set to the network data analysis device. Figure 3 All relevant contents of each step involved in the illustrated method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0287] exist Figure 4 In the method embodiment shown, the acquisition unit 801, or the acquisition unit and the processing unit 802 are used to support the network management device to execute Figure 4 In S401, the acquisition unit 801 is also used to support the network management device to execute Figure 4 S402 in; processing unit 802 is used to support the network management device to execute Figure 4 S403 in the above Figure 4 All relevant contents of each step involved in the illustrated method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0288] exist Figure 5 In the method embodiment shown, the acquisition unit 801 is used to support the network management device to execute Figure 5 S501 and S502 in the processing unit 802 is used to support the network management device to execute Figure 5 Optionally, the sending unit 803 may be used to support the network management device to send a request message for requesting a third service experience data set to the service server. Figure 5 All relevant contents of each step involved in the illustrated method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0289] In hardware implementation, the processing unit 802 may be a processor, the acquiring unit 801 may be a receiver, the sending unit 803 may be a transmitter, and the receivers and receivers may constitute a transceiver or a communication interface.

[0290] Fig. 9 , which is a possible logical structure diagram of the network management device involved in the above-mentioned embodiments provided by the embodiments of the present application. The network management device includes: a processor 902, a communication interface 903, a memory 901 and a bus 904. The processor 902, the communication interface 903 and the memory 901 are interconnected via a bus 614. In the embodiments of the present application, the processor 902 is used to control and manage the actions of the network management device. For example, the processor 902 can be used to support the network management device to execute Figure 2 S205 in or Figure 3 S304 in Figure 4One or more steps of S401 and S403 in the embodiment of the present invention, and / or other processes of the technology described herein. The communication interface 903 is used to support the network management device to communicate. The memory 901 is used to store program codes and data of the network management device.

[0291] Among them, the processor 902 can be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a field programmable gate array or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the contents disclosed in this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, and so on. The bus 904 can be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig. 9 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0292] The embodiment of the present application also provides a chip system applied to a data analysis function network element, the chip system includes a processor, a memory, a communication interface and a bus, and the processor, the memory and the communication interface are connected through the bus. Among them, when the chip system is built into a network data analysis device, the chip system is used to support the network data analysis device to perform one or more steps of the network data analysis device in the above method embodiment; when the chip system is built into a network management device, the chip system is used to support the network management device to perform one or more steps of the network management device in the above method embodiment.

[0293] The embodiment of the present application also provides a communication system, which includes a data analysis function network element and a service server, wherein the data analysis function network element can be a network data analysis device or a network management device. Figure 6 or Figure 7 The network data analysis device provided is used to execute the steps of the network data analysis device in the above method embodiment; and / or the network management device is Figure 8 or Fig. 9 The provided network management device is used to execute the steps of the network management device in the above method embodiment.

[0294] In the method provided in the embodiment of the present application, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in accordance with the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a network device or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, an SSD), etc.

[0295] Based on this understanding, an embodiment of the present application also provides a computer-readable storage medium, which stores instructions. When the computer-readable storage medium is run on a computer, it enables the computer to execute one or more steps of the data analysis function network element in the above method embodiment.

[0296] The embodiment of the present application also provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is executed on a computer, the computer executes one or more steps of the network management device in the above method embodiment.

[0297] The embodiment of the present application also provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute one or more steps of the data analysis function network element in the above method embodiment.

[0298] The embodiment of the present application also provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute one or more steps of the network management device in the above method embodiment.

[0299] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0300] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0301] Finally, it should be noted that the above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0302] In all embodiments of the present application, the interaction between two device network elements, such as the operation of sending information / data, can be direct interaction or indirect interaction. In other words, the two device network elements can send information / data through or without an intermediate device network element, and the present application does not limit this.

[0303] The network management device in all embodiments of the present application refers to a network element with network deployment, analysis, maintenance, and adjustment functions. For example, the network management device may be an OAM, NSMF, MDASF (management data analytic service function) network element, etc.

[0304] In addition, the present application also provides the following embodiments. The network elements in the following embodiments may be the corresponding network elements in the above embodiments. For example, the network data analysis device may be the above network data analysis device, and the NSSF network element may be the above NSSF network element.

[0305] It should be noted that the present application does not limit the names of the information involved in the following embodiments, that is, the information with the same name in the following embodiments and the above embodiments may be the same information or different information, and is not limited here. The following embodiments and the above embodiments may be combined with each other or applied independently, and the same or similar concepts or processes may not be described in detail in some of the following embodiments.

[0306] It should be noted that for all embodiments in the present application, experience data may also be referred to as service quality data, for example, network experience data may also be referred to as network service quality data, and business experience data may be referred to as business service quality data.

[0307] Fig.10 A schematic diagram of a resource management method provided in this application embodiment, see Fig.10 , the method includes the following steps.

[0308] S1000, optionally, the first network element determines that the network cannot meet the network quality requirement or the network's satisfaction with the network quality requirement is lower than a preset value.

[0309] The first network element may be a network control network element of a control plane or a network control network element of a management plane, which is not limited in the present invention. For example, the first network element may be NSSF, PCF, NSMF or other network elements with network management, control and user access control functions.

[0310] Among them, in some possible designs, network quality is information that reflects the quality of network granularity experience. In this case, the network quality requirements include the overall quality requirements of the network, for example, the number of registered users in the network (such as >1 million), the number of online users (such as >800,000), the network delay requirements (such as less than 2ms), the network load information requirements, etc.

[0311] In some other possible designs, network quality is information reflecting the quality of the service granularity experience in the network. In this case, the network quality requirements include the service quality requirements corresponding to at least one service in the network, for example, the number of users of service A in the network (e.g., >500,000), the average opinion score requirement of service A (e.g., MOS>3), and the ratio of users of service A with an average opinion score greater than 3 to the total number of users of service A (e.g., >95%).

[0312] The network quality requirements in the first network element can be directly obtained from the network tenant (such as the network slice tenant) or the service server; or, the network quality requirements in the first network element may be obtained from the network management device (such as OAM) of the network itself; or, the network quality requirements in the first network element may be obtained from the network data analysis device (such as NWADF); or, the network quality requirements in the first network element may be obtained from the network policy control device (such as PCF); or, the network quality requirements in the first network element are fixedly configured therein through the network configuration process.

[0313] The specific method for the first network element to determine whether the network meets the network quality requirement may include but is not limited to the following methods:

[0314] 1) The first network element receives first network experience data from a network data analysis device;

[0315] The first network experience data refers to data that can reflect the quality of network service, so it can also be called first network service quality data.

[0316] In some possible designs, the first network experience data includes network-granular experience data, that is, the experience data is data describing the overall network experience, such as the total number of registered users or online users in the network, network latency, network load information, etc.

[0317] In some other possible designs, the first network experience data includes experience data at a service granularity, that is, the experience data is data describing the service experience situation in the network, such as the total number of users of service A in the network, the average opinion score of service A, the proportion of users with an average opinion score of service A greater than 3 to the total number of users of service A, etc. Among them, the specific content and meaning of the experience data at a service granularity and the method for the network data analysis device to obtain the service experience data are consistent with the first service experience data in steps S201 and S301, and the details can be referred to the description in the above step S201.

[0318] 2) The first network element determines whether the network meets the network quality requirement according to the first network experience data.

[0319] The first network element compares the first network experience data with the network quality requirements stored therein to determine whether the network meets the network quality requirements. Specifically, when the experience data at the network granularity contained in the first network experience data cannot meet the network quality requirements at the network granularity, such as when the first network experience data shows that the number of online users in the network is less than 1 million; or when the experience data at the service granularity contained in the first network experience data cannot meet the network quality requirements at the service granularity, such as when the first network experience data shows that the average opinion score of service A in the network is less than 3 points, the first network element determines that the network cannot meet the network quality requirements.

[0320] Optionally, when the first network experience data and the network quality requirement are different data types, the first network element converts the first network experience data into the same data type as the network quality requirement data, and then performs the comparison. For example, the first network experience data includes three types of delay information: core network delay, access network delay, and delay on the N6 interface, while the data type in the network quality requirement only includes network delay. The first network element converts the data types of the above three types of delay information into the data types in the network quality requirement, that is, the first network element converts the three types of delay information into a comprehensive delay, and then compares it with the network quality requirement data.

[0321] How the first network element determines that the network's satisfaction with the network quality requirement is lower than a preset value, the specific method may include but is not limited to the following methods:

[0322] 1) The first network element receives first network experience data from a network data analysis device;

[0323] For example, for the description of the first network experience data, reference may be made to step 1) in the method for how the first network element determines whether the network meets the network quality requirement, which will not be described in detail here.

[0324] 2) The first network element determines, based on the first network experience data, that the network's satisfaction with the network quality requirement is lower than a preset value.

[0325] A comparison value of the network quality requirement is preset in the first network element, and the comparison value may be a positive comparison value or a negative comparison value of the actual network quality requirement. In other words, the network quality requirement displayed by the comparison value may be higher than the actual network quality requirement or may be lower than the actual network quality requirement. For example, the preset comparison value may be 120%*actual network quality requirement or 80%*actual network quality requirement.

[0326] The first network element compares the first network experience data with the preset comparison value of the network quality requirement, so as to determine whether the network meets the network quality requirement less than the preset value. Specifically, when the experience data of the network granularity contained in the first network experience data cannot meet the preset comparison value corresponding to the network granularity quality requirement, such as if the network tenant requires that the maximum number of online users in the network can reach 1 million, and the preset comparison value in the first network element is 800,000, and the first network experience data shows that the maximum number of online users in the network is less than 800,000; or, when the experience data of the service granularity contained in the first network experience data cannot meet the preset comparison value corresponding to the network quality requirement of the service granularity, such as if the network tenant requires that the average opinion score of service A in the network is 3 points, and the preset comparison value in the first network element is 2.4 points, and the first network experience data shows that the average opinion score of service A in the network is less than 2.4 points, then the first network element determines that the network meets the network quality requirement less than the preset value.

[0327] It should be noted that the present application does not limit the method for obtaining or setting the preset comparison value of the network quality requirement in the first network element. For example, the preset comparison value may be sent to the first network element by a network tenant or a service server, or configured in the first network element by a network operator.

[0328] It should be noted that before the first network element determines, based on the first network experience data, that the network cannot meet the network quality requirement or that the network's satisfaction with the network is lower than a preset value, the method may further include the following steps;

[0329] The first network element performs user access control on the network, that is, controls or adjusts the number of users accessing the network. For example, the first network element controls or adjusts the number of registered users and / or online users in the network.

[0330] Specifically, in a possible design, the first network element controls or adjusts the number of access users in the network based on historical network quality data, wherein the historical network quality data refers to the network quality data generated by the network before the control or adjustment action, which can be obtained from a network data analysis device. The meaning, content and acquisition method of the historical network quality data are similar to those of the first network experience data described above, except that there may be a sequential relationship in time. The historical network quality data includes user number information, and the historical user number information includes the number of registered users and / or the number of online users in the network.

[0331] Among them, the first network element controls the number of access users in the network according to historical network quality data, which may refer to setting the number of access users in the network according to the number of registered users or online users contained in the historical network quality data; the first network element adjusts the number of access users in the network according to historical network quality data, which refers to the first network element increasing or decreasing the number of registered users or online users in the network according to the historical network quality data.

[0332] In another possible design, the first network element controls or adjusts the number of access users in the network based on user number information sent by the network management device, where the user number information sent by the network management device includes the number of registered users and / or the number of online users in the network.

[0333] It should be noted that step S1000 is an optional step. In some possible designs, subsequent steps such as S1001 are based on step S1000, that is, subsequent steps such as S1001 are executed only when step S1000 occurs; while in other possible designs, subsequent step S1001 is not dependent on step S1000, that is, step S1001 can be executed regardless of whether step S1000 occurs.

[0334] S1001, a first network element sends first indication information to a network management device, where the first indication information is used to indicate whether the network meets network quality requirements. Correspondingly, the network management network element receives the first indication information sent by the NSSF.

[0335] In the embodiment of the present application, there is no limitation on how the first indication information indicates the network's satisfaction with the network quality requirements, as long as the first indication information can reflect the network's satisfaction with the network quality requirements. In some possible designs, the first indication information may only indicate whether the network meets the network quality requirements. For example, the first indication information may be a binary value of 0 or 1, where 0 indicates that the network does not meet the network quality requirements; 1 indicates that the network meets the network quality requirements; in other possible designs, the first indication information may also indicate the degree of satisfaction of the network with the network quality requirements, for example, the first indication information may be a percentage value (80% or 120%), where the percentage value is used to indicate the percentage value of the network meeting the network quality requirements; in other possible designs, the first indication information may also be the first network experience data itself received by the first network element from the network data analysis device, for example, the first indication information includes the number of online users of network slice 1, the average opinion score of service A, the proportion of users with an average opinion score of service A greater than 3 points and less than 4 points to the total number of users of service A, the service delay of service B, etc.

[0336] In some possible designs, if step S1000 occurs, the first indication information sent by the first network element to the network management network element in step S1001 is used to indicate that the network does not meet the network quality requirements (such as 0) or the specific degree of satisfaction of the network for the network quality requirements (such as 80%), or the first indication information is the first network experience data itself.

[0337] S1002, optionally, the network management device sends a third request message to the network data analysis device, where the third request message is used to request the second network experience data. Correspondingly, the network device analysis device receives the third request message sent by the network management network element.

[0338] It should be noted that the present application does not limit the time sequence of step S1002 and step S1001. In other words, step S1002 may occur before step S1001, that is, it is independent of step S1001; or, step S1002 may also occur after step S1001, that is, step S1002 may be executed by the network management device according to the first indication information sent by the first network element.

[0339] The nature and meaning of the second network data are similar to the meaning and nature of the first network experience data in step S1001. The first and second are used to distinguish network experience data obtained by different devices from the network data analysis device, and the specific content and values ​​of the two can be different or the same, and are not limited.

[0340] In some possible designs, the second network experience data includes network-granular experience data, that is, the experience data is data that describes the overall network experience, such as the total number of registered users or online users in the network, network latency, network load information, etc.

[0341] In some other possible designs, the second network experience data includes experience data at a service granularity, that is, the experience data is data describing the service experience situation in the network, such as the total number of users of service A in the network, the average opinion score of service A, the proportion of users with an average opinion score of service A greater than 3 to the total number of users of service A, etc. Among them, the specific content and meaning of the experience data at a service granularity and the method for the network data analysis device to obtain the service experience data are consistent with the first service experience data in steps S201 and S301, and the details can be referred to the description in the above step S201.

[0342] In some possible designs, the third request information may include network identification information of the network, and the third request information is used to request the second network experience data corresponding to the network identification information, wherein the network identification information is used to uniquely identify a network. For example, when the network is a network slice, the third request information includes identification information of the network slice, such as NSSAI, S-NSSAI, NSI, and NSSI.

[0343] In some possible designs, the third request information may also include service identification information of one or more services in the network, and the third request information is used to request the second network experience data corresponding to the one or more service identification information, wherein the service identification information is used to uniquely identify the service. For example, the identification information of the service may be service type information or a global identification of the service.

[0344] In some possible designs, the third request information may also include time information. In other words, the third request information is used to obtain the second network experience data corresponding to the time information. The specific form of the time information is not limited in the embodiment of the present application. For example, the time information may be an absolute time, for example, from 00:00 on January 1, 2017 to 24:00 on January 30, 2017; or it may be relative time information, for example, from one month before the time when the third request information is sent to the time when the third request information is sent. The granularity of the time information may be in hours, minutes or days, which is not limited in the embodiment of the present application. In addition, the time information may also include time interval information for indicating the reporting of the second network experience data, such as requesting the network data analysis device to send the second network experience data to the network management device every five minutes.

[0345] Optionally, in some embodiments, the third request information may also include location information. In other words, the third request information is used to request the second network experience data corresponding to the location information. In the embodiments of the present application, the specific form of the location information is not limited. The location information may be location information defined in a 3GPP communication network (hereinafter referred to as communication network location information), such as a service cell A or a registration area B. The location information may also be location information defined in a non-3GPP communication network, such as a specific geographic location range (for example, longitude and latitude or global positioning system (GPS) location information, hereinafter referred to as geographic location information).

[0346] Optionally, in some embodiments, the third request information may also include service description information of at least one service in the network. In other words, the third request information is used to request the second network experience data corresponding to the service description information of the at least one service. The service description information may include one or more of the following information: service identifier to which the service flow belongs, IP filtering information, media bandwidth requirements, traffic routing information, jitter buffer requirements, media coding type requirements, coding rate requirements of media coding type requirements, TCP congestion window requirements, TCP receiving window requirements, buffer requirements, and value requirements of at least one data type.

[0347] Optionally, in some embodiments, the third request information may also include data network name (DNN) information corresponding to the network. In other words, the third request information is used to request the second network experience data corresponding to the DNN.

[0348] It can be understood that the time information, location information, network identification information, service identification information, etc. in the third request information are used to indicate the filtering information or reporting conditions for sending the second network experience data to the network data analysis device.

[0349] Specifically, the third request information can be a subscription request information, and the network data analysis device sends the second network experience data to the network management device after meeting the reporting conditions contained in the subscription request information; or, the third request information can also be a real-time request information, and the network data analysis device immediately sends the second network experience data to the network management device.

[0350] S1003, optionally, the network data analysis device sends the second network experience data to the network management device. Correspondingly, the network management device receives the second network experience data sent by the network data analysis device.

[0351] In some possible designs, the network data analysis device sends the second network experience data to the network management device according to the third request information in step S1002. In other words, the network data analysis device sends the second network experience data to the network management device according to the filtering information or reporting conditions contained in the third request information. For example, when the third request information contains time information, the time information is used to indicate that the third request information is used to request the second network experience data corresponding to the time information, then the experience data of the network sent by the network data analysis device to the network management device is the second network experience data corresponding to the time information. The application of other filtering conditions or reporting conditions is similar and will not be repeated here.

[0352] In some other possible designs, the network data analysis device may send the second network experience data to the network management device without relying on the third request information in step S1002. In other words, the network data analysis device may actively send the second network experience data to the network management device without receiving the third request information sent by the network data analysis device.

[0353] In some possible designs, the network data analysis device may also send network identification information of the network to the network management device, where the network identification information corresponds to the second network experience data, wherein the network identification information is used to uniquely identify a network. For example, when the network is a network slice, the network data analysis device may also send identification information of the network slice to the network management device, such as NSSAI, S-NSSAI, NSI, NSSI, etc.

[0354] In some possible designs, the network data analysis device may also send service identification information of one or more services to the network management device, each service identification information corresponds to the service experience data of each service in the second network experience data, wherein each service identification information is used to uniquely identify the service. The content and meaning of the service experience data of each service may be specifically referred to in Figure 2 and Figure 3 First service experience data in the embodiment.

[0355] In some possible designs, the network data analysis device may also send time information to the network management device. For example, the description of the time information may refer to the description of the time information in step S1002, which will not be repeated here.

[0356] In some possible designs, the network data analysis device may also send location information to the network management device. For example, the description of the location information may refer to the description of the location information in step S1002, which will not be repeated here.

[0357] In some possible designs, the network data analysis device may also send DNN information to the network management device. For example, the description of the location information may refer to the description of the DNN information in step S1002, which will not be repeated here.

[0358] It should be noted that the above-mentioned network identification information, service identification information, time information, location information, DNN information, etc. can be sent to the network management device together with the second network experience data as filtering information or reporting conditions, but this application does not limit whether these conditions are included in the second network experience data. In other words, the above-mentioned filtering information or reporting conditions can be sent to the network management device as part of the second network experience data, or can be sent to the network management device separately without being the content of the second network experience data.

[0359] S1004: The network management device adjusts the network resources of the network according to the first indication information and / or the second network experience data, so that the network can meet the network quality requirement.

[0360] Among them, in some possible designs, the network being able to meet the quality requirements of the network means that the network is able to meet the quality requirements of the network granularity.

[0361] In some other possible designs, the network can meet the quality requirements of the network means that the services in the network can meet the quality requirements of the service granularity, that is, at least one service in the network can meet the corresponding service quality requirements. Figure 3 The network management device described in the embodiment adjusts the network so that the service in the network meets the first service quality requirement of the service. Figure 3 The embodiments are not described in detail here.

[0362] In some possible designs, the network management device may decide whether to adjust network element resources based on the first indication information sent by the first network element; in other possible designs, after the network management device receives the first indication information sent by the first network element, it also needs to decide whether to adjust network resources based on the second network experience data sent by the network data analysis device.

[0363] Specifically, the network management device adjusts the network resources of the network according to the first indication information and / or the second network experience data, including:

[0364] The network management device determines that the network cannot meet the network quality requirement according to the first indication information and / or the second network experience data; or,

[0365] The network management device determines, according to the first indication information and / or the second network experience data, that the degree to which the network satisfies the network quality requirement is lower than a preset value;

[0366] The network management device adjusts the network resources of the network.

[0367] The method for the network management device to adjust the network resources of the network includes:

[0368] The network management device sends network resource adjustment notification information to the access network device or the core network device, and the corresponding access network device or the core network device adjusts the corresponding network resources according to the resource adjustment notification information. Among them, the access network device includes the access network management device, and the core network device includes the core network management device.

[0369] In one possible design, the network resource adjustment notification information includes resource adjustment policy information. In other words, in this design scenario, the network management element first formulates a resource adjustment policy, and then informs the access network device or the core network device to adjust the network according to the resource adjustment policy. For example, the resource adjustment policy information can be similar to Figure 2 Or the second network data set in the third embodiment, that is, when the network is in any state of the second network data, the network can meet the network quality requirements, that is, the network can meet the service quality requirements corresponding to at least one service in the network. Among them, how the network management device generates resource adjustment policy information similar to the second network data set, see Figure 3 Embodiment: For this design scenario, the following describes how the network management element generates resource adjustment policy information similar to the second network data set:

[0370] Specifically, the network management device establishes a network experience model according to the network quality requirements, the second network experience data and the first network data of the network, that is, establishes a relationship between the second network experience data and the corresponding first network data, thereby determining each second network data according to the relationship, and the determined multiple second network data form a second network data set. For example, the network management device performs model training according to the network quality requirements, a large amount of second network experience data and a large amount of first network data, thereby obtaining a network experience model, and then determines the second network data set according to the network experience model. Among them, the second network experience data is the network experience data generated at the historical time received by the network management device from the network data analysis device, and the first network data is the network data generated by the network at the historical time corresponding to the second network experience data. The second network data is the network data calculated or derived by the network management device based on the first two, and the second network data will be used as a strategy or basis for adjusting or setting the network.

[0371] Exemplarily, first, the network management device may obtain a relationship model between the second network experience data and the first network data based on a linear regression method. For example, the network experience model is composed of the following multiple sub-service experience models:

[0372] g i (y) = m i0 y0+m i1 y1+m i2 y2+m i3 y3+···+m iD y D (2)

[0373] In formula (2), g i (y) is the first service experience data of the i-th service in the network, for example, the proportion of users with a MOS greater than 3 for voice services, wherein the second network experience data includes the first service experience data of all services in the network; Y = (y1, y2, y3, ..., y D ) The feature vector is the first network data corresponding to the first service experience data of the i-th service, that is, the first parameter of the network performance. For example, y1 represents the uplink packet loss rate of NG RAN, y2 represents the average air interface delay, y3 represents the average number of registered users of AMF, ..., y D Indicates the uplink / downlink utilization rate of the N6 interface, y0 is a constant 1; M = (m i0 ,m i1 , m i2 , m i3 , ..., m iD ) is the parameter vector, also called the weight vector identifier, m ik Identify the weight of the kth parameter in the first network data affecting the first service experience data set of service i.

[0374] The above-mentioned linear regression refers to an exemplary data analysis algorithm, and the network data analysis device can obtain the network experience model based on other algorithms, and the present invention does not make specific limitations.

[0375] Thirdly, the network management device determines the value of the feature vector corresponding to the network quality requirement according to the network experience model, that is, obtains the second network data set. For example, given the model of g(y), according to the value requirements of g(y) (composed of sub-value requirements corresponding to multiple services in the network): for example, the number of online users of the network is greater than 1 million, the number of users with an average opinion score of service A greater than 3 accounts for more than 80% of the total number of users of service A, the number of users with an average opinion score of service A greater than 3 and the number of users with an average opinion score of service B greater than 4 accounts for more than 90% of the total number of users of service B..., obtain Y corresponding to these requirements = (y1, y2, y3, ..., y D ) value combination. For another example, given the model of g(y), according to the value requirements of g(y), obtain Y=(y1, y2, y3, ..., y D ) value combination.

[0376] Among them, the above-mentioned determination of the value of the feature vector corresponding to a certain network quality requirement according to the network experience model belongs to a multiple criteria decision making (MCDM) problem, and the network management device can obtain the value of the feature vector based on the existing MCDM method, that is, obtain the second network data. Generally speaking, a combination of multiple sets of feature vectors that meet the network quality requirements can be obtained, that is, a combination of multiple sets of second network data can be obtained.

[0377] In another possible design, the network resource adjustment notification information may not include resource adjustment policy information. In other words, in this design scenario, the access network device or the core network device itself can decide how to adjust the network resources, and the network management network element does not need to decide in advance how to adjust the network resources. In other words, the network management network element does not need to know the second network data that meets the network quality requirements in advance. However, after adjusting the network through this design process, the network can eventually reach a state that meets the network quality requirements, that is, the network is in a state similar to Figure 2 Or the state of the second network data in embodiment 3.

[0378] The process of this embodiment uses the first indication information sent by the first network element as a trigger condition to trigger the network management network element to adjust the network resources. In other words, this embodiment provides a method for the control plane network element to trigger the management plane network element to perform network adjustment, that is, first monitor the network and adjust the number of network users on the control plane, and then adjust the network resources through the management plane. The method of how the management plane implements network resource adjustment is similar to Figure 3 The embodiment method described is different only in that Figure 3 The embodiments are described with the granularity of different services in the network, while this embodiment is described with the granularity of the network (such as network slicing).

[0379] Fig.11 A schematic diagram of a resource management method provided in this application embodiment, see Fig.11 , the method includes the following steps.

[0380] S1101. A network management device sends second indication information to a network data analysis device, where the second indication information is used to indicate to the network data analysis device that the network is a newly built network or that the network is in a testing phase; or, the second indication information is used to indicate to the network data analysis device fifth time information for reporting network experience data. Accordingly, the network data analysis device receives the second indication information sent by the network management device.

[0381] The network management device can learn whether the network is a newly built network or is in a testing phase through its own configuration information or from network tenants or service servers.

[0382] Optionally, when the network management device determines that it is a newly built network or that the network is in a testing phase, the network management device sets the fifth time information according to the network status and includes the fifth time information in the second indication information. The fifth time information may specifically be a time interval information and / or a time range information. For example, the time interval is 5 minutes and the time range is from January 1 to 31, 2018, that is, the second indication information indicates to report the network experience data for January 2018, and the reporting time interval is once every 5 minutes. Generally speaking, in order to enable the network management device to obtain network experience data in a timely manner, so as to monitor and adjust the network in the testing phase in a relatively real time manner, the fifth time information is generally set to a shorter time interval or a smaller time range.

[0383] The meaning and content of the network experience data involved in this embodiment are the same as Fig.10 The second network experience data in the embodiment will not be described in detail here.

[0384] The method for the network management device to send the second indication information to the network data analysis device includes: the network management device can directly or indirectly send the second indication information to the network data analysis device. In other words, the network management device can directly send the second indication information to the network data analysis device, or send the second indication information to the network data analysis device through an intermediate device.

[0385] In some possible designs, the second indication information can be used to indicate that the network is a newly built network or that the network is in a testing phase; in some possible designs, the second indication information can be the fifth time information that can directly reflect the reported network experience data; in other possible designs, the second indication information can have both of the above two indication functions, that is, the second indication information is used to indicate that the network is a newly built network or that the network is in a testing phase, and the second indication information is used to indicate the fifth time information of the reported network experience data. It should be noted that the second indication information in this step is actually used to help the network data analysis device determine the filtering information or reporting conditions for the subsequent reporting of the network experience data, for example, to determine the time information, location information, network identification information, service identification information, etc. of the reported network experience data.

[0386] The following takes the example of determining the time information filtering condition based on the second indication information to illustrate how the second indication information helps the network data analysis device determine the filtering condition for reporting network experience data. For example, the network data analysis device learns from the second indication information that a certain network slice is in the testing phase, and the network data analysis device decides on its own to shorten the network experience data reporting time interval, such as shortening the reporting time interval from the normal once a month to once every five days. This helps the network management device obtain the latest network experience data, so as to monitor and adjust the resources of the network slice in a timely manner according to the network experience data, thereby better ensuring the service quality of the network slice. For more information on how the network management device specifically monitors and adjusts the resources of the network slice based on the network experience data, see Figure 3 Example or Fig.10 The embodiments are not described in detail here.

[0387] The above is only a simple example to illustrate the effect and function of the second indication information. The specific operation method after the network data analysis device obtains the second indication information is shown in the following operation steps S1102 and S1103.

[0388] In some possible designs, the second indication information may be included in a subscription request message and sent to a network data analysis device, and the subscription request message is used to request the network data analysis device to subscribe to the network experience data. Optionally, in addition to the second indication information, the subscription request message may also include a subscription reporting condition, and the subscription reporting condition is used to indicate to the network data analysis device the triggering timing or specific filtering information of the network experience data reporting, such as reporting network experience data related to certain areas in the network, or reporting network experience data related to certain services. Among them, if the second indication information includes the fifth time information, it can be considered that the fifth time information also belongs to a subscription reporting condition.

[0389] S1102, a network data analysis device obtains network experience data.

[0390] Specifically, the network experience data in this step is equivalent to Fig.10 The second network experience data in the embodiment, how the network data analysis device obtains the network experience data is shown in Fig.10 The method for the network data analysis device to obtain the second network experience data in the embodiment will not be described in detail here.

[0391] Optionally, based on the above-mentioned method for the network data analysis device to obtain network experience data, the network data analysis device may also obtain network experience data according to the second indication information. In other words, the network data analysis device needs to consider the second indication information when obtaining the network experience method. Specifically:

[0392] After learning from the second indication information that the network is a newly built network or is in a testing phase, or reporting the fifth time information of the network experience data, the network data analysis device determines the sixth time information, and the sixth time information is used to limit the time interval and / or time range for obtaining training data from other network elements; the network data analysis device obtains training data from other network elements according to the sixth time information to obtain network experience data.

[0393] It should be noted that the training data described in this step refers to prior or historical data used to train or calculate network experience data. For example, the training data may include at least one of the following types of data: historical experience data at the network granularity, historical experience data at the service granularity, historical experience data at the user granularity, network identification information, location information corresponding to the training data, time information corresponding to the training data, data network name information corresponding to the training data, etc. Among them, the historical experience data at the network granularity refers to historical data used to characterize the quality of the overall network experience, such as the historical number of online users or registered users of the network, historical network latency, etc.; the historical experience data at the service granularity refers to historical data used to characterize the quality of the service granularity experience, such as the historical average opinion score of service A, and the historical proportion of users whose service A is greater than the average opinion score; the historical experience data at the user granularity is used to characterize the quality of the service experience of a single user in the network, such as the average opinion score of service A of user 1, the service latency of service B of user 1, etc.

[0394] The network experience data in this step is equivalent to Fig.10 The second network experience data in the embodiment, how the network data analysis device obtains the network experience data according to the training data can also be specifically referred to in Fig.10 A method for a network data analysis device to obtain second network experience data in an embodiment.

[0395] In some possible designs, when the network data analysis device learns from the second indication information that the network is a newly built network or is in the testing phase, it can determine the sixth time information by itself. For example, for a sliced ​​network in the testing phase, the network data analysis device decides to obtain training data every 5 days to obtain network experience data. The network data analysis device can request the corresponding network element to report training data every 5 days, or the network data analysis device can request the corresponding network element to send training data every 5 days. This design does not limit the specific method of how to set the sixth time information and the specific value of the sixth time information.

[0396] In some other possible designs, the network data analysis device determines the sixth time information according to the fifth time information in the second indication information. The sixth time information may be the same as or different from the fifth time information, and this design does not limit it. For example, in some implementations, the network data analysis device sets the sixth time information to the same value as the fifth time information. For example, if the fifth time information requires the network data analysis device to report network experience data once every 5 days, the network data analysis device obtains training data from other network elements once every 5 days to obtain the network experience data to be reported; in some other possible implementations, the network data analysis device only sets the sixth time information according to the fifth time information, but the two are not the same. For example, if the fifth time information requires the network data analysis device to report network experience data once every 5 days, the network data analysis device obtains training data from other network elements once every 1 day to obtain the network experience data to be reported.

[0397] It should be noted that, in addition to the above-mentioned method in which the network data analysis device determines the sixth time information according to the second indication information and obtains the network experience data according to the sixth time information, there may be other methods in which the network data analysis device obtains the network experience data according to the second indication information:

[0398] In some possible designs, the network data analysis device determines the sixth location information according to the second indication information, and obtains the network experience data according to the sixth location information. The sixth location information includes one or more of the following location area information: the entire network, at least one registration area list, and at least one cell list. For example, the network experience data corresponding to all registration areas in the network is obtained according to the second indication information.

[0399] In some possible designs, the network data analysis device determines the sixth network identification information according to the second indication information, and obtains the network experience data according to the sixth network identification information. For example, the network experience data corresponding to the network slice 1 is obtained according to the second indication information.

[0400] In some possible designs, the network data analysis device determines the sixth service identification information according to the second indication information, and obtains network experience data according to the sixth service identification information. For example, the network experience data corresponding to the services identified by all service identifications in the network is obtained according to the second indication information.

[0401] In some possible designs, the network data analysis device determines the sixth data network name information according to the second indication information, and obtains the network experience data according to the sixth data network name information. For example, the network experience data corresponding to all DNNs in the network is obtained according to the second indication information.

[0402] It can be considered that one or more of the sixth time information, the sixth location information, the sixth network identification information, the sixth service identification information, and the sixth data network name information are used as filtering information for the network data analysis device to obtain training data. The network data analysis device determines the filtering information according to the second indication information, and obtains the training data according to the filtering information, thereby obtaining network experience data.

[0403] S1103: The network data analysis device sends the network experience data to the network management device according to the second indication information. Correspondingly, the network management device receives the network experience data sent by the network data analysis device.

[0404] Optionally, before sending the network experience data to the network management device, the network data analysis device also needs to determine seventh time information for reporting the network experience data according to the second indication information.

[0405] Specifically, in some possible designs, the second indication information is used to indicate that the network is a newly built network or that the network is in a testing phase. After the network data analysis device obtains the second indication information, it determines the seventh time information for subsequently reporting the network experience data to the network management device based on the second indication information. In some implementations, the seventh time information may be the time interval information for reporting the network experience data, for example, the network data analysis device reports the network experience data to the network management network element once every five minutes; in other designs, the seventh time information may be the time range information for reporting the network experience data, for example, the network data analysis device reports the network experience data within the past / future five days or reports the network experience data within January 1-5, 2018.

[0406] Specifically, when the network data analysis device learns through the second indication information that the network is a newly built network or that the network is in the testing phase, the network data analysis device can determine the seventh time information, and the network data analysis device subsequently reports the network experience data to the network management device according to the seventh time information. For example, the seventh time information may be set to a relatively short time interval or a relatively small time range, so that the frequency of the network data analysis device reporting the network experience data to the network management device is relatively high, which can ensure that the network management device can obtain the network experience data in a relatively real-time manner, so as to be used for subsequent network experience monitoring and network resource adjustment, thereby improving the accuracy of network adjustment and setting.

[0407] In some possible designs, the second indication information may be the fifth time information that can directly reflect the reported network experience data, wherein the fifth time information may specifically be a time interval information and / or time range information. After receiving the second indication information, the network data analysis device reports the network experience data to the network data analysis device according to the time interval information and / or time range information contained in the second indication information. Generally speaking, if the network is a newly built network or is in the testing phase, the fifth time information may be a relatively short time interval or a relatively small time range. For example, the network management device may directly instruct the network device analysis device to report the network experience data every five minutes and / or instruct the network device analysis device to report the network experience data within the past five days. In this way, the network data analysis device can report the network experience data to the network management device at a relatively high frequency, ensuring that the network management device can obtain the network experience data in a relatively real-time manner, so as to be used for subsequent network experience monitoring and network resource adjustment, thereby improving the accuracy of network adjustment and setting. The network data analysis device determines the seventh time information according to the fifth time information in the second indication information. The seventh time information may be the same as or different from the fifth time information, and this design is not limited.

[0408] It should be noted that the seventh time information may be the same as or different from the sixth time information in step S1102, and there is no limitation here.

[0409] It should be noted that, in addition to the above-mentioned network data analysis device determining the seventh time information for reporting the network experience data according to the second indication information and reporting the network experience data according to the seventh time information, there may be other methods for the network data analysis device to report the network experience data according to the second indication information:

[0410] For example, in some possible designs, the network data analysis device determines the seventh location information based on the second indication information, and reports the network experience data based on the seventh location information. In other words, the network data analysis device reports the network experience data corresponding to the seventh location information. Among them, the seventh location information includes one or more of the following location area information: the entire network, at least one registration area list, and at least one cell list. It should be noted that the seventh location information may be the same as or different from the sixth location information in step S1102, and there is no limitation here.

[0411] For another example, in some possible designs, the network data analysis device determines the seventh network identification information according to the second indication information, and reports the network experience data according to the seventh network identification information. In other words, the network data analysis device reports the network experience data corresponding to the seventh network identification information. For example, the network experience data corresponding to the network slice 1 is reported according to the second indication information. It should be noted that the seventh network identification information may be the same as or different from the sixth network identification information in step S1102, and this is not limited here.

[0412] For another example, in some possible designs, the network data analysis device determines the seventh service identification information based on the second indication information, and reports the network experience data based on the seventh service identification information. In other words, the network data analysis device reports the network experience data corresponding to the seventh service identification information. For example, the network experience data corresponding to the services identified by all service identifiers in the network are reported according to the second indication information. It should be noted that the Yth service identification information may be the same as or different from the sixth service identification information in step S1102, and this is not limited here.

[0413] In some possible designs, the network data analysis device determines the seventh data network name information according to the second indication information, and reports the network experience data according to the seventh data network name information. For example, the network experience data corresponding to all DNNs in the network is reported according to the second indication information. It should be noted that the seventh data network name information may be the same as or different from the sixth data network name information in step S1102, and this is not limited here.

[0414] It can be considered that the seventh time information, the seventh location information, the seventh network identification information, the seventh service identification information, and the seventh data network name information can be used as reporting filtering information for the network data analysis device to send network experience data to the network management device. The network data analysis device determines to report the filtering information based on the second indication information, and sends the network experience data based on the reported filtering information. Optionally, the network data analysis device can send these filtering information to the network management device while sending the network experience data to the network management device, but the present application does not limit whether these filtering information are part of the network experience data. In other words, these filtering information can be included inside or outside the network experience data.

[0415] How the network data analysis device sends network experience data to the network management device can also be combined with steps Fig.10 The method of how the network data analysis device sends the second network experience data to the network management device in the embodiment will not be described in detail here.

[0416] In addition to the methods described in the above steps, optionally, the embodiments of the present application may also include methods described in one or more of the following steps:

[0417] S1104. The network management network element adjusts the network resources of the network according to the network experience data sent by the network data analysis device so that the network can meet the network quality requirements.

[0418] This step method and Fig.10 The method for adjusting network resources according to the first network experience data by the network management device in the embodiment is similar, and specific reference may be made to Fig.10 The method described in the embodiment will not be repeated here.

[0419] To illustrate, this can also be similar to Fig.10 In the method of the embodiment, optionally, when the network management device adjusts the network resources according to the network experience data, it is also necessary to consider the first indication information obtained from the first network element. Fig.10 Example.

[0420] S1105. The network management device sends third indication information to the network data analysis device, where the third indication information is used to indicate to the network data analysis device that the network has entered a stable phase or that the network has completed a test phase; or, the third indication information is used to indicate to the network management device an eighth time information for reporting network experience data. Accordingly, the network data analysis device receives the third indication information sent by the network management device.

[0421] The network management device can learn, through its own configuration information or from network tenants or service servers, that the network has entered a stable phase or that the network has completed a testing phase.

[0422] Optionally, when the network management device determines that the network has entered a stable phase or that the network has completed a test phase, the network management device sets the eighth time information according to the network status, and includes the eighth time information in the third indication information. The eighth time information may specifically be a time interval information and / or time range information. For example, the time interval is one day, and the time range is from January 1, 2018 to March 31, 2018, that is, the third indication information indicates that the network experience data for the first quarter of 2018 is reported, and the reporting time interval is once a day. Generally speaking, the eighth time information may be set to a relatively long time interval or a relatively large time range, so that the network data analysis device reports the network experience data to the network management device at a relatively low frequency, which can avoid the network management device from frequently interacting with the network management device. The eighth time information may even be set to an infinite time interval or time range, so that the network data analysis device does not send network experience data to the network management device, thereby reducing the data throughput and network load of the network.

[0423] In some possible designs, the third indication information can be used to indicate that the network has entered a stable phase or that the network has completed a testing phase; in some possible designs, the third indication information can be the eighth time information that can directly reflect the reported network experience data; in other possible designs, the third indication information can have both of the above-mentioned two indication functions, that is, the third indication information is used to indicate that the network has entered a stable phase or that the network has completed a testing phase, and the third indication information is used to indicate the eighth time information for reporting network experience data.

[0424] It can be understood that when the network is in different stages, the network management device sets different time information for reporting network experience data, or the network management device instructs the network data analysis device to determine different reporting time information for network experience data. Then, when the state of the network changes, the time information for reporting the network experience data will also change accordingly.

[0425] S1106. The network data analysis device obtains network experience data according to the third indication information.

[0426] Specifically, after knowing according to the third indication information that the network has entered a stable phase or has completed a testing phase, or after reporting the eighth time information of the network experience data, the network data analysis device determines the ninth time information, and the ninth time information is used to redefine the time interval and / or time range for obtaining training data from other network elements; the network data analysis device obtains training data from other network elements according to the ninth time information to obtain network experience data.

[0427] In some possible designs, when the network data analysis device learns that the network has entered a stable phase or that the network has completed a test phase according to the third indication information, it can determine the ninth time information by itself. For example, for a sliced ​​network in a stable phase, the network data analysis device decides to obtain training data once a month to obtain network experience data, then the network data analysis device can request the corresponding network element to report training data once a month, or the network data analysis device requests the corresponding network element to send training data every month. This design does not limit the specific method of setting the ninth time information and the specific value of the ninth time information, but generally speaking, the ninth time information is larger than the time interval or time range represented by the sixth time information, so that the frequency of the network data analysis device reporting network experience data to the network management device is relatively low, which can avoid the network management device frequently obtaining training data or frequently interacting with the network management device. The ninth time information may even be set to an infinite time interval or time range, so that the network data analysis device does not need to obtain training data or interact with the network management device, thereby reducing the data throughput and network load of the network.

[0428] In some other possible designs, the network data analysis device determines the ninth time information according to the eighth time information in the third indication information. The ninth time information may be the same as or different from the eighth time information, and this design does not limit it. For example, in some implementations, the network data analysis device sets the ninth time information to the same value as the eighth time information. For example, if the eighth time information requires the network data analysis device to report network experience data once a month, the network data analysis device obtains training data from other network elements once a month to obtain the reported network experience data; in some other possible implementations, the network data analysis device only sets the ninth time information according to the eighth time information, but the two are not the same. For example, if the eighth time information requires the network data analysis device to report network experience data once a month, the network data analysis device obtains training data from other network elements once every 10 days to obtain the reported network experience data.

[0429] It should be noted that, in addition to the above-mentioned network data analysis device determining the ninth time information according to the third indication information and obtaining the network experience data according to the ninth time information, there may be other methods in which the network data analysis device obtains the network experience data according to the third indication information:

[0430] In some possible designs, the network data analysis device determines the ninth location information according to the third indication information, and obtains the network experience data according to the ninth location information. The ninth location information includes one or more of the following location area information: the entire network, at least one registration area list, and at least one cell list. For example, according to the third indication information, only the network experience data corresponding to some registration areas in the network is obtained.

[0431] In some possible designs, the network data analysis device determines the ninth network identification information according to the third indication information, and obtains the network experience data according to the ninth network identification information. For example, the network experience data corresponding to the network slice 1 is obtained according to the third indication information.

[0432] In some possible designs, the network data analysis device determines the ninth service identification information according to the third indication information, and obtains the network experience data according to the ninth service identification information. For example, the network experience data corresponding to the service identified by some service identifications in the network is obtained according to the third indication information.

[0433] In some possible designs, the network data analysis device determines the ninth data network name information according to the third indication information, and obtains the network experience data according to the ninth data network name information. For example, the network experience data corresponding to the partial DNN in the network is obtained according to the third indication information.

[0434] It can be considered that one or more of the ninth time information, the ninth location information, the ninth network identification information, the ninth service identification information, and the ninth data network name information are used as filtering information for the network data analysis device to obtain training data. The network data analysis device determines the filtering information according to the third indication information, and obtains the training data according to the filtering information, thereby obtaining network experience data.

[0435] To clarify, for details on how the network data analysis device obtains network experience data, please refer to the method for the network data analysis device to obtain network experience data in S1102, which will not be repeated here.

[0436] It can be understood that for different stages of the network, the network data analysis device determines different filtering information or policy information for obtaining training data, and obtains training data according to the corresponding filtering information or policy information to obtain network experience data according to the training data. In other words, when the state of the network changes, the network data analysis device uses different filtering information or policy information to obtain training data from other network elements.

[0437] S1107: The network data analysis device sends the network experience data to the network management device according to the third indication information. Accordingly, the network management device receives the network experience data sent by the network data analysis device.

[0438] Optionally, before sending the network experience data to the network management device, the network data analysis device also needs to re-determine the tenth time information for reporting the network experience data according to the third indication information.

[0439] Specifically, in some possible designs, the third indication information is used to indicate that the network has entered a stable phase or that the network has completed a test phase, and the network data analysis device determines the tenth time information for subsequently reporting the network experience data to the network management device based on the third indication information. In some implementations, the tenth time information may be the time interval information for reporting the network experience data, for example, the network data analysis device reports the network experience data to the network management network element once a day; in other designs, the tenth time information may be the time range information for reporting the network experience data, for example, the network data analysis device reports the network experience data within the past / future five days or reports the network experience data within January 1-5, 2018. It should be noted that the tenth time information for reporting the network experience data determined based on the third indication information is generally different from the seventh time information for reporting the network experience data determined based on the second indication information.

[0440] Specifically, when the network data analysis device learns through the third indication information that the network has entered a stable phase or that the network has completed a test phase, the network data analysis device may re-determine the reporting time information as the tenth time information, and the network data analysis device subsequently reports the network experience data to the network management device based on the tenth time information. For example, the tenth time information may be set to a relatively long time interval or a relatively large time range, so that the frequency of the network data analysis device reporting the network experience data to the network management device is relatively low, which can avoid the network management device from frequently interacting with the network management device. The tenth time information may even be set to an infinite time interval or time range, so that the network data analysis device does not have to interact with the network management device, thereby reducing the network's data throughput and network load. In other words, for networks in different stages, the network data analysis device determines different reporting time information for network experience data, and when the state of the network changes, the time information for reporting the network experience data will also change accordingly.

[0441] In some possible designs, the third indication information may be the eighth time information that can directly reflect the reported network experience data, wherein the eighth time information may specifically be a time interval information and / or time range information. After receiving the third indication information, the network data analysis device reports the network experience data to the network data analysis device according to the time interval information and / or time range information contained in the third indication information. Generally speaking, if the network enters a stable phase or the network completes a test phase, the eighth time information may be a relatively long time interval or a relatively large time range. For example, the network management device may directly instruct the network device analysis device to report the network experience data once a day and / or instruct the network device analysis device to report the network experience data within the past month. In this way, the frequency of the network data analysis device reporting the network experience data to the network management device may be relatively low, avoiding the network management device from frequently interacting with the network management device, thereby reducing the data throughput and network load of the network. Even the eighth time information may be set to an infinite time interval or time range, so that the network data analysis device does not need to obtain training data or interact with the network management device.

[0442] It should be noted that, in addition to the above-mentioned network data analysis device determining the tenth time information for reporting the network experience data according to the third indication information and reporting the network experience data according to the tenth time information, there may be other methods for the network data analysis device to report the network experience data according to the third indication information:

[0443] For example, in some possible designs, the network data analysis device determines the tenth location information based on the third indication information, and reports the network experience data based on the tenth location information. In other words, the network data analysis device reports the network experience data corresponding to the tenth location information. Among them, the tenth location information includes one or more of the following location area information: the entire network, at least one registration area list, and at least one cell list. It should be noted that the ninth location information may be the same as or different from the ninth location information in step S1106, and there is no limitation here.

[0444] For another example, in some possible designs, the network data analysis device determines the tenth network identification information according to the third indication information, and reports the network experience data according to the tenth network identification information. In other words, the network data analysis device reports the network experience data corresponding to the tenth network identification information. For example, the network experience data corresponding to the network slice 1 is reported according to the third indication information. It should be noted that the ninth network identification information may be the same as or different from the ninth network identification information in step S1106, and this is not limited here.

[0445] For another example, in some possible designs, the network data analysis device determines the tenth service identification information based on the third indication information, and reports the network experience data based on the tenth service identification information. In other words, the network data analysis device reports the network experience data corresponding to the tenth service identification information. For example, the network experience data corresponding to the service identified by some service identifiers in the network is reported according to the third indication information. It should be noted that the tenth service identification information may be the same as or different from the ninth service identification information in step S1106, and this is not limited here.

[0446] In some possible designs, the network data analysis device determines the tenth data network name information according to the third indication information, and reports the network experience data according to the tenth data network name information. For example, the network experience data corresponding to some DNNs in the network is reported according to the third indication information. It should be noted that the tenth data network name information may be the same as or different from the ninth data network name information in step S1106, and this is not limited here.

[0447] It can be considered that one or more of the tenth time information, the tenth location information, the tenth network identification information, the tenth service identification information, and the tenth data network name information are used as reporting filtering information for the network data analysis device to send network experience data to the network management device. The network data analysis device determines the reporting filtering information according to the third indication information, and sends the network experience data according to the reporting filtering.

[0448] After the network data analysis device learns that the network has entered the stable stage from the test stage through the method flow described in this step, the network data analysis device changes the filtering information reported by the network experience data accordingly, that is, reports the network experience data to the network management device with different reporting strategies. Among them, the filtering information / reporting strategy includes reporting time information, location information, network identification information, service identification information, data network name information, etc. In general, the changed filtering information / reporting strategy can avoid frequent and wide geographical reporting of network experience data, or even completely avoid reporting of network experience data, so as to meet the needs of network quality monitoring or adjustment in the stable stage of the network.

[0449] S1108. Same method as described in S1104.

[0450] This embodiment provides a method for determining whether the network is in a test state or a stable state between a network management device and a network data analysis device, and adopts different data reporting and data collection methods for different states. In fact, this method is also applicable to any other two network elements, and can be summarized as follows:

[0451] 1) A first network device (such as a network management device) determines a network state of a network, wherein the network state includes a test state or a stable state, wherein the test state is used to indicate that the network is a newly built network or the network is in a test phase, and the stable state is used to indicate that the network is in a stable state or the network has completed the test phase;

[0452] 2) The first network device (such as a network management device) sends network status indication information (such as the second indication information in S1101 or the third indication information in S1105) to the second network device (network data analysis device), and the network status indication information is used to indicate the network status of the network to the second network device; or, the network status indication information is used to indicate the time information of reporting data (such as network experience data) to the second network device (such as the fifth time information in S1101 or the eighth time information in S1105), wherein the time information of the reported data is determined by the first network device (such as a network management device) according to the network status.

[0453] In addition, accordingly,

[0454] 3) The second network device (such as a network data analysis device) receives the network status indication information.

[0455] 4) The second network device (such as a network data analysis device) reports data (such as network experience data) to the first network device (such as a network management device) according to the network status information.

[0456] For other methods, please refer to Fig.11 The detailed description of the method described in the embodiment only requires replacing the network management device with the first network device, the network data analysis device with the second network device, and replacing the data interacting between the two from network experience data with data to be interacted between the first network device and the second network device.

[0457] In addition, it is explained that in a possible design, if the second network device itself can determine whether the network is in the test phase or whether the network is a newly built network, the operation of receiving the network status indication information from the first network device can be omitted. After the second network device itself determines that the network is in a different network state, it adopts a different data reporting strategy to report data to the first network device, wherein the data reporting method can still refer to Fig.11 Example.

[0458] In the embodiments provided by the present application, the various schemes of the resource management method provided by the embodiments of the present application are introduced from the perspective of each network element itself and from the perspective of the interaction between each network element. It can be understood that each network element and device, such as the first network element, the network management device, the first network device and the second network device, in order to realize the above functions, includes a hardware structure and / or software module corresponding to each function. It should be easy for those skilled in the art to realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0459] For example, when the above network element implements the corresponding function through a software module. The resource management device may include a receiving module 1201, a processing module 1202 and a sending module 1203. Fig. 12A shown.

[0460] In one embodiment, the resource management device can be used to perform the above Fig.10 For example:

[0461] The processing module 1202 is used to determine whether the network meets the network quality requirement. The sending module 1203 is used to send first indication information to the network management device, wherein the first indication information is used to indicate whether the network meets the network quality requirement.

[0462] Optionally, before the sending module 1203 sends the first indication information to the network management device, the processing module 1202 is further configured to perform user access control on the network.

[0463] Optionally, the resource management device also includes a receiving module 1201, which is used to receive user number information from a network management device or a network data analysis device, wherein the user number information includes registered user number information and / or online user number information; the processing module 1202 performs user access control on the network based on the user number information.

[0464] Optionally, the network's satisfaction with network quality requirements includes: the network cannot meet the network quality requirements; or, the network's satisfaction with network quality requirements is lower than a preset value; or, the degree to which the network satisfies the network quality requirements.

[0465] Optionally, the receiving module 1201 is used to receive first network experience data of the network from a network data analysis device, where the first network experience data is used to indicate the service quality of the network; the processing module 1202 is used to determine whether the network meets the network quality requirements based on the first network experience data.

[0466] In addition, the receiving module 1201, the processing module 1202 and the sending module 1203 in the above-mentioned resource management device can also implement the above-mentioned method. Fig.10 Other operations or functions of the first network element are not described here.

[0467] In another embodiment, Fig. 12A The resource management device shown can also be used to perform the above Fig.10 For example, the receiving module 1201 is used to receive first indication information from the first network element, wherein the first indication information is used to indicate whether the network meets the network quality requirement, and the processing module 1202 is used to adjust the network resources according to the first indication information.

[0468] Optionally, the processing module 1202 is used to determine, according to the first indication information, that the network cannot meet network quality requirements, and the processing module 1202 is used to adjust network resources.

[0469] Optionally, the receiving module 1201 is used to receive second network experience data from a network data analysis device, where the second network experience data is used to indicate the service quality of the network; and the processing module 1202 is used to adjust network resources according to the first indication information and the second network experience data.

[0470] Optionally, the processing module 1202 is further configured to obtain second network experience data according to the first indication.

[0471] In addition, the receiving module 1201 and the processing module 1202 in the above-mentioned resource management device can also implement the above-mentioned method. Fig.10 Other operations or functions of the network management device are not described here.

[0472] In another embodiment, Fig. 12A The resource management device shown can also be used to perform the above Fig.10 For example, the receiving module 1201 is used to receive network experience data from a network data analysis device, where the network experience data is used to indicate the service quality of the network; and the processing module 1202 is used to adjust network resources according to the network experience data.

[0473] Optionally, the network experience data includes experience data at a network granularity and / or experience data at a business granularity, wherein the experience data at a network granularity is used to indicate network service quality at a network granularity, and the experience data at a business granularity is used to indicate network service quality at a business granularity.

[0474] Optionally, the receiving module 1201 is further used to receive first indication information from the first network element, where the first indication information is used to indicate whether the network meets the network quality requirement.

[0475] Optionally, the network's satisfaction with network quality requirements includes: the network cannot meet the network quality requirements; or, the network's satisfaction with network quality requirements is lower than a preset value; or, the degree to which the network satisfies the network quality requirements.

[0476] Optionally, the processing module 1202 is configured to adjust network resources according to the first indication information and the network experience data.

[0477] Optionally, the processing module 1202 is used to determine, according to the first indication information, that the network cannot meet network quality requirements, and the processing module 1202 is used to adjust network resources.

[0478] In addition, the receiving module 1201 and the processing module 1202 in the above-mentioned resource management device can also implement the above-mentioned method. Fig.10 Other operations or functions of the network management device are not described here.

[0479] In another embodiment, Fig. 12A The resource management device shown can also be used to perform the above Fig.11For example: the processing module 1202 is used to determine the network status of the network, the network status includes a test status or a stable status, wherein the test status is used to indicate that the network is a newly built network or the network is in the test phase, and the stable status is used to indicate that the network is in a stable state or the network has completed the test phase; the sending module 1203 is used to send network status indication information to the second network device, the network status indication information is used to indicate the network status of the network to the second network device; or the network status indication information is used to indicate to the second network device the time information for sending data to the first network device, wherein the time information is determined by the first network device according to the network status.

[0480] Optionally, the resource management apparatus further includes a receiving module 1201, and the receiving module 1201 is used to receive data from the second network device, where the data is sent by the second network device to the resource management apparatus according to the first indication information.

[0481] Optionally, the resource management apparatus includes a network management device.

[0482] Optionally, the second network device includes a network data analysis device.

[0483] Optionally, the data includes network experience data, where the network experience data is used to indicate the service quality of the network.

[0484] Optionally, the processing module 1202 is further configured to adjust network resources according to the network experience data so that the network can meet network quality requirements.

[0485] Optionally, the sending module 1203 is used to send resource adjustment notification information to the access network device or the core network device according to the network experience data, and the resource adjustment notification information is used to notify the access network device or the core network device to adjust network resources.

[0486] In addition, the receiving module 1201, the processing module 1202 and the sending module 1203 in the above-mentioned resource management device can also implement the above-mentioned method. Fig.11 Other operations or functions of the first network device are not described here.

[0487] In another embodiment, Fig. 12A The resource management device shown can also be used to perform the above Fig.11For example: the receiving module 1201 is used to receive the second indication information from the first network device, and the second indication information is used to indicate to the second network device that the network is in the first network state; or, the second indication information is used to indicate to the second network device the first time information of sending data to the first network device. The first network state includes a test state or a stable state, wherein the test state is used to indicate that the network is a newly built network or the network is in the test phase, and the stable state is used to indicate that the network is in a stable state or the network has completed the test phase. The first time information is determined by the first network device according to the first network state. The sending module 1203 is used to send data to the first network device according to the second indication information.

[0488] Optionally, the resource management device also includes a processing module 1202, and the processing module 1202 is used to obtain training data from a third network device according to the second indication information, and the third network device is different from the second network device. The processing module 1202 is used to generate data based on the training data.

[0489] Optionally, the first network device includes a network management device, and the resource management device includes a network data analysis device.

[0490] Optionally, the data includes network experience data, where the network experience data is used to indicate the service quality of the network.

[0491] In addition, the receiving module 1201, the processing module 1202 and the sending module 1203 in the above-mentioned resource management device can also implement the above-mentioned method. Fig.11 Other operations or functions of the second network device are not described here.

[0492] Fig. 12B Another possible structural diagram of the resource management device involved in the above embodiment is shown. The resource management device includes a transceiver 1204 and a processor 1205, such as Fig. 12B As shown. For example, the processor 1205 can be a general-purpose microprocessor, a data processing circuit, an application specific integrated circuit (ASIC) or a field-programmable gate array (FPGA) circuit. The resource management device can also include a memory 1206, for example, the memory is a random access memory (RAM). The memory is used to couple with the processor 1205, and it stores the computer program 12061 necessary for the resource management device.

[0493] In addition, the resource management method involved in the above embodiment further provides a carrier 1207, in which a computer program 12071 of the resource management device is stored, and the computer program 12071 can be loaded into the processor 1205. The above carrier can be an optical signal, an electrical signal, an electromagnetic signal, or a computer-readable storage medium (for example, a hard disk).

[0494] When the computer program 12061 or 12071 is executed on a computer (eg, processor 1205 ), the computer may be enabled to execute the method described above.

[0495] For example, in one embodiment, the processor 1205 is configured to Fig.10 The transceiver 1204 is used to implement communication between the resource management device and the network management device / network data analysis device.

[0496] In another embodiment, the processor 1205 is configured to Fig.10 The transceiver 1204 is used to implement communication between the resource management device and the network data analysis device / first network element.

[0497] In another embodiment, the processor 1205 is configured to Fig.11 The transceiver 1204 is used to implement communication between the resource management device and the second network device / network data analysis device.

[0498] In another embodiment, the processor 1205 is configured to Fig.11 The transceiver 1204 is used to implement communication between the resource management device and the first network device / network data analysis device.

[0499] The controller / processor of the device for executing the resource management described above in the present application may be a central processing unit (CPU), a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of the present application. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0500] The steps of the method or algorithm described in conjunction with the disclosure of the present application can be implemented in a hardware manner, or can be implemented by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a mobile hard disk, a CD-ROM or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a resource management device. Of course, the processor and the storage medium can also be present in a resource management device as discrete components.

[0501] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0502] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solution of the present invention should be included in the scope of protection of the present invention.

Claims

1. A resource management method, characterized in that: The method comprises: The network management device obtains a first service experience data set of the service from the network data analysis device, where each first service experience data in the first service experience data set is used to indicate the service quality of all users or multiple users in the network performing the service, wherein the service runs on the network, and the first service experience data is historical first service experience data; The network management device obtains first service quality requirement information of the service; The network management device adjusts the network according to the first service experience data set, the first network data set of the network and the first service quality requirement information; the first network data set of the network includes device-level performance parameters, interface-level performance parameters and network-level performance parameters, wherein the network-level performance parameters include end-to-end performance parameters of the network.

2. The resource management method according to claim 1, characterized in that: The network is a network slice or a network slice instance or a network slice sub-instance.

3. The resource management method according to claim 1, characterized in that: The network management device is a network operation and maintenance management OAM network element or a network slicing management function NSMF network element.

4. The resource management method according to claim 1, characterized in that: The network management device obtains first service quality requirement information of the service, including: The network management device obtains first service quality requirement information of the service from a network data analysis device or a service server of the service.

5. The resource management method according to any one of claims 1 to 4, characterized in that: Each first service experience data in the first service experience data set includes at least one of the following information: service identification information of the service, network identification information of the network, first time information, first location information, and information on the proportion of users meeting the service experience standard.

6. The resource management method according to any one of claims 1 to 4, characterized in that: The device-level performance parameters include at least one of the following information of at least one network device: device identification information, registered user number information, online user number information, resource information, performance parameter measurement information, key performance indicator information, and associated identification information of a single user executing the service in the device.

7. The resource management method according to any one of claims 1 to 4, characterized in that: The interface-level performance parameters include at least one of the following information of at least one network interface: identification information of a device corresponding to the network interface, latency information of the network interface, topology information of a device corresponding to the network interface, data packet throughput information of the network interface, and link usage information of the network interface.

8. The resource management method according to any one of claims 1 to 4, characterized in that: The end-to-end performance parameters of the network include at least one of the following information: end-to-end delay within the network, the number of registered users of the service in the network, uplink data traffic, downlink data traffic, the number of protocol data unit PDU sessions in the network, and virtual resource usage information in the network.

9. The resource management method according to any one of claims 1 to 4, characterized in that: Before adjusting the network, the method includes: The network management device determines, according to the first service experience data set of the service, that the network cannot meet the service quality requirement corresponding to the first service quality requirement information.

10. A resource management device, characterized in that: The device comprises: an acquiring unit, configured to acquire a first service experience data set of a service from a network data analysis device, wherein each first service experience data in the first service experience data set is used to indicate a service quality of the service performed by all users or multiple users in the network, wherein the service runs on the network, and the first service experience data is historical first service experience data; The acquisition unit is further used to acquire first service quality requirement information of the service; A processing unit, used to adjust the network according to the first service experience data set, the first network data set of the network and the first service quality requirement information; the first network data set of the network includes device-level performance parameters, interface-level performance parameters and network-level performance parameters, wherein the network-level performance parameters include end-to-end performance parameters of the network.

11. The resource management device according to claim 10, characterized in that: The network is a network slice, a network slice instance or a network slice sub-instance.

12. The resource management device according to claim 10, characterized in that: The resource management device is a network operation and maintenance management OAM network element or a network slicing management function NSMF network element.

13. The resource management device according to claim 10, characterized in that: The acquisition unit is further used for: The first service quality requirement information of the service is obtained from a network data analysis device or a service server of the service.

14. The resource management device according to any one of claims 10 to 13, characterized in that: Each first service experience data in the first service experience data set includes at least one of the following information: service identification information of the service, network identification information of the network, first time information, first location information, and information on the proportion of users meeting the service experience standard.

15. The resource management device according to any one of claims 10 to 13, characterized in that: The device-level performance parameters include at least one of the following information of at least one network device: device identification information, registered user number information, online user number information, resource information, performance parameter measurement information, key performance indicator information, and associated identification information of a single user executing the service in the device.

16. The resource management device according to any one of claims 10 to 13, characterized in that: The interface-level performance parameters include at least one of the following information of at least one network interface: identification information of a device corresponding to the network interface, latency information of the network interface, topology information of a device corresponding to the network interface, data packet throughput information of the network interface, and link usage information of the network interface.

17. The resource management device according to any one of claims 10 to 13, characterized in that: The end-to-end performance parameters of the network include at least one of the following information: end-to-end delay within the network, the number of registered users of the service in the network, uplink data traffic, downlink data traffic, the number of protocol data unit PDU sessions in the network, and virtual resource usage information in the network.

18. The resource management device according to any one of claims 10 to 13, characterized in that: The processing unit is further configured to determine, based on a first service experience data set of the service, that the network cannot meet the service quality requirement corresponding to the first service quality requirement information.

Images