Network performance monitoring method, apparatus and system

Abstract

The application provides a network performance monitoring method, device and system, relates to the technical field of communication, and can flexibly subscribe to network performance data and improve network operation and maintenance efficiency. The method comprises the following steps: a management device receives request information from a demand device, and the request information is used for requesting network performance data. The request information carries network performance monitoring conditions. The network performance monitoring conditions comprise one or more of the following: network performance data statistical granularity, network performance data category and network performance data filtering condition. The network performance data statistical granularity is used for indicating the granularity of the network performance data to be sent; the network performance data category is used for indicating the category of the network performance data to be sent; and the network performance data filtering condition is used for indicating the filtering condition that needs to be met by the network performance data to be sent. The management device determines the network performance data according to the network performance monitoring conditions, wherein the network performance data meets the network performance monitoring conditions. The management device sends the network performance data to the demand device.

Description

[0001] The present application claims priority from the Chinese Patent Application No. 202010306630.7 filed on April 17, 2020, and entitled "Network Performance Monitoring Method, Device and System", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the field of communication technology, and in particular to a network performance monitoring method, device and system. BACKGROUND

[0003] With the development of communication technology, including the introduction of vertical industries, the increase of terminal devices and the diversity of services, the network of operators becomes more and more complex. The complex network increases the difficulty of operation and maintenance, therefore, network performance visualization has become an important technical means for network operation and maintenance. Based on network performance visualization, network performance data can be obtained intuitively by operation and maintenance personnel, so as to quickly locate network performance problems and reduce operation and maintenance costs.

[0004] However, in the existing network performance monitoring method, the demand device needs to specify a specific management object and network performance data name, in order to obtain the network performance data provided by the management device, and to realize monitoring network performance.

[0005] Relying on the above method to obtain network performance data, on the one hand, the demand device needs to specify the management object in advance, and can only obtain the network performance data of the specified management object, which lacks flexibility. On the other hand, the demand device and the management device need to synchronize the management object and the network performance data name, in order to obtain the correct network performance data, which affects the network operation and maintenance efficiency. SUMMARY

[0006] The network performance monitoring method, device and system provided by the present application can realize flexible subscription of network performance data and improve network operation and maintenance efficiency.

[0007] To achieve the above-mentioned purpose, the present application adopts the following technical solutions:

[0008] In a first aspect, the present application provides a network performance monitoring method, which can include: a management device receiving request information from a demand device. The request information is used to request network performance data. The request information carries network performance monitoring conditions. The network performance monitoring conditions include one or more of the following: network performance data statistical granularity, network performance data category, network performance data filtering condition. The network performance data statistical granularity is used to indicate the granularity of the network performance data to be sent; the network performance data category is used to indicate the category of the network performance data to be sent; and the network performance data filtering condition is used to indicate the filtering condition that needs to be met by the network performance data to be sent. The management device determines the network performance data according to the network performance monitoring conditions. The network performance data meets the network performance monitoring conditions. The management device sends the network performance data to the demand device.

[0009] For example, the network performance monitoring conditions include network performance data statistical granularity at the regional level. The management device can obtain network performance data according to the network performance statistical granularity requirement. For example, the uplink and downlink user throughput at the regional level can include the average value of the uplink and downlink user throughput of all cells in the region.

[0010] Alternatively, the network performance monitoring conditions include network performance data category as capacity. For example, the network performance data subscribed or monitored by the demand device is capacity network performance data. For example, it can include uplink and downlink throughput. Then the management device obtains the network performance data of the capacity according to the network performance monitoring conditions.

[0011] Alternatively, the network performance monitoring conditions include network performance data filtering conditions. For example, network performance data when network congestion occurs. Then the management device can obtain the network performance data when network congestion occurs according to the network performance monitoring conditions.

[0012] Alternatively, the network performance monitoring conditions include a combination of network performance data statistical granularity, network performance data category, and network performance data filtering condition. For example, uplink and downlink throughput when network congestion occurs.

[0013] In this way, the demand device can flexibly subscribe to network performance data using network performance monitoring conditions. The management device directly determines the corresponding network performance data according to the network performance monitoring conditions. Moreover, the management device and the demand device do not need to synchronize the network performance data name to determine the network performance data, thereby improving the operation and maintenance efficiency.

[0014] In a possible implementation, the network performance monitoring condition includes a network performance data statistical granularity. The management device determines the network performance data according to the network performance monitoring condition, including: the management device performs one or more of the following according to the network performance data statistical granularity: collecting network performance data of the network performance statistical granularity, statistically analyzing network performance data of the network performance statistical granularity, and querying network performance data of the network performance statistical granularity in a local database.

[0015] For example, the management device collects network performance data of the network performance statistical granularity, and the network performance data statistical granularity is network performance data of a network slice service level. Then, the management device needs to request a network device (such as a base station) to report network performance data of the network slice service level, and after collecting (that is, receiving) the network performance data of the network slice service level reported by the network device, directly sends the network performance data to the demand device.

[0016] For another example, the management device statistically analyzes network performance data of the network performance statistical granularity, and the network performance data statistical granularity is network performance data of a network slice level. Then, the management device needs to first receive network performance data of a cell level of an access network slice reported by a network device (such as a base station), and then statistically analyzes and generates network performance data of the network slice level according to the network performance data of the cell level of the access network slice. Then, the management device sends the statistically analyzed network performance data to the demand device.

[0017] For another example, the management device queries network performance data of the network performance statistical granularity in the local database, which means that the local database of the management device stores network performance data of different network performance statistical granularities, such as cell level network performance data and network slice level network performance data. The network performance data in the local database can be network performance data collected by the management device and directly stored, or can be network performance data collected and statistically analyzed by the management device and stored. Subsequently, the management device can directly call network performance data of a corresponding network performance statistical granularity in the local database according to the network performance data statistical granularity.

[0018] In this way, the management device can flexibly determine network performance data according to the requirements included in the network performance monitoring condition carried in the received request information and according to actual conditions through various implementation manners. For example, in a case where network performance data collection can be performed, network performance data is directly collected to feed back network performance in real time. For another example, in a case where network performance data collection cannot be performed, network performance data that has been analyzed and statistically analyzed in the local database can be directly called, so that the demand device can directly apply the network performance data sent by the management device after receiving the network performance data, without the need to perform statistical analysis again, thereby improving efficiency.

[0019] In a possible implementation, the network performance monitoring condition includes a network performance data category. The management device determines the network performance data according to the network performance monitoring condition, including: the management device determines a network performance data name corresponding to the network performance data category. The management device performs one or more of the following according to the network performance data name: collecting network performance data corresponding to the network performance data name, statistically analyzing network performance data corresponding to the network performance data name, and querying network performance data corresponding to the network performance data name in a local database.

[0020] Corresponding to the above example of network performance data statistical granularity, if the network performance monitoring condition includes a network performance data category, the management device can collect network performance data according to the network performance data category and directly send the network performance data to the demand device. The network performance data can also be collected according to the network performance data category, and then statistically analyzed and sent to the demand device. Alternatively, the management device stores the statistically analyzed network performance data in a local database, and after receiving the network performance monitoring condition, queries the corresponding network performance data in the local database according to the network performance data category.

[0021] In a possible implementation, the network performance monitoring condition includes a network performance data filtering condition. The management device determines the network performance data according to the network performance monitoring condition, including: the management device performs one or more of the following according to the network performance data filtering condition: collecting network performance data satisfying the network performance data filtering condition, statistically analyzing network performance data satisfying the network performance data filtering condition, and querying network performance data satisfying the network performance data filtering condition in a local database.

[0022] Corresponding to the above example of network performance data statistical granularity, if the network performance monitoring condition includes a network performance data filtering condition, the management device can collect network performance data according to the network performance data filtering condition and directly send the network performance data to the demand device. The network performance data can also be collected according to the network performance data filtering condition, and then statistically analyzed and sent to the demand device. Alternatively, the management device stores the statistically analyzed network performance data in a local database, and after receiving the network performance monitoring condition, queries the corresponding network performance data in the local database according to the network performance data filtering condition.

[0023] In a possible implementation, the request information is network performance management configuration request information, network performance intent request information, or network performance task management request information. The network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model includes a network performance monitoring condition. The network performance intent request information carries a network performance intent model, and the network performance intent model includes a network performance monitoring condition. The network performance task management request information carries a network performance monitoring condition.

[0024] Optionally, the demand device can send the request information to the management device through different interfaces, and the demand device can match the interface type through the type of the request information. Then, different types of request information can be configured for corresponding different interfaces. In different types of request information, the network performance monitoring condition is carried, so as to realize flexible subscription of network performance data.

[0025] In a possible implementation, the network performance monitoring condition further includes one or more of the following: a receiving address, a statistical period, and a reporting period. The receiving address, the statistical period, and the reporting period are determined by the demand device according to one or more of the following: a network performance data statistical granularity, a network performance data category, and a network performance data filtering condition. The management device sends the network performance data to the demand device, including: if the network performance monitoring condition further includes the receiving address, the management device sends the network performance data to the demand device at the receiving address. If the network performance monitoring condition further includes the statistical period, the management device statistically determines the network performance data according to the statistical period and sends the network performance data to the demand device. If the network performance monitoring condition further includes the reporting period, the management device sends the network performance data to the demand device according to the reporting period.

[0026] Optionally, the network performance monitoring condition includes the receiving address, and the management device can send the network performance data to the receiving address after determining the network performance data. The demand device directly receives the network performance data at the receiving address, which can prevent data loss.

[0027] Further, different network performance data statistical granularities, different network performance data categories, and different network performance data filtering conditions can correspond to the same or different receiving addresses. In this way, the demand device can directly distinguish the types of received network performance data through different receiving addresses.

[0028] Optionally, the network performance monitoring condition includes the statistical period, and the management device periodically determines the network performance data according to the statistical period, which can further save device power consumption. Correspondingly, the network performance data sent by the management device to the demand device is also the network performance data periodically determined by the demand device.

[0029] Optionally, the network performance monitoring condition includes a reporting period, and the management device periodically sends the network performance data according to the reporting period. The demand device also periodically receives the network performance data according to the reporting period. In this way, device power consumption is further saved, and the reception of the network performance data can be ensured.

[0030] In a possible implementation, the network performance data statistical granularity includes one or more of the following: a region level, a cell level, a grid level, a network element level, a network slice level, a sub-network level, a network slice service level, a tenant level, and a user level.

[0031] In a possible implementation, the network performance data category includes one or more of the following: a coverage category, a capacity category, a quality category, a handover category, a resource category, a user category, a service category, a performance measurement quantity, a key performance indicator (KPI), signaling trace data, minimization of drive test (MDT) data, analysis data, and customer experience (QoE) data.

[0032] In a possible implementation, the network performance data filtering condition includes one or more of the following: a network problem condition, a time range, a network performance threshold range, and a region range.

[0033] In this way, the network performance monitoring condition can include different network performance data statistical granularities, different network performance data categories, different network performance data filtering conditions, or a combination of the three. In this way, the demand device can subscribe to network performance data in a more flexible manner.

[0034] In a second aspect, the present application provides a network performance monitoring method, which can include: a demand device sending request information to a management device; the request information is used to request network performance data, and carries a network performance monitoring condition; the network performance monitoring condition includes one or more of the following: a network performance data statistical granularity, a network performance data category, and a network performance data filtering condition; the network performance data statistical granularity is used to indicate the granularity of the network performance data to be received; the network performance data category is used to indicate the category of the network performance data to be received; and the network performance data filtering condition is used to indicate the filtering condition that needs to be met by the network performance data to be received. The demand device receives network performance data from the management device; and the network performance data meets the network performance monitoring condition.

[0035] In a possible implementation, before the demand device sends the request information to the management device, the method further includes: the demand device receiving a network performance monitoring condition. Alternatively, the demand device receives a network performance optimization requirement or a network performance optimization intention; the network performance optimization requirement or the network performance optimization intention is used to optimize network performance. The demand device determines the network performance monitoring condition according to the network performance optimization requirement or the network performance optimization intention.

[0036] Optionally, the demand device can directly receive the network performance monitoring condition input by the operation and maintenance personnel.

[0037] For example, the demand device can display the network performance data statistical granularity, the network performance data category, and the network performance data filtering condition through the human-computer interaction page, and receive the input or selection of the operation and maintenance personnel. Different operation and maintenance personnel (which can also be referred to as customers) have different subscription or monitoring demands for network performance data, and the demand device can directly receive different subscription or monitoring demands of the operation and maintenance personnel for network operation and maintenance.

[0038] Optionally, during network operation, the demand device receives the network optimization demand or intention of the customer or the automatic module, and then determines the network performance monitoring condition according to the network optimization demand or intention.

[0039] For example, the demand device receives the network slice delay optimization demand, and then determines the delay of the network slice granularity that needs to be monitored according to the network slice delay optimization demand. For another example, the demand device receives the edge user rate improvement intention, and then determines the UE-level uplink and downlink throughput rate when the user rate is less than 5 Mbps and the regional-level uplink and downlink throughput rate at this time according to the edge user rate improvement intention.

[0040] In this way, the demand device can determine the network performance monitoring condition required by the operation and maintenance personnel or the automatic module through the above two different implementation manners. For example, the demand device directly receives the network performance monitoring condition. Or, during network operation, the demand device receives the network performance optimization demand or network performance optimization intention, and determines the network performance monitoring condition by analyzing the network performance optimization demand or network performance optimization intention. Further, the corresponding network performance data is obtained to meet the operation and maintenance demand.

[0041] In a possible implementation manner, the request information is network performance management configuration request information, network performance intention request information, or network performance task management request information. The network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model includes the network performance monitoring condition. The network performance intention request information carries a network performance intention model, and the network performance intention model includes the network performance monitoring condition. The network performance task management request information carries the network performance monitoring condition.

[0042] In a possible implementation, the network performance monitoring condition further comprises one or more of the following: a receiving address, a statistical period, a reporting period; wherein the receiving address, the statistical period and the reporting period are determined by the demand device according to one or more of the following: a network performance data statistical granularity, a network performance data category, a network performance data filtering condition. The demand device receives the network performance data from the management device, comprising: if the network performance monitoring condition further comprises the receiving address, the demand device receives the network performance data sent by the management device at the receiving address. If the network performance monitoring condition further comprises the statistical period, the demand device receives the network performance data counted according to the statistical period sent by the management device. If the network performance monitoring condition further comprises the reporting period, the demand device receives the network performance data sent by the management device according to the reporting period.

[0043] In a possible implementation, the network performance data statistical granularity comprises one or more of the following: a region level, a cell level, a grid level, a network element level, a network slice level, a sub-network level, a network slice service level, a tenant level, and a user level.

[0044] In a possible implementation, the network performance data category comprises one or more of the following: a coverage type, a capacity type, a quality type, a handover type, a resource type, a user type, a service type, a performance measurement quantity, a key performance indicator KPI, signaling tracking data, minimization of drive test MDT data, analysis data, and customer perception experience QoE data.

[0045] In a possible implementation, the network performance data filtering condition comprises one or more of the following: a network problem condition, a time range, a network performance threshold range, and a region range.

[0046] In addition, the technical effects of the network performance monitoring method of the second aspect can refer to the technical effects of the network performance monitoring method of the first aspect, which will not be repeated here.

[0047] In a third aspect, the present application provides a network performance monitoring method, which can include: a requirement device sending request information to a management device; wherein the request information is used to request network performance data, and the request information carries network performance monitoring conditions; the network performance monitoring conditions include one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering conditions; the network performance data statistical granularity is used to indicate the granularity of the network performance data to be received by the requirement device; the network performance data category is used to indicate the category of the network performance data to be received by the requirement device; and the network performance data filtering conditions are used to indicate the filtering conditions that need to be met by the network performance data to be received by the requirement device. The management device receives the request information from the requirement device. The management device determines the network performance data according to the network performance monitoring conditions; wherein the network performance data meets the network performance monitoring conditions. The management device sends the network performance data to the requirement device. The requirement device receives the network performance data from the management device.

[0048] In addition, the technical effects of the network performance monitoring method of the third aspect can refer to the technical effects of the network performance monitoring method of the first aspect, which will not be repeated here.

[0049] In a fourth aspect, the present application provides a network performance monitoring device, which can include a receiving module, a processing module, and a sending module. The receiving module is used to receive request information from a requirement device; the request information is used to request network performance data; the request information carries network performance monitoring conditions; the network performance monitoring conditions include one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering conditions; the network performance data statistical granularity is used to indicate the granularity of the network performance data to be sent; the network performance data category is used to indicate the category of the network performance data to be sent; and the network performance data filtering conditions are used to indicate the filtering conditions that need to be met by the network performance data to be sent. The processing module is used to determine the network performance data according to the network performance monitoring conditions; wherein the network performance data meets the network performance monitoring conditions. The sending module is used to send the network performance data to the requirement device.

[0050] In a possible implementation, the processing module is specifically configured to perform one or more of the following according to the network performance data statistical granularity: collect network performance data of the network performance statistical granularity, statistically analyze network performance data of the network performance statistical granularity, and query network performance data of the network performance statistical granularity from a local database.

[0051] In a possible implementation, the processing module is further configured to determine a network performance data name corresponding to the network performance data category. The processing module is specifically configured to perform one or more of the following according to the network performance data name: collect network performance data corresponding to the network performance data name, statistically analyze network performance data corresponding to the network performance data name, and query network performance data corresponding to the network performance data name in a local database.

[0052] In a possible implementation, the processing module is specifically configured to perform one or more of the following according to the network performance data filtering condition: collect network performance data satisfying the network performance data filtering condition, statistically analyze network performance data satisfying the network performance data filtering condition, and query network performance data satisfying the network performance data filtering condition in a local database.

[0053] In a possible implementation, the request information is network performance management configuration request information, network performance intent request information, or network performance task management request information. The network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model includes a network performance monitoring condition. The network performance intent request information carries a network performance intent model, and the network performance intent model includes a network performance monitoring condition. The network performance task management request information carries a network performance monitoring condition.

[0054] In a possible implementation, the network performance monitoring condition further includes one or more of the following: a receiving address, a statistical period, and a reporting period. The receiving address, the statistical period, and the reporting period are determined by the demand device according to one or more of the following: a network performance data statistical granularity, a network performance data category, and a network performance data filtering condition. The sending module is further configured to send the network performance data to the demand device at the receiving address if the network performance monitoring condition further includes the receiving address. The processing module is further configured to statistically analyze the network performance data according to the statistical period if the network performance monitoring condition further includes the statistical period. The sending module is further configured to send, to the demand device, network performance data statistically analyzed by the processing module according to the statistical period if the network performance monitoring condition further includes the statistical period. The sending module is further configured to send the network performance data to the demand device according to the reporting period if the network performance monitoring condition further includes the reporting period.

[0055] In a possible implementation, the network performance data statistical granularity includes one or more of the following: a region level, a cell level, a grid level, a network element level, a network slice level, a sub-network level, a network slice service level, a tenant level, and a user level.

[0056] In a possible implementation, the network performance data category includes one or more of the following: a coverage category, a capacity category, a quality category, a handover category, a resource category, a user category, a service category, a performance measurement quantity, a key performance indicator (KPI), signaling trace data, minimization of drive test (MDT) data, analysis data, and customer perception experience (QoE) data.

[0057] In a possible implementation, the network performance data screening condition includes one or more of the following: a network problem condition, a time range, a network performance threshold range, and a region range.

[0058] Optionally, the receiving module and the sending module can also be integrated together, such as a transceiver module, implemented by a transceiver or a transceiver-related circuit component. The receiving module is configured to receive the request information sent by the demand device. The sending module is configured to send the network performance to the demand device. The embodiments of the present application do not limit the specific implementation of the receiving module and the sending module.

[0059] Optionally, the network performance monitoring apparatus of the fourth aspect can further include a storage module, which stores a program or an instruction. When the processing module executes the program or the instruction, the network performance monitoring apparatus of the third aspect can execute the network performance monitoring method of the first aspect.

[0060] It should be noted that the network performance monitoring apparatus of the fourth aspect can be a management device or a chip (system) or other components or assemblies that can be arranged in the management device, and the present application does not limit this.

[0061] It should be noted that the network performance monitoring apparatus provided in the fourth aspect of the present application is used to implement the network performance monitoring method provided in the first aspect and any possible implementation of the first aspect. Therefore, the specific implementation of the network performance monitoring apparatus provided in the fourth aspect of the present application can refer to the specific implementation of the network performance monitoring method provided in the first aspect and any possible implementation of the first aspect, which will not be described here.

[0062] In addition, the technical effects of the network performance monitoring apparatus of the fourth aspect can refer to the technical effects of the network performance monitoring method of the first aspect, which will not be described here.

[0063] In a fifth aspect, the present application provides a network performance monitoring device, comprising: a sending module and a receiving module. The sending module is configured to send request information to a management device, wherein the request information is used to request network performance data, and the request information carries network performance monitoring conditions; the network performance monitoring conditions comprise one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering conditions; the network performance data statistical granularity is used to indicate the granularity of the network performance data to be received; the network performance data category is used to indicate the category of the network performance data to be received; and the network performance data filtering conditions are used to indicate the filtering conditions that need to be met by the network performance data to be received. The receiving module is configured to receive network performance data from the management device, wherein the network performance data meets the network performance monitoring conditions.

[0064] In a possible implementation, the receiving module is further configured to receive the network performance monitoring conditions. Alternatively, the device further comprises a processing module. The receiving module is further configured to receive network performance optimization requirements or network performance optimization intentions, wherein the network performance optimization requirements or network performance optimization intentions are used to optimize network performance. The processing module is further configured to determine the network performance monitoring conditions according to the network performance optimization requirements or network performance optimization intentions.

[0065] In a possible implementation, the request information is network performance management configuration request information, network performance intention request information, or network performance task management request information. The network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model contains the network performance monitoring conditions. The network performance intention request information carries a network performance intention model, and the network performance intention model contains the network performance monitoring conditions. The network performance task management request information carries the network performance monitoring conditions.

[0066] In a possible implementation, the network performance monitoring conditions further comprise one or more of the following: a receiving address, a statistical period, and a reporting period; wherein the receiving address, the statistical period, and the reporting period are determined by the processing module according to one or more of the following: the network performance data statistical granularity, the network performance data category, and the network performance data filtering conditions. The receiving module is further configured to receive the network performance data sent by the management device at the receiving address if the network performance monitoring conditions further comprise the receiving address. The receiving module is further configured to receive the network performance data sent by the management device according to the statistical period if the network performance monitoring conditions further comprise the statistical period. The receiving module is further configured to receive the network performance data sent by the management device according to the reporting period if the network performance monitoring conditions further comprise the reporting period.

[0067] In a possible implementation, the network performance data statistical granularity includes one or more of the following: a region level, a cell level, a grid level, a network element level, a network slice level, a sub-network level, a network slice service level, a tenant level, and a user level.

[0068] In a possible implementation, the network performance data category includes one or more of the following: a coverage category, a capacity category, a quality category, a handover category, a resource category, a user category, a service category, a performance measurement quantity, a key performance indicator (KPI), signaling trace data, minimization of drive test (MDT) data, analysis data, and customer perception experience (QoE) data.

[0069] In a possible implementation, the network performance data filtering condition includes one or more of the following: a network problem condition, a time range, a network performance threshold range, and a region range.

[0070] Optionally, the receiving module and the sending module can be integrated together, for example, a transceiver module, implemented by a transceiver or a transceiver-related circuit component. The receiving module is configured to receive the network performance data sent by the management device. The sending module is configured to send the request information to the management device. The embodiments of the present application do not limit the specific implementation of the receiving module and the sending module.

[0071] Optionally, the network performance monitoring apparatus of the fifth aspect can further include a storage module, which stores a program or an instruction. When the processing module executes the program or the instruction, the network performance monitoring apparatus of the fifth aspect can execute the network performance monitoring method of the second aspect.

[0072] It should be noted that the network performance monitoring apparatus of the fifth aspect can be a demand device or a chip (system) or other components or assemblies that can be arranged in the demand device, and the present application does not limit this.

[0073] It should be noted that the network performance monitoring apparatus provided in the fifth aspect of the present application is used to implement the network performance monitoring method provided in the second aspect and any possible implementation of the second aspect. Therefore, the specific implementation of the network performance monitoring apparatus provided in the fifth aspect of the present application can refer to the specific implementation of the network performance monitoring method provided in the second aspect and any possible implementation of the second aspect, which will not be described here in detail.

[0074] In addition, the technical effects of the network performance monitoring apparatus of the fifth aspect can refer to the technical effects of the network performance monitoring method of the second aspect, which will not be described here in detail.

[0075] In a sixth aspect, the present application provides a network performance monitoring apparatus, which can implement the functions of the management device in the above method examples. The functions can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. The network performance monitoring apparatus can exist in the form of a chip product.

[0076] In combination with the sixth aspect, in a possible implementation, the network performance monitoring apparatus includes a processor and a transceiver in its structure. The processor is configured to support the network performance monitoring apparatus to perform the corresponding functions in the above method. The transceiver is used to support the communication between the network performance monitoring apparatus and other devices. The network performance monitoring apparatus can further include a memory coupled with the processor, which stores the necessary program instructions and data of the network performance monitoring apparatus.

[0077] In a seventh aspect, the present application provides another network performance monitoring apparatus, which can implement the functions of the demand device in the above method examples. The functions can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. The network performance monitoring apparatus can exist in the form of a chip product.

[0078] In combination with the seventh aspect, in a possible implementation, the network performance monitoring apparatus includes a processor and a transceiver in its structure. The processor is configured to support the network performance monitoring apparatus to perform the corresponding functions in the above method. The transceiver is used to support the communication between the network performance monitoring apparatus and other devices. The network performance monitoring apparatus can further include a memory coupled with the processor, which stores the necessary program instructions and data of the network performance monitoring apparatus.

[0079] In an eighth aspect, the present application provides a management device, which has the functions of implementing the network performance monitoring method in the above first aspect and any possible implementation thereof. The functions can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0080] In a ninth aspect, the present application provides a demand device, which has the functions of implementing the network performance monitoring method in the above second aspect and any possible implementation thereof. The functions can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0081] In a tenth aspect, the present application provides a network performance monitoring system, which comprises the management device provided in the eighth aspect and the demand device provided in the ninth aspect.

[0082] In an eleventh aspect, the present application provides a network performance monitoring system, which comprises a demand device and a management device. The demand device is configured to send request information to the management device, wherein the request information is used to request network performance data, and the request information carries network performance monitoring conditions. The network performance monitoring conditions comprise one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering condition. The network performance data statistical granularity is used to indicate the granularity of the network performance data to be received by the demand device. The network performance data category is used to indicate the category of the network performance data to be received by the demand device. The network performance data filtering condition is used to indicate the filtering condition to be met by the network performance data to be received by the demand device. The management device is configured to receive the request information from the demand device, determine the network performance data according to the network performance monitoring conditions, wherein the network performance data meets the network performance monitoring conditions, and send the network performance data to the demand device. The demand device is further configured to receive the network performance data from the management device.

[0083] In a twelfth aspect, the present application provides a computer readable storage medium, which comprises computer instructions. When the computer instructions are run on a server, the server is caused to perform the network performance monitoring method according to any one of the first aspect to the third aspect and the possible implementation manners thereof.

[0084] In a thirteenth aspect, the present application provides a computer program product, which, when run on a server, causes the server to perform the network performance monitoring method according to any one of the first aspect to the third aspect and the possible implementation manners thereof.

[0085] In a fourteenth aspect, the present application provides circuitry, which comprises processing circuitry configured to perform the network performance monitoring method according to any one of the first aspect to the third aspect and the possible implementation manners thereof.

[0086] In a fifteenth aspect, the present application provides a chip, which comprises a processor and an interface circuit. The interface circuit is configured to receive code instructions and transmit the code instructions to the processor. The processor is configured to run the code instructions to perform the network performance monitoring method according to any one of the first aspect to the third aspect and the possible implementation manners thereof. BRIEF DESCRIPTION OF DRAWINGS

[0087] Figure 1 A structural schematic diagram of a communication system architecture provided by the embodiments of the present application;

[0088] Figure 2 The structural schematic diagram of the communication device provided by the embodiment of the present application is shown in FIG. 1.

[0089] Figure 3 The network performance monitoring method provided by the embodiment of the present application is shown in FIG. 2. Figure 1

[0090] Figure 4 The network performance monitoring method provided by the embodiment of the present application is shown in FIG. 2. Figure 2

[0091] Figure 5 The network performance monitoring condition collection interface provided by the embodiment of the present application is shown in FIG. 3.

[0092] Figure 6 The structural schematic diagram of the network performance monitoring device provided by the embodiment of the present application is shown in FIG. 4. Figure 1

[0093] Figure 7 The structural schematic diagram of the network performance monitoring device provided by the embodiment of the present application is shown in FIG. 4. Figure 2

[0094] Figure 8 The structural schematic diagram of the network performance monitoring system provided by the embodiment of the present application is shown in FIG. 5.

[0095] Figure 9 The structural schematic diagram of the chip system provided by the embodiment of the present application is shown in FIG. 6. DETAILED DESCRIPTION

[0096] The network performance monitoring method, device and system provided by the embodiment of the present application are described in detail below with reference to the accompanying drawings.

[0097] Before the specific schemes of the present application are described, some terms in the embodiment of the present application are explained to facilitate the understanding of the skilled in the art.

[0098] 1) Demand device

[0099] The demand device, which can also be called as consumer, is a device using network and monitoring network performance to operate and maintain network. The demand device proposes request information according to its own business needs to obtain network performance data for monitoring network performance. The demand device can be a business support system (BSS), or a cross domain management system (CD-MnF), or a domain management function (domain-MnF).

[0100] 2) Management device​​​​

[0101] A management device, also known as a provider, is a device used to manage and monitor the network used by the requesting device. Based on the requests from the requesting device, the management device obtains network performance data and feeds it back to the requesting device to achieve network performance monitoring. The management device can be a cross-domain management function (CD-MnF), a domain management function (domain-MnF), or a network element.

[0102] It should be noted that the required equipment and management equipment can be functional units, chip systems, or other types, and this application embodiment does not specifically limit them.

[0103] 3) Network performance data

[0104] It refers to the performance-related data exhibited by the devices managed by the management equipment during operation, including performance data related to service performance, network performance data, and UE performance data.

[0105] The network performance monitoring method provided in this application embodiment is applied to, for example, Figure 1 The diagram shows the structural design of the communication system architecture. Figure 1 As shown, the communication system 100 includes a business support system (BSS) 101, a cross-domain management function (CD-MnF) 102, a domain management function (domain-MnF) 103, and multiple network elements 104 in the mobile communication network. It should be noted that... Figure 1 The example in the diagram shows four network elements, number 104, representing four separate network elements. Their logical architecture is referenced... Figure 1 As shown. The domain management system 103 can also be understood in the same way.

[0106] Among them, the business support system 101 is oriented towards communication services and can provide functions and management services such as billing, settlement, accounting, customer service, sales, network monitoring, communication service lifecycle management, and business intent translation.

[0107] The business support system 101 comprises an operator's operational system or vertical operational technology system. For example, the business support system 101 can be a communication service MnS producer or a communication service MnS consumer.

[0108] The cross-domain management system 102, which can also be referred to as a network management function (NMF), provides one or more of the following management functions or services: network lifecycle management, network deployment, network fault management, network performance management, network configuration management, network assurance, network optimization function, translation of intent from a communication service provider (intent-CSP), translation of intent from a communication service consumer (intent-CSC), etc. The network can comprise one or more network elements, subnetworks or network slices. For example, the cross-domain management system 102 can be a network slice management function (NSMF), or a management data analytical function (MDAF), or a cross-domain self-organization network function (SON-function), or a cross-domain intent management function unit.

[0109] It is noted that in some deployment scenarios, the cross-domain management system 102 can also provide one or more of the following management functions or services: subnetwork lifecycle management, subnetwork deployment, subnetwork fault management, subnetwork performance management, subnetwork configuration management, subnetwork assurance, subnetwork optimization function, translation of intent from a communication service provider for a subnetwork, translation of intent from a communication service consumer for a subnetwork, etc. The subnetwork can comprise a plurality of small subnetworks or a plurality of network slice subnetworks. The cross-domain management system 102 can also be referred to as a network management service producer.

[0110] The domain management system 103, which can also be referred to as a subnetwork management function (NMF) or a network element management system, provides network operation and maintenance functions within a domain, i.e., subnetwork or network element, including one or more of the following functions or management services: lifecycle management of a subnetwork or network element, deployment of a subnetwork or network element, fault management of a subnetwork or network element, performance management of a subnetwork or network element, assurance of a subnetwork or network element, optimization management of a subnetwork or network element, and intent translation of a subnetwork or network element. The subnetwork herein includes one or more network elements. Alternatively, the subnetwork herein can also include one or more subnetworks, i.e., one or more subnetworks form a larger coverage subnetwork. Alternatively, the subnetwork herein can also include one or more network slice subnetworks. Then, the domain management system 103 can also be a network slice subnetwork management function (NSSMF), a domain management data analytical function (domain-MDAF), a domain SON-function, or a domain intent management function unit.

[0111] The domain management system 103 can also be referred to as a subnetwork communication service producer or a network communication service producer.

[0112] The domain management system 103 can be deployed in a manner including but not limited to the following:

[0113] 1) The domain management system 103 can be deployed according to network types, and can be deployed as a combination of one or more of the following: an access network domain management system, a core network domain management system, and a transmission network domain management system.

[0114] 2) The domain management system 103 can be deployed according to regions, and can be deployed as a domain management system for a certain region. For example, a Shanghai domain management system, a Beijing domain management system, etc. That is, a set of network elements or cells contained in a certain region can also be considered as a subnetwork, i.e., a regional network.

[0115] The network element 104 is an entity providing network service, including a core network element, an access network element, etc. For example, the core network element can include but is not limited to an access and mobility management function (AMF) entity, a session management function (SMF) entity, a policy control function (PCF) entity, a network data analysis function (NWDAF) entity, a network repository function (NRF), a gateway, etc. The access network element can include but is not limited to various types of base stations (for example, a generation node B (gNB), an evolved Node B (eNB), a central unit control panel (CUCP), a central unit (CU), a distributed unit (DU), a central unit user panel (CUUP), etc.

[0116] The network element 104 can also provide one or more of the following management functions or management services: lifecycle management of the network element, deployment of the network element, fault management of the network element, performance management of the network element, assurance of the network element, optimization function of the network element, intent translation of the network element, etc.

[0117] The network element 104 can also be referred to as a network function MnS producer.

[0118] Among them, Figure 1 The business support system 101 and the cross-domain management system 102 illustrated in the figure can be an operator network operation and maintenance management system. Alternatively, Figure 1 The business support system 101 illustrated in the figure is a third-party operation and maintenance system, the cross-domain management system 102 is an operator network operation and maintenance management system, and the domain management system 103 is a device manufacturer management system.

[0119] In Figure 1 In the communication system architecture illustrated in the figure, if the cross-domain management system 102 is a management device, the business support system 101 is a demand device. If the domain management system 103 is a management device, the business support system 101 or the cross-domain management system 102 is a demand device. If the network element 104 is a management device, the business support system 101, the cross-domain management system 102, or the domain management system 103 is a demand device.

[0120] It should be noted that, Figure 1 The communication system architecture shown is a service-oriented management architecture that provides network operation and maintenance services. It should include a management service producer (MnS producer) and a management service consumer (MnS consumer). The management device in this application embodiment can also be referred to as a management service provider, and the requesting device can also be referred to as a management service consumer.

[0121] Optionally, the management device or required device that executes the network performance monitoring method provided in this application can be implemented by a single device, multiple devices working together, a functional module within a single device, or a chip within a single device. This application does not specifically limit this. It is understood that the above-mentioned functions can be network elements in hardware devices, software functions running on dedicated hardware, or virtualization functions instantiated on a platform (e.g., a cloud platform).

[0122] For example, the management device or required device for implementing the network performance monitoring method provided in this application can be implemented by different devices. For example, through Figure 2 This is achieved through the communication device 200. Figure 2 The diagram shown is a schematic representation of a communication device provided in an embodiment of this application. The communication device 200 includes at least one processor 201, a communication line 202, a memory 203, and at least one communication interface 204. The memory 203 may also be included within the processor 201.

[0123] The processor 201 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0124] Communication line 202 may include a path for transmitting information between the aforementioned components.

[0125] The communication interface 204 is configured to communicate with other devices. In the embodiments of the present application, the communication interface 204 can be a module, a circuit, a bus, an interface, a transceiver or other device capable of realizing the communication function, and is configured to communicate with other devices. Optionally, when the communication interface 204 is a transceiver, the transceiver can be a separately arranged transmitter, which is configured to send information to other devices. The transceiver can also be a separately arranged receiver, which is configured to receive information from other devices. The transceiver can also be a component integrating the functions of the transmitter and the receiver. The specific implementation of the transceiver is not limited in the embodiments of the present application.

[0126] The memory 203 can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. The non-volatile memory can be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example, and not limitation, many forms of RAM can be used, such as a static RAM (SRAM), a dynamic RAM (DRAM), a synchronous dynamic RAM (SDRAM), a double data rate SDRAM (DDR SDRAM), an enhanced SDRAM (ESDRAM), a synchlink DRAM (SLDRAM), and a direct rambus RAM (DR RAM), or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but not limited to this. The memory 203 can exist independently, and is connected to the processor 201 through the communication line 202. The memory 203 can also be integrated with the processor 201.

[0127] The memory 203 is configured to store computer-executable instructions for implementing the solutions of the present application, and the processor 201 is configured to control the execution. The processor 201 is configured to execute the computer-executable instructions stored in the memory 203, so as to implement the network performance monitoring method provided in the embodiments of the present application.

[0128] It should be noted that the memories described herein are intended to include, but are not limited to, these and any other suitable types of memories.

[0129] Optionally, the computer execution instructions in the embodiments of this application may also be referred to as application code, instructions, computer program or other names, and the embodiments of this application do not specifically limit them.

[0130] In a specific implementation, as one embodiment, the processor 201 may include one or more CPUs, for example... Figure 2 CPU0 and CPU1 in the CPU.

[0131] In a specific implementation, as one example, the communication device 200 may include multiple processors, such as... Figure 2 Processors 201 and 207 are described herein. Each of these processors may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor here may refer to one or more devices, circuits, and / or processing cores used to process data (e.g., computer program instructions).

[0132] In a specific implementation, as one embodiment, the communication device 200 may further include an output device 205 and an input device 206. The output device 205 communicates with the processor 201 and can display information in various ways. For example, the output device 205 may be a liquid crystal display (LCD), a light-emitting diode (LED) display device, a cathode ray tube (CRT) display device, or a projector, etc. The input device 206 communicates with the processor 201 and can receive user input in various ways. For example, the input device 206 may be a mouse, keyboard, touchscreen device, or sensing device, etc.

[0133] The aforementioned communication device 200 can be a general-purpose device or a dedicated device. In specific implementations, the communication device 200 can be a desktop computer, laptop computer, network server, PDA (personal digital assistant), mobile phone, tablet computer, wireless terminal device, embedded device, or other similar device. Figure 2 Devices with similar structures. This application does not limit the type of communication device 200 to any particular embodiment.

[0134] In a possible implementation, when the communication apparatus 200 is a management device performing the network performance monitoring method provided in the present application, the processor 201 performs the following functions by running or executing software programs and / or modules stored in the memory 203 and calling data stored in the memory 203:

[0135] The request information is received from the demand device through the communication interface 204. The request information is used to request network performance data, and carries network performance monitoring conditions. The network performance monitoring conditions include one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering condition. The network performance data statistical granularity is used to indicate the granularity of the network performance data to be sent; the network performance data category is used to indicate the category of the network performance data to be sent; and the network performance data filtering condition is used to indicate the filtering condition that needs to be met by the network performance data to be sent. The network performance data satisfying the network performance monitoring conditions is sent to the demand device through the communication interface 204.

[0136] In a possible implementation, when the communication apparatus 200 is a demand device performing the network performance monitoring method provided in the present application, the processor 201 performs the following functions by running or executing software programs and / or modules stored in the memory 203 and calling data stored in the memory 203:

[0137] The request information is sent to the management device through the communication interface 204. The request information is used to request network performance data, and carries network performance monitoring conditions. The network performance monitoring conditions include one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering condition. The network performance data statistical granularity is used to indicate the granularity of the network performance data to be sent; the network performance data category is used to indicate the category of the network performance data to be sent; and the network performance data filtering condition is used to indicate the filtering condition that needs to be met by the network performance data to be sent. The network performance data satisfying the network performance monitoring conditions is received from the management device through the communication interface 204.

[0138] It should be noted that the names of messages between devices in the following embodiments of the present application or the names of parameters in the messages are only examples, and other names can also be used in specific implementations, and the embodiments of the present application do not make specific limitations on this.

[0139] Figure 3 Fig. 4 shows a network performance monitoring method provided by an embodiment of the present application Figure 1 As shown in Fig. 4, the method can include S301-S305: Figure 3

[0140] ​S301, the demand device sends request information to the management device, the request information carrying network performance monitoring conditions.

[0141] The request information is used to request network performance data, and carries network performance monitoring conditions. The network performance monitoring conditions include one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering condition.

[0142] Optionally, the demand device can realize network performance monitoring by sending request information to the management device to subscribe to network performance data. The subscription to network performance data described in the embodiments of the present application includes periodic reporting of control network performance data or real-time querying of network performance data.

[0143] In a possible implementation, the network performance data statistical granularity is used to describe the statistical granularity of the network performance data subscribed to or monitored by the demand device. That is, the network performance data statistical granularity is used to indicate the granularity of the network performance data to be received. The network performance data statistical granularity includes one or more of the following: regional level, cell level, grid level, network element level, network slice level, sub-network level, network slice service level, tenant level, and user level.

[0144] For example, if the network performance data statistical granularity is the regional level, it means that the demand device needs network performance data of the regional level. For example, the reference signal received power (RSRP) of the regional level can include the average value of the RSRP of all cells in the region. For example, the uplink and downlink user throughput of the regional level can include the average value of the uplink and downlink user throughput of all cells in the region. For example, the number of users of the regional level can include the total number of users accessing the cells in the region. The region can include a set of network element devices or cells in a certain region.

[0145] It should be noted that the statistical formula or algorithm of the network performance data of the regional level can be preconfigured. For example, it can be preconfigured in the management device. If the management device receives the request information sent by the demand device, and the network performance monitoring conditions carried in the request information include the statistical requirement of the regional level, the network performance data can be calculated according to the preconfigured statistical formula. For example, the sum formula of the radio resource control (RRC) connection number is preconfigured in the management device. If the network performance data statistical granularity is the regional level, the sum of the RRC connection numbers of the cells in the current region can be calculated as the RRC connection number of the regional level by using the preconfigured formula.

[0146] For example, if the network performance statistical granularity is cell level, it means that the demand device needs network performance data of cell level granularity. For example, the RSRP of cell level granularity can include the average of RSRP of all user equipments (UEs) accessing the cell. For example, the uplink and downlink user throughput of cell level granularity can include the average of uplink and downlink user throughput of all UEs accessing the cell. For example, the number of users of cell level granularity can include the number of UEs accessing the cell. The cell refers to a wireless coverage area identified by a base station identification code or a global cell identification code.

[0147] It should be noted that the network performance data statistical formula or algorithm of cell level granularity can be preset.

[0148] For example, if the network performance statistical granularity is grid level, it means that the demand device needs network performance data of grid level granularity. For example, the RSRP of grid level granularity can include the average of RSRP of all UEs in the grid. For example, the uplink and downlink user throughput of grid level granularity can include the average of uplink and downlink user throughput of all UEs in the grid. For example, the number of users of grid level can include the number of UEs in the grid. The grid refers to each small area after a geographical area is divided into multiple small areas, and each grid can be described as longitude and latitude information and grid size.

[0149] It should be noted that the network performance data statistical formula or algorithm of grid level granularity can be preset.

[0150] For example, if the network performance statistical granularity is network element level, it means that the demand device needs network performance data of network element level granularity. For example, the RSRP of network element level granularity can include the average of RSRP of UEs accessing the network element. For example, the uplink and downlink user throughput of network element level granularity can include the average of uplink and downlink user throughput of UEs accessing the network element. For example, the number of users of network element level granularity can include the number of UEs accessing the network element.

[0151] It should be noted that the network performance data statistical formula or algorithm of network element level can be preset.

[0152] For example, if the network performance statistical granularity is a network slice level, it means that the device in need requires network performance data of the network slice level. For example, the RSRP of the network slice level can include the average value of the RSRP of the UE accessing the network slice. For another example, the uplink and downlink user throughput of the network slice level can include the average value of the uplink and downlink user throughput of the UE accessing the network slice. For another example, the number of users of the network slice level can include the number of UEs accessing the network slice. The network slice can include a logical network satisfying a specific service or customer running on a general network infrastructure, and the network slice in the embodiment of the present application refers to a network slice instance.

[0153] It should be noted that the network performance data statistical formula or algorithm of the network slice level can be pre-set.

[0154] For example, if the network performance statistical granularity is a sub-network level, it means that the device in need requires network performance data of the sub-network level. For example, the RSRP of the sub-network level can include the average value of the RSRP of the UE accessing the sub-network. For another example, the uplink and downlink user throughput of the sub-network level can include the average value of the uplink and downlink user throughput of the UE accessing the sub-network. For another example, the number of users of the sub-network level can include the number of UEs accessing the sub-network. The sub-network is a set of network elements.

[0155] It should be noted that the network performance data statistical formula or algorithm of the sub-network level can be pre-set.

[0156] For example, if the network performance statistical granularity is a network slice service level, it means that the device in need requires network performance data of the network slice service level. For example, the RSRP of the network slice service level can include the average value of the RSRP of the UE accessing the network slice service. For another example, the uplink and downlink user throughput of the network slice service level can include the average value of the uplink and downlink user throughput of the UE accessing the network slice service. For another example, the number of users of the network slice service level can include the number of UEs accessing the network slice. The network slice service can include single network slice selection assistance information (S-NSSAI) used to identify a network slice.

[0157] It should be noted that the network performance data statistical formula or algorithm of the network slice level can be pre-set.

[0158] For example, if the network performance statistics granularity is tenant level, it means that the demand device needs network performance data of tenant level granularity. For example, RSRP of tenant level granularity can include the average of RSRP of UEs belonging to the tenant. For example, uplink and downlink user throughput of tenant level granularity can include the average of uplink and downlink user throughput of UEs belonging to the tenant. For example, the number of users of tenant level granularity can include the number of UEs belonging to the tenant. The tenant can include, for example, an instance of existence of a mobile virtual network operator (MVNO) in a specific country or region.

[0159] It should be noted that the network performance data statistical formula or algorithm of the tenant level can be pre-set.

[0160] For example, if the network performance statistics granularity is user level, it means that the demand device needs network performance data of user level granularity. For example, latency of user level granularity, user rate of user level granularity, etc. The network performance data of user level granularity is measured by the UE and reported to the management device, and then sent to the demand device by the management device.

[0161] In a possible implementation, the network performance data category is used to describe the network performance category of network performance data that the demand device needs to subscribe to or monitor. That is, the network performance data category is used to indicate the category of network performance data to be received. The network performance data category includes one or more of the following: coverage category, capacity category, quality category, handover category, resource category, user category, service category, performance measurement quantity, key performance indicator (KPI), signaling tracking data, minimization of drive test (MDT) data, analysis data, and customer perception experience (QoE) data.

[0162] For example, if the network performance data category is coverage category, it means that the network performance data that the demand device needs to subscribe to or monitor is network performance data of coverage category. For example, it can include RSRP, signal to interference plus noise ratio (SINR), etc.

[0163] For example, if the network performance data category is capacity category, it means that the network performance data that the demand device needs to subscribe to or monitor is network performance data of capacity category. For example, it can include uplink and downlink throughput, physical resource block (PRB) usage, radio resource control (RRC) connection number, etc.

[0164] For example, if the network performance data category is quality, it means that the network performance data required by the demand device to subscribe or monitor is quality network performance data. For example, it can include uplink and downlink air interface delay, packet loss rate, handover success rate, etc.

[0165] For example, if the network performance data category is handover, it means that the network performance data required by the demand device to subscribe or monitor is handover network performance data. For example, it can include the number of requested handover execution, the number of successful handover executions, and the mean time of requested handover execution.

[0166] For example, if the network performance data category is resource, it means that the network performance data required by the demand device to subscribe or monitor is resource network performance data. For example, it can include CPU occupancy, virtual resource usage, etc.

[0167] For example, if the network performance data category is user, it means that the network performance data required by the demand device to subscribe or monitor is user network performance data. For example, it can include user delay, user perceived rate, user number, user location, etc.

[0168] For example, if the network performance data category is service, it means that the network performance data required by the demand device to subscribe or monitor is service network performance data. For example, it can include service delay, service perceived rate, delay jitter, call drop rate, and packet loss rate.

[0169] For example, if the network performance data category is performance measurement, it means that the network performance data required by the demand device to subscribe or monitor is network performance measurement. For example, it can include PRB resource utilization, the number of requested handover execution, and CPU occupancy, etc.

[0170] For example, if the network performance data category is key performance indicator (KPI), it means that the network performance data required by the demand device to subscribe or monitor is KPI. For example, it can include delay, throughput rate, etc.

[0171] For example, if the network performance data category is signaling trace data, it means that the network performance data that the requesting device needs to subscribe to or monitor is signaling trace data. For example, it can include packet delay measurement, packet loss rate measurement, etc.

[0172] For example, if the network performance data category is minimization drive tests (MDT) data, it means that the network performance data that the requesting device needs to subscribe to or monitor is minimization drive tests data. For example, it can include reference signal received power (RSRP), signal to interference plus noise ratio (SINR), etc.

[0173] For example, if the network performance data category is analysis data, it means that the network performance data that the requesting device needs to subscribe to or monitor is analysis data. The analysis data includes at least one of management analysis data and network analysis data. For example, it can include coverage problem analysis data, capacity problem analysis data, traffic map, coverage map, etc.

[0174] For example, if the network performance data category is quality of experience (QoE) data, it means that the network performance data that the requesting device needs to subscribe to or monitor is quality of experience data. For example, it can include average throughput, frame rate, jitter period, etc.

[0175] In a possible implementation, the network performance data filtering condition is used to describe the filtering condition of the network performance data that the requesting device needs to subscribe to or monitor, that is, the network performance data filtering condition is used to indicate the filtering condition that the network performance data to be received needs to meet. The network performance data filtering condition includes one or more of the following: network problem condition, time range, network performance threshold range, area range.

[0176] For example, if the network performance data filtering condition includes a network problem condition, it means that the requesting device needs to subscribe to or monitor the network performance data corresponding to the network problem. For example, the network performance data when weak coverage, network congestion, etc. occurs. In combination with the network performance data statistical granularity and the network performance data category, it can include RSRP when weak coverage occurs, RRC connection number when network congestion occurs, PRB usage rate when network congestion occurs, etc.

[0177] For example, if the network performance data filtering condition includes a time range, it means that the demand device needs to subscribe or monitor network performance data in the specified time range. For example, network performance data during busy hours, a certain time period, idle hours, etc. Combined with the network performance data statistical granularity, the network performance data category, it can include the number of user connections during busy hours, the user perceived rate during a certain time period, the latency during idle hours, etc.

[0178] For example, if the network performance data filtering condition includes a network performance threshold range, it means that the demand device needs to subscribe or monitor network performance data within or outside the network performance threshold range. For example, user perceived rate < 5 Mbps, RSRP value < -20 dB, etc.

[0179] For example, if the network performance data filtering condition includes a region range, it means that the demand device needs to subscribe or monitor network performance data within the region range. The region range can be represented in one or more of the following ways: latitude and longitude, administrative region, tracking area code (TAC). The region range can also represent a group of cells or a group of base stations, and the region range is described by the identifier of the region. For example, user perceived rate within region range A, number of users within region range A, etc.

[0180] S302, the management device receives the request information from the demand device.

[0181] In S302, the management device receives the request information, i.e. the request information sent by the demand device in S301, which is not described here.

[0182] S303, the management device determines the network performance data according to the network performance monitoring condition.

[0183] Specifically, after receiving the request information sent by the demand device, the management device can obtain the network performance monitoring condition carried in the request information, and then determine the network performance data according to the network performance monitoring condition.

[0184] If the network performance monitoring condition includes a network performance data statistical granularity, the management device can analyze the network performance data corresponding to the network performance data statistical granularity according to the network performance data statistical formula or algorithm preconfigured in the management device as described in S301.

[0185] Optionally, the network performance monitoring condition includes a network performance data statistical granularity, and the management device performs one or more of the following according to the network performance data statistical granularity: collects network performance data of the network performance statistical granularity, analyzes network performance data of the network performance statistical granularity, and queries network performance data of the network performance statistical granularity in a local database.

[0186] For example, the management device collects network performance data of a network performance statistical granularity, and the network performance data is network performance data of a network slice service level. Then, the management device needs to request the network device (e.g., a base station) to report network performance data of a network slice service level, and after collecting (i.e., receiving) the network performance data of the network slice service level reported by the network device, directly sends the network performance data to the demand device.

[0187] For another example, the management device statistically analyzes network performance data of a network performance statistical granularity, and the network performance data is network performance data of a network slice level. Then, the management device needs to first receive cell-level network performance data of an access network slice reported by the network device (e.g., a base station), and then statistically analyzes and generates network performance data of a network slice level according to the cell-level network performance data of the access network slice. After that, sends the statistically analyzed network performance data to the demand device.

[0188] For another example, the management device queries network performance data of a network performance statistical granularity in a local database, which means that the local database of the management device stores network performance data of different network performance statistical granularities, such as cell-level network performance data and network slice-level network performance data. The network performance data in the local database can be network performance data collected by the management device in advance and directly stored, or can be network performance data collected and statistically analyzed by the management device and then stored. Subsequently, the management device can directly call network performance data of a corresponding network performance statistical granularity in the local database according to the network performance statistical granularity.

[0189] Optionally, the network performance monitoring condition includes a network performance data category, the management device determines a network performance data name corresponding to the network performance data category, and performs one or more of the following according to the network performance data name: collects network performance data corresponding to the network performance data name, statistically analyzes network performance data corresponding to the network performance data name, and queries network performance data corresponding to the network performance data name in a local database.

[0190] The correspondence between the network performance data category and the network performance data name can be preconfigured in the management device. For example, when the network performance data type is coverage, the network performance data name is RSRP or SINR.

[0191] Specifically, the management device obtains a corresponding network data name according to the network performance data category in the network performance monitoring condition. Then, obtains corresponding network performance data according to the network data name.

[0192] For example, after the management device collects the network performance data of the coverage type, the management device directly sends the collected network performance data of the coverage type to the demand device.

[0193] For another example, after the management device queries the RSRP value in the local database, the management device sends the queried RSRP value to the demand device.

[0194] Optionally, the network performance monitoring condition comprises a network performance data screening condition, and the management device performs one or more of the following according to the network performance data screening condition: collects network performance data meeting the network performance data screening condition, statistically analyzes the network performance data meeting the network performance data screening condition, and queries the network performance data meeting the network performance data screening condition in the local database.

[0195] For example, the management device collects the uplink and downlink user throughput during busy hours according to the network performance data screening condition.

[0196] For another example, the management device queries the RSRP value when a weak coverage problem is detected in the local database according to the network performance data screening condition.

[0197] In this way, the management device can flexibly determine the network performance data according to the requirements contained in the network performance monitoring condition carried in the received request information and according to the actual conditions through various implementation manners. For example, in the case where network performance data collection is possible, the network performance data is directly collected to feed back the network performance in real time. For another example, in the case where network performance data collection is not possible, the network performance data that has been analyzed and counted in the local database can be directly called, so that the demand device can directly apply the network performance data sent by the management device after receiving the network performance data, without the need to perform statistical analysis again, thereby improving the efficiency.

[0198] S304, the management device sends the network performance data to the demand device.

[0199] The network performance data is obtained by the management device according to the network performance monitoring condition, and the network performance data can meet the network performance monitoring condition. After the management device obtains the network performance data according to the network performance monitoring condition, the management device can send the obtained network performance data to the demand device.

[0200] S305, the demand device receives the network performance data from the management device.

[0201] Specifically, the network performance data received by the demand device in S305 corresponds to the specific implementation manner of the management device sending the network performance data in S304, which will not be described herein again.

[0202] After S305, the demand device can operate and maintain the network managed by the demand device according to the network performance data.

[0203] It should be noted that the execution order of the above steps in the network performance monitoring method provided in this application embodiment can be configured according to actual needs, and this application does not impose specific limitations on this. Figure 3 This only illustrates one possible execution order of the above steps included in the network performance monitoring method, and is not a specific limitation.

[0204] Therefore, the network performance monitoring method provided in this application requires the device to obtain the statistical granularity of network performance data and / or the category of network performance data, and / or network performance data that meets the filtering conditions by configuring network performance monitoring conditions. This enables flexible customization of network performance data, improves the flexibility of network performance data control and access, and enhances network operation and maintenance efficiency.

[0205] Alternatively, before sending a request to the management device, the requesting device needs to determine the request information. That is, the requesting device needs to determine the network performance monitoring conditions first. Figure 4 A schematic diagram of the network performance monitoring method provided in this application embodiment. Figure 2 .like Figure 4 As shown, the network performance monitoring method provided in this application embodiment may include S301a or S301b before S301.

[0206] S301a, Requirements for receiving network performance monitoring conditions.

[0207] Specifically, the required equipment can directly receive network performance monitoring conditions input by maintenance personnel. In other words, the network performance monitoring conditions are determined by collecting the network performance monitoring requirements from maintenance personnel.

[0208] For example, the device can display the granularity of network performance data statistics, network performance data categories, and network performance data filtering conditions through a human-machine interface, and receive input or selections from maintenance personnel. Different maintenance personnel (also known as customers) have different subscription or monitoring needs for network performance data, and the device can directly receive these different subscription or monitoring needs for network maintenance.

[0209] for example, Figure 5 This is a schematic diagram of the network performance monitoring condition collection interface provided in an embodiment of this application. See also... Figure 5 As shown, interface 510 is used to collect network performance monitoring conditions. The required device collects the network performance monitoring conditions selected by maintenance personnel in menu bar 511, corresponding to interface 512. Interface 512 then collects the needs of maintenance personnel to subscribe to or monitor network performance data. For example, Figure 5In the middle, interface 512 corresponds to the content displayed after the network performance data filtering condition is selected from menu bar 511. The demand device determines the network performance data filtering condition by collecting the content input or selected by the operation and maintenance personnel on interface 512.

[0210] It can be understood that the demand device can also receive the network performance monitoring condition in other ways. For example, directly receiving the network performance monitoring condition sent by other devices, such as an automation module, and the like. The embodiments of the present application do not make specific limitations thereto.

[0211] S301b, the demand device receives a network performance optimization demand or a network performance optimization intention, and determines a network performance monitoring condition according to the network performance optimization demand or the network performance optimization intention.

[0212] The network performance optimization demand or the network performance optimization intention is used to optimize the network performance and perform network operation and maintenance management. In the network operation process, the network performance monitoring condition can be determined according to the current network situation or real-time demand. Different customers or automation modules have different subscription or monitoring demands for the network performance, and the demand device can flexibly monitor the network performance according to the changes of the demand or intention.

[0213] For example, the demand device receives a network slice latency optimization demand, and determines the latency of the network slice granularity that needs to be monitored according to the network slice latency optimization demand. For another example, the demand device receives an edge user rate improvement intention, and determines the uplink and downlink throughput rate of the UE level when the user rate is less than 5 Mbps and the uplink and downlink throughput rate of the region level at this time according to the edge user rate improvement intention.

[0214] In this way, the demand device can determine the network performance monitoring condition required by the operation and maintenance personnel or the automation module through the two different implementation manners in S301a and S301b described above. For example, the demand device directly receives the network performance monitoring condition. Or, in the network operation process, the demand device receives a network performance optimization demand or a network performance optimization intention, and determines the network performance monitoring condition by analyzing the network performance optimization demand or the network performance optimization intention. Then, the demand device can send a request message to the management device, the request message carries the determined network performance monitoring condition, obtains the corresponding network performance data, realizes flexible network performance monitoring, and meets the operation and maintenance demand.

[0215] Optionally, in S301a or S301b described above, the management device can further determine other contents included in the network performance monitoring condition in the process of determining the request information. For example, the network performance monitoring condition further includes one or more of the following: a receiving address, a statistical period, and a reporting period.

[0216] The receiving address, the statistical period and the reporting period are determined by the demand device according to one or more of the following: network performance data statistical granularity, network performance data category, network performance data filtering condition.

[0217] In a possible implementation, the network performance monitoring condition further includes a receiving address set for one or more of the following: different network performance data statistical granularity, different network performance data category, different network performance data filtering condition. The demand device receives the network performance data sent by the management device at the receiving address.

[0218] For example, the demand device sets the same or different receiving address for different network performance data statistical granularity. For example, the receiving address of network performance data of cell-level granularity is address 1, the receiving address of network performance data of network slice-level granularity is address 2, and the like. Alternatively, the demand device sets the same or different receiving address for different network performance data category. For example, the receiving address of network performance data of capacity type is address A, the receiving address of network performance data of coverage type is address B, and the like. Alternatively, the demand device sets the same or different receiving address for different network performance data statistical granularity and different network performance data category. For example, the receiving address of network performance data of cell-level granularity and capacity type is address 3, and the like.

[0219] In this way, the demand device can directly distinguish the type of received network performance data through different receiving addresses.

[0220] In a possible implementation, the network performance monitoring condition further includes a statistical period set for one or more of the following: different network performance data statistical granularity, different network performance data category, different network performance data filtering condition. The demand device receives the network performance data sent by the management device according to the statistical period.

[0221] For example, the demand device sets the same or different statistical period for different network performance data statistical granularity. For example, the statistical period of network performance data of cell-level granularity is 5 minutes, the statistical period of network performance data of network slice-level granularity is 10 minutes, and the like. The demand device sets the same or different statistical period for different network performance data category. For example, the statistical period of network performance data of capacity type is 10 minutes, the statistical period of network performance data of coverage type is 20 minutes, and the like.

[0222] In a possible implementation, the network performance monitoring condition further includes a reporting period set for one or more of the following: different network performance data statistical granularity, different network performance data category, different network performance data filtering condition. The demand device receives the network performance data sent by the management device according to the reporting period.

[0223] For example, the demand device sets the same or different reporting period for different network performance data statistical granularity. For example, the reporting period of network performance data of cell level granularity is 5 minutes, and the reporting period of network performance data of network slice level granularity is 10 minutes, and the like. The demand device sets the same or different reporting period for different network performance data categories. For example, the reporting period of capacity type network performance data is 10 minutes, and the reporting period of coverage type network performance data is 20 minutes, and the like.

[0224] Correspondingly, if the network performance monitoring condition contains the statistical period, in the above S303, the management device determines the network performance data according to the network performance monitoring condition. Specifically, the management device determines the network performance data according to the network performance monitoring condition and according to the statistical period.

[0225] For example, the management device statistically analyzes the network performance data of the network performance statistical granularity according to the statistical period. In this way, the network performance data is periodically obtained, which meets the purpose of network performance monitoring and saves power consumption.

[0226] It can be understood that, in the above S305, the demand device receives the network performance data determined by the management device according to the statistical period.

[0227] Correspondingly, if the network performance monitoring condition contains the receiving address, in the above S304, the management device sends the network performance data to the demand device, and specifically, the management device sends the network performance data to the receiving address contained in the network performance monitoring condition corresponding to the demand device.

[0228] It can be understood that, in the above S305, the demand device can receive the network performance data sent by the management device at the receiving address, which prevents data loss.

[0229] Correspondingly, if the network performance monitoring condition contains the reporting period, in the above S304, the management device sends the network performance data to the demand device, and specifically, the management device sends the network performance data to the demand device according to the reporting period contained in the network performance monitoring condition.

[0230] It can be understood that, in the above S305, the demand device can receive the network performance data sent by the management device according to the reporting period, which saves power consumption.

[0231] Optionally, in the above S301, the demand device can send the request information to the management device through different interfaces, and the demand device can match the interface type through the type of the request information.

[0232] The request information is network performance management configuration request information, network performance intent request information, or network performance task management request information. The network performance management configuration request information is sent through a management configuration interface, the network performance intent request information is sent through an intent interface, and the network performance task management request information is sent through a task management interface.

[0233] In a possible implementation, the request information is network performance management configuration request information, and the network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model includes a network performance monitoring condition. As shown in Table 1 below, the network performance monitoring condition corresponds to an attribute name in the network performance management configuration model. After receiving the network performance management configuration request information, the management device can determine the network performance data to be monitored by reading the attribute name included in the network performance management configuration model carried by the network performance management configuration request information.

[0234] Table 1

[0235]

[0236] It should be noted that, in Table 1 above, M represents mandatory, T represents true, and F represents false. The network performance management configuration model described above can be a network performance management configuration model configured by adding a network performance monitoring condition based on an existing network performance management configuration model, and includes a network performance control object identifier, a state, file reporting indication information, or flow reporting indication information in the existing network performance management configuration model, which will not be described here.

[0237] The network performance data statistical granularity in Table 1 above is taken as an example for description. The attribute name is configured in the network performance configuration model, so the corresponding identifier of the qualifier is M, that is, the attribute is configured mandatorily. The network performance data statistical granularity attribute is readable and writable. The network performance data statistical granularity in the network performance configuration model will change according to the determined network performance monitoring condition, and is not constant. The network performance data statistical granularity is not public.

[0238] In a possible implementation, the request information is network performance intent request information, and the network performance intent request information carries a network performance intent model, and the network performance intent model includes a network performance monitoring condition. As shown in Table 2 below, an exemplary network performance intent model is given. The intent object in Table 2 is the corresponding network performance monitoring condition. After receiving the network performance intent request information, the management device can determine the network performance data to be monitored by reading the intent object included in the network performance intent model carried by the network performance intent request information.

[0239] Table 2

[0240]

[0241] It should be noted that the network performance intent model described above can be a network performance intent model configured based on an existing network performance intent model, adding a network performance monitoring condition, containing intent object identification, intent state and other information in the existing network performance intent model, which will not be described here.

[0242] In a possible implementation, the request information is network performance task management request information, and the network performance monitoring condition is carried in the network performance task management request information. After receiving the network performance task management request information, the management device can directly determine the network performance data to be monitored by reading the network performance monitoring condition contained therein.

[0243] It should be noted that the network performance task management request information described above can be network performance task management request information configured based on an existing network performance task management request, adding a network performance monitoring condition, containing management object type, management object identification, reporting mode, start time and end time, priority and other information carried in the existing network performance task management request information, which will not be described here.

[0244] The network performance monitoring method provided by the embodiments of the present application is described in detail above. Figure 3 and Figure 4 The network performance monitoring device provided by the embodiments of the present application is described in detail below. Figure 6 and Figure 7 The network performance monitoring device provided by the embodiments of the present application is described in detail below.

[0245] In a possible design, Figure 6 The structure of the network performance monitoring device provided by the embodiments of the present application is shown in Figure 1 . As shown in Figure 6 , the network performance monitoring device 600 includes a receiving module 601, a processing module 602 and a sending module 603. The network performance monitoring device 600 can be used to implement the functions of the management device involved in the above method embodiments. Among them, the network performance monitoring device 600 can be the management device itself, or a functional module or chip in the management device, or a device matched with the management device.

[0246] The receiving module 601 is configured to receive request information from the demand device. The request information is used to request network performance data. The request information carries a network performance monitoring condition.

[0247] Optionally, the network performance monitoring condition includes one or more of the following: network performance data statistical granularity, network performance data category, network performance data filtering condition.

[0248] The network performance data statistical granularity is used to indicate a granularity of the network performance data to be sent; the network performance data category is used to indicate a category of the network performance data to be sent; and the network performance data filtering condition is used to indicate a filtering condition to be met by the network performance data to be sent.

[0249] The processing module 602 is configured to determine the network performance data according to the network performance monitoring condition.

[0250] The network performance data meets the network performance monitoring condition.

[0251] The sending module 603 is configured to send the network performance data to the demand device.

[0252] In a possible implementation, the processing module 602 is specifically configured to perform one or more of the following according to the network performance data statistical granularity: collect network performance data of the network performance statistical granularity, statistically analyze the network performance data of the network performance statistical granularity, and query the network performance data of the network performance statistical granularity from a local database.

[0253] In a possible implementation, the processing module 602 is further configured to determine a network performance data name corresponding to the network performance data category.

[0254] The processing module 602 is specifically configured to perform one or more of the following according to the network performance data name: collect network performance data corresponding to the network performance data name, statistically analyze the network performance data corresponding to the network performance data name, and query the network performance data corresponding to the network performance data name from a local database.

[0255] In a possible implementation, the processing module 602 is specifically configured to perform one or more of the following according to the network performance data filtering condition: collect network performance data meeting the network performance data filtering condition, statistically analyze the network performance data meeting the network performance data filtering condition, and query the network performance data meeting the network performance data filtering condition from a local database.

[0256] In a possible implementation, the request information is network performance management configuration request information, network performance intent request information, or network performance task management request information.

[0257] Optionally, the network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model includes the network performance monitoring condition.

[0258] Optionally, the network performance intent request information carries a network performance intent model, and the network performance intent model includes the network performance monitoring condition.

[0259] Optionally, the network performance monitoring conditions can be included in the network performance task management request information.

[0260] In one possible implementation, the network performance monitoring conditions may also include one or more of the following: receiving address, statistical period, and reporting period.

[0261] The receiving address, statistical period, and reporting period are determined by the requesting device based on one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering conditions.

[0262] The sending module 603 is also used to send network performance data to the requesting device at the receiving address if the network performance monitoring conditions also include a receiving address.

[0263] The processing module 602 is also used to collect network performance data according to the statistical period if the network performance monitoring conditions also include a statistical period.

[0264] The sending module 603 is also used to send network performance data collected by the processing module 602 according to the statistical period to the requesting device if the network performance monitoring conditions also include a statistical period.

[0265] The sending module 603 is also used to send network performance data to the requesting device according to the reporting period if the network performance monitoring conditions also include a reporting period.

[0266] In one possible implementation, the granularity of network performance data statistics includes one or more of the following: region level, cell level, grid level, network element level, network slice level, subnetwork level, network slice service level, tenant level, and user level.

[0267] In one possible implementation, network performance data categories include one or more of the following: coverage, capacity, quality, handover, resources, users, services, performance measurements, key performance indicators (KPIs), signaling trace data, minimized drive test (MDT) data, analytics data, and customer perceived experience (QoE) data.

[0268] In one possible implementation, the network performance data filtering criteria include one or more of the following: network problem conditions, time range, network performance threshold range, and regional range.

[0269] Optional, Figure 6 The network performance monitoring device 600 shown may also include a storage module. Figure 6 (not shown in the image), this storage module stores programs or instructions. When the processing module 602 executes the program or instructions, it causes... Figure 6 The network performance monitoring device 600 shown can perform... Figure 3 or Figure 4The network performance monitoring method shown.

[0270] Figure 6 The processing module 602 involved in the network performance monitoring apparatus 600 shown can be implemented by a processor or a processor-related circuit component, and can be a processor or a processing unit. The receiving module 601 and the sending module 603 can also be integrated together, such as a transceiver module, implemented by a transceiver or a transceiver-related circuit component. The receiving module 601 is configured to receive the request information sent by the demand device. The sending module 603 is configured to send the network performance data to the demand device. The specific implementation of the receiving module 601 and the sending module 603 is not limited in the embodiment of the present application. The operations and / or functions of each module in the network performance monitoring apparatus 600 are respectively implemented to achieve Figure 3 or Figure 4 The corresponding flow of the network performance monitoring method shown is not described here for brevity.

[0271] Figure 6 The technical effects of the network performance monitoring apparatus 600 shown can refer to Figure 3 or Figure 4 The technical effects of the network performance monitoring method shown, which are not described here for brevity.

[0272] In yet another possible design, Figure 7 The structure of the network performance monitoring apparatus provided by the embodiment of the present application is shown in Figure 2 . As Figure 7 shown, the network performance monitoring apparatus 700 includes a sending module 701 and a receiving module 702. The network performance monitoring apparatus 700 can be used to implement the functions of the demand device involved in the above-mentioned method embodiments. The network performance monitoring apparatus 700 can be the demand device itself, or a functional module or chip in the demand device, or an apparatus matched with the demand device.

[0273] The sending module 701 is configured to send request information to the management device. The request information is used to request network performance data, and the request information carries a network performance monitoring condition.

[0274] Optionally, the network performance monitoring condition includes one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering condition.

[0275] The network performance data statistical granularity is used to indicate the granularity of the network performance data to be received; the network performance data category is used to indicate the category of the network performance data to be received; and the network performance data filtering condition is used to indicate the filtering condition that needs to be met by the network performance data to be received.

[0276] The receiving module 702 is configured to receive the network performance data from the management device.

[0277] The network performance data satisfies a network performance monitoring condition.

[0278] In a possible implementation, the receiving module 702 is further configured to receive a network performance monitoring condition.

[0279] Optionally, the network performance monitoring apparatus 700 further includes a processing module 703.

[0280] The receiving module 702 is further configured to receive a network performance optimization requirement or a network performance optimization intention. The network performance optimization requirement or the network performance optimization intention is used for optimizing network performance.

[0281] The processing module 703 is further configured to determine the network performance monitoring condition according to the network performance optimization requirement or the network performance optimization intention.

[0282] In a possible implementation, the request information is network performance management configuration request information, network performance intention request information, or network performance task management request information.

[0283] Optionally, the network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model includes the network performance monitoring condition.

[0284] Optionally, the network performance intention request information carries a network performance intention model, and the network performance intention model includes the network performance monitoring condition.

[0285] Optionally, the network performance task management request information carries the network performance monitoring condition.

[0286] In a possible implementation, the network performance monitoring condition further includes one or more of the following: a receiving address, a statistical period, and a reporting period.

[0287] The receiving address, the statistical period, and the reporting period are determined by the processing module 703 according to one or more of the following: a network performance data statistical granularity, a network performance data category, and a network performance data filtering condition.

[0288] The receiving module 702 is further configured to receive, if the network performance monitoring condition further includes the receiving address, network performance data sent by the management device at the receiving address.

[0289] The receiving module 702 is further configured to receive, if the network performance monitoring condition further includes the statistical period, network performance data sent by the management device and counted according to the statistical period.

[0290] The receiving module 702 is further configured to receive the network performance data sent by the management device according to the reporting period if the network performance monitoring condition further comprises the reporting period.

[0291] In a possible implementation, the network performance data statistical granularity comprises one or more of the following: a region level, a cell level, a grid level, a network element level, a network slice level, a sub-network level, a network slice service level, a tenant level, and a user level.

[0292] In a possible implementation, the network performance data category comprises one or more of the following: a coverage category, a capacity category, a quality category, a handover category, a resource category, a user category, a service category, a performance measurement quantity, a key performance indicator (KPI), signaling trace data, minimization of drive test (MDT) data, analysis data, and customer perception experience (QoE) data.

[0293] In a possible implementation, the network performance data filtering condition comprises one or more of the following: a network problem condition, a time range, a network performance threshold range, and a region range.

[0294] Optionally, Figure 7 The network performance monitoring apparatus 700 shown in the figure can further comprise a storage module (not shown in the figure), which stores programs or instructions. When the processing module 703 executes the programs or instructions, the network performance monitoring apparatus 700 is enabled to Figure 7 The network performance monitoring apparatus 700 shown in the figure can execute the network performance monitoring method. Figure 7 The network performance monitoring apparatus 700 shown in the figure can execute the network performance monitoring method. Figure 3 or Figure 4 The network performance monitoring method.

[0295] Figure 7 The processing module 703 involved in the network performance monitoring apparatus 700 shown in the figure can be implemented by a processor or a processor-related circuit component, and can be a processor or a processing unit. The sending module 701 and the receiving module 702 can also be integrated together, such as a transceiver module, implemented by a transceiver or a transceiver-related circuit component. The sending module 701 is configured to send the request information to the management device. The receiving module 702 is configured to receive the network performance sent by the management device. The specific implementation of the sending module 701 and the receiving module 702 is not limited in the embodiments of the present application. The operations and / or functions of each module in the network performance monitoring apparatus 700 are respectively used to realize the corresponding processes of the network performance monitoring method. Figure 3 or Figure 4 The network performance monitoring method.

[0296] Figure 7 The technical effects of the network performance monitoring apparatus 700 shown in the figure can refer to the technical effects of the network performance monitoring method. Figure 3 or Figure 4 The network performance monitoring method.

[0297] Figure 8 A structural diagram of a network performance monitoring system is provided in the embodiments of the present application. As shown in Figure 8 the network performance monitoring system 800 includes a demand device 801 and a management device 802.

[0298] The demand device 801 is configured to send request information to the management device 802. The request information is used to request network performance data, and the request information carries network performance monitoring conditions.

[0299] Optionally, the network performance monitoring conditions include one or more of the following: network performance data statistical granularity, network performance data category, and network performance data filtering condition.

[0300] The network performance data statistical granularity is used to indicate the granularity of the network performance data to be received by the demand device 801; the network performance data category is used to indicate the category of the network performance data to be received by the demand device 801; and the network performance data filtering condition is used to indicate the filtering condition to be met by the network performance data to be received by the demand device 801.

[0301] The management device 802 is configured to receive the request information from the demand device 801.

[0302] The management device 802 is further configured to determine network performance data according to the network performance monitoring conditions. The network performance data meets the network performance monitoring conditions.

[0303] The management device 802 is further configured to send the network performance data to the demand device 801.

[0304] The demand device 801 is further configured to receive the network performance data from the management device 802.

[0305] It can be understood that the network performance monitoring system 800 can include more or fewer components than those shown, or can combine some components, or split some components, or arrange different components. The components shown can be implemented in hardware, software, or a combination of software and hardware. All related content of each step involved in the above method embodiments can be cited to the function description of the corresponding components, which will not be repeated here.

[0306] The embodiments of the present application also provide a chip system, as shown in Figure 9As shown, the chip system includes at least one processor 901 and at least one interface circuit 902. The processor 901 and the interface circuit 902 can be interconnected by a line. For example, the interface circuit 902 can be used to receive signals from other devices. For another example, the interface circuit 902 can be used to send signals to other devices (e.g., the processor 901). Illustratively, the interface circuit 902 can read instructions stored in a memory and send the instructions to the processor 901. When the instructions are executed by the processor 901, the network performance monitoring device can be caused to perform various steps in the network performance monitoring method in the above embodiments. Of course, the chip system can also include other discrete devices, which are not limited in the embodiments of the present application.

[0307] The embodiments of the present application also provide a chip system, which includes: a processor, the processor being coupled with a memory, the memory being used to store programs or instructions, when the programs or instructions are executed by the processor, the chip system implements the method in any of the method embodiments.

[0308] Optionally, the processor in the chip system can be one or more. The processor can be implemented by hardware or software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented by software, the processor can be a general-purpose processor, which is implemented by reading software codes stored in a memory.

[0309] Optionally, the memory in the chip system can also be one or more. The memory can be integrated with the processor or set separately from the processor, which is not limited in the present application. Illustratively, the memory can be a non-transient processor, for example, a read-only memory (ROM), which can be integrated with the processor on the same chip or set on different chips, which is not limited in the present application.

[0310] For example, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD) or other integrated chip.

[0311] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits of hardware in the processor or instructions in the form of software. The method steps disclosed in combination with the embodiments of the present application can be directly embodied as hardware processor execution, or executed by a combination of hardware and software modules in the processor.

[0312] Embodiments of the present application also provide a storage medium for storing instructions for the above communication device.

[0313] Embodiments of the present application also provide a computer readable storage medium having computer instructions stored therein, when the computer instructions run on a server, the server executes the above related method steps to implement the network performance monitoring method in the above embodiments.

[0314] Embodiments of the present application also provide a computer program product, when the computer program product runs on a computer, the computer executes the above related steps to implement the network performance monitoring method in the above embodiments.

[0315] In addition, embodiments of the present application also provide a device, which can be specifically a component or a module. The device can include one or more processors and memories connected thereto. The memory is configured to store computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the device executes the network performance monitoring method in the above method embodiments.

[0316] The device, the computer readable storage medium, the computer program product or the chip provided by the embodiments of the present application are used for executing the corresponding method provided above, and thus the beneficial effects achieved thereby can refer to the beneficial effects of the corresponding method provided above, which will not be repeated here.

[0317] The steps of the methods or algorithms described in connection with the present disclosure can be implemented in hardware, or as software executed by a processor. The software instructions can be stored in a memory, such as a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disk, a floppy disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can be a component of the processor. Suitable processors for the execution of instructions can be provided in an ASIC.

[0318] Those skilled in the art can clearly understand the specific working process of the above-described system, device and unit by referring to the corresponding process in the foregoing method embodiments, which will not be described here.

[0319] In the several embodiments provided by the present application, it should be understood that the disclosed method can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is merely a logical function division. There can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection between the units can be indirect coupling or communication connection through some interfaces, modules or units, and can be electrical, mechanical or in other forms.

[0320] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0321] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present alone, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0322] The integrated unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program code storage media.

[0323] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or replacements within the technical scope disclosed in the present application should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A method of network performance monitoring, characterized by, The method comprises: The management device receives request information from the demand device; the request information is used for requesting network performance data; the request information carries network performance monitoring conditions; the network performance monitoring conditions comprise network performance data statistical granularity and one or more of the following: network performance data categories, network performance data filtering conditions; the network performance data statistical granularity is used for indicating the granularity of the network performance data to be sent; the network performance data categories are used for indicating the categories of the network performance data to be sent; the network performance data filtering conditions are used for indicating the filtering conditions to be met by the network performance data to be sent; The management device determines the network performance data according to the network performance monitoring conditions; wherein the network performance data meets the network performance monitoring conditions; The management device sends the network performance data to the demand device; The network performance data statistical granularity comprises network slice level; The network performance data categories comprise one or more of the following: coverage category, capacity category, quality category, switching category, resource category, service category, signaling tracking data, minimization of drive test data, analysis data, and user experience quality data; The network performance data filtering conditions comprise one or more of the following: network problem conditions, time range, and area range.

2. The method of claim 1, wherein, The network performance monitoring conditions comprise the network performance data statistical granularity; The management device determines the network performance data according to the network performance monitoring conditions, comprising: The management device performs one or more of the following according to the network performance data statistical granularity: collecting network performance data of the network performance statistical granularity, statistically analyzing network performance data of the network performance statistical granularity, and querying network performance data of the network performance statistical granularity in a local database.

3. The method of claim 1, wherein, The network performance monitoring conditions comprise the network performance data categories; The management device determines the network performance data according to the network performance monitoring conditions, comprising: The management device determines network performance data names corresponding to the network performance data categories; The management device performs one or more of the following according to the network performance data names: collecting network performance data corresponding to the network performance data names, statistically analyzing network performance data corresponding to the network performance data names, and querying network performance data corresponding to the network performance data names in a local database.

4. The method of claim 1, wherein, The network performance monitoring conditions comprise the network performance data filtering conditions; The management device determines the network performance data according to the network performance monitoring conditions, comprising: The management device performs one or more of the following according to the network performance data filtering conditions: collecting network performance data meeting the network performance data filtering conditions, statistically analyzing network performance data meeting the network performance data filtering conditions, and querying network performance data meeting the network performance data filtering conditions in a local database.

5. The method according to any one of claims 1 to 4, characterized in that, The request information is network performance management configuration request information, network performance intent request information, or network performance task management request information; The network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model includes the network performance monitoring condition. The network performance intention request information carries a network performance intention model, and the network performance intention model includes the network performance monitoring condition. The network performance task management request information carries the network performance monitoring condition.

6. A network performance monitoring method characterized by, The method comprises: The demand device sends request information to the management device, wherein the request information is used to request network performance data, and the request information carries a network performance monitoring condition; the network performance monitoring condition includes a network performance data statistical granularity and one or more of the following: a network performance data category, a network performance data filtering condition; the network performance data statistical granularity is used to indicate the granularity of the network performance data to be received; the network performance data category is used to indicate the category of the network performance data to be received; and the network performance data filtering condition is used to indicate the filtering condition that needs to be met by the network performance data to be received; The demand device receives the network performance data from the management device, and the network performance data meets the network performance monitoring condition; The network performance data statistical granularity includes a network slice level. The network performance data category includes one or more of the following: a coverage category, a capacity category, a quality category, a handover category, a resource category, a service category, signaling trace data, minimization of drive test data, analysis data, and user experience quality data. The network performance data filtering condition includes one or more of the following: a network problem condition, a time range, and a region range.

7. The method of claim 6, wherein, Before the demand device sends the request information to the management device, the method further comprises: The demand device receives the network performance monitoring condition; Alternatively, The demand device receives a network performance optimization demand or a network performance optimization intention; wherein the network performance optimization demand or the network performance optimization intention is used to optimize network performance; The demand device determines the network performance monitoring condition according to the network performance optimization demand or the network performance optimization intention.

8. A network performance monitoring method characterized by, The method comprises: The demand device sends request information to the management device, wherein the request information is used to request network performance data, and the request information carries a network performance monitoring condition; the network performance monitoring condition includes a network performance data statistical granularity and one or more of the following: a network performance data category, a network performance data filtering condition; the network performance data statistical granularity is used to indicate the granularity of the network performance data to be received by the demand device; the network performance data category is used to indicate the category of the network performance data to be received by the demand device; and the network performance data filtering condition is used to indicate the filtering condition that needs to be met by the network performance data to be received by the demand device; The management device receives the request information from the demand device; The management device determines the network performance data according to the network performance monitoring condition, wherein the network performance data meets the network performance monitoring condition; The management device sends the network performance data to the demand device; The demand device receives the network performance data from the management device; The network performance data statistical granularity comprises a network slice level; The network performance data categories comprise one or more of the following: coverage category, capacity category, quality category, handover category, resource category, service category, signaling tracking data, minimization of drive test data, analysis data, and user experience quality data; The network performance data filtering conditions comprise one or more of the following: network problem condition, time range, and area range.

9. A network performance monitoring apparatus, characterized by, The apparatus comprises a receiving module, a processing module, and a sending module; The receiving module is configured to receive request information from a demand device, wherein the request information is used to request network performance data, and the request information carries network performance monitoring conditions, wherein the network performance monitoring conditions comprise network performance data statistical granularity and one or more of the following: network performance data categories and network performance data filtering conditions, the network performance data statistical granularity is used to indicate the granularity of network performance data to be sent, the network performance data categories are used to indicate the categories of network performance data to be sent, and the network performance data filtering conditions are used to indicate filtering conditions that need to be met by network performance data to be sent; The processing module is configured to determine the network performance data according to the network performance monitoring conditions, wherein the network performance data meets the network performance monitoring conditions; The sending module is configured to send the network performance data to the demand device; The network performance data statistical granularity comprises a network slice level; The network performance data categories comprise one or more of the following: coverage category, capacity category, quality category, handover category, resource category, service category, signaling tracking data, minimization of drive test data, analysis data, and user experience quality data; The network performance data filtering conditions comprise one or more of the following: network problem condition, time range, and area range.

10. The apparatus of claim 9, wherein The processing module is specifically configured to perform one or more of the following according to the network performance data statistical granularity: collect network performance data of the network performance statistical granularity, statistically analyze network performance data of the network performance statistical granularity, and query network performance data of the network performance statistical granularity in a local database.

11. The apparatus of claim 9, wherein The processing module is further configured to determine network performance data names corresponding to the network performance data categories; The processing module is specifically configured to perform one or more of the following according to the network performance data names: collect network performance data corresponding to the network performance data names, statistically analyze network performance data corresponding to the network performance data names, and query network performance data corresponding to the network performance data names in a local database.

12. The apparatus of claim 9, wherein The processing module is specifically configured to perform one or more of the following according to the network performance data screening condition: collecting network performance data satisfying the network performance data screening condition, statistically analyzing the network performance data satisfying the network performance data screening condition, and querying the local database for the network performance data satisfying the network performance data screening condition.

13. The device of any of claims 9-12, wherein, The request information is network performance management configuration request information, network performance intention request information, or network performance task management request information. The network performance management configuration request information carries a network performance management configuration model, and the network performance management configuration model contains the network performance monitoring condition. The network performance intention request information carries a network performance intention model, and the network performance intention model contains the network performance monitoring condition. The network performance task management request information carries the network performance monitoring condition.

14. A network performance monitoring apparatus, characterized by, The apparatus includes a sending module and a receiving module. The sending module is configured to send request information to a management device, wherein the request information is used to request network performance data, and the request information carries a network performance monitoring condition; the network performance monitoring condition includes a network performance data statistical granularity and one or more of the following: a network performance data statistical granularity, a network performance data category, and a network performance data screening condition; the network performance data statistical granularity is used to indicate the granularity of network performance data to be received; the network performance data category is used to indicate the category of network performance data to be received; and the network performance data screening condition is used to indicate a screening condition that needs to be met by network performance data to be received. The receiving module is configured to receive the network performance data from the management device, wherein the network performance data meets the network performance monitoring condition. The network performance data statistical granularity includes a network slice level. The network performance data category includes one or more of the following: a coverage category, a capacity category, a quality category, a handover category, a resource category, a service category, signaling trace data, minimization of drive test data, analysis data, and user experience quality data. The network performance data screening condition includes one or more of the following: a network problem condition, a time range, and a region range.

15. The apparatus of claim 14, wherein The receiving module is further configured to receive the network performance monitoring condition. Alternatively, the apparatus further includes a processing module. The receiving module is further configured to receive network performance optimization demand or network performance optimization intention, wherein the network performance optimization demand or the network performance optimization intention is used to optimize network performance. The processing module is further configured to determine the network performance monitoring condition according to the network performance optimization demand or the network performance optimization intention.

16. A network performance monitoring system, characterized by The system includes a demand device and a management device. The requirement device is configured to: send request information to the management device, wherein the request information is used to request network performance data, and the request information carries network performance monitoring conditions; the network performance monitoring conditions comprise network performance data statistical granularity and one or more of the following: network performance data categories, network performance data filtering conditions; the network performance data statistical granularity is used to indicate the granularity of the network performance data to be received by the requirement device; the network performance data categories are used to indicate the categories of the network performance data to be received by the requirement device; and the network performance data filtering conditions are used to indicate filtering conditions to be met by the network performance data to be received by the requirement device; The management device is configured to: receive the request information from the requirement device; determine the network performance data according to the network performance monitoring conditions, wherein the network performance data meets the network performance monitoring conditions; and send the network performance data to the requirement device. The requirement device is further configured to: receive the network performance data from the management device. The network performance data statistical granularity comprises network slice level. The network performance data categories comprise one or more of the following: coverage category, capacity category, quality category, switching category, resource category, service category, signaling tracking data, minimization of drive test data, analysis data, and user experience quality data. The network performance data filtering conditions comprise one or more of the following: network problem condition, time range, and area range.

17. A management device comprising a memory, a processor, and a program stored on the memory and executable on the processor, wherein The processor implements the network performance monitoring method in any of claims 1-5 when executing the program.

18. A demand device comprising a memory, a processor, and a program stored on the memory and executable on the processor, wherein, The processor implements the network performance monitoring method in claim 6 or 7 when executing the program.

19. A network performance monitoring system, characterized by The management device in claim 17, and the requirement device in claim 18.

20. A computer-readable storage medium, characterized in that, The computer program product comprises computer instructions, which, when executed on an apparatus, cause the apparatus to perform the network performance monitoring method in any of claims 1-5, or the network performance monitoring method in claim 6 or 7.

21. A computer program product, characterised in that, The computer program product, when executed on an apparatus, causes the apparatus to perform the network performance monitoring method in any of claims 1-5, or the network performance monitoring method in claim 6 or 7.

Images