Service quality verification method, device, storage medium and electronic device

Abstract

The present application discloses a method, device, storage medium and electronic device for verifying quality of service. The method includes: a quality of service QoS verification server receives a verification request forwarded by a third-party server; when the verification request passes the verification, the communication quality parameters are verified to obtain a QoS detection result; the QoS detection result is sent to a third-party server, and an evaluation result returned by the third-party server is received; and a processing strategy corresponding to the evaluation result is executed according to the evaluation result. The present application solves the technical problem that the communication quality on the application side and the communication quality on the network side cannot be linked due to the influence of the actual communication environment, human failures, dynamic policy changes of the business, etc. in actual mobile communication services; the third-party service party cannot dynamically match and adjust the network communication quality parameter configuration based on the communication quality on the application side, and the operator cannot provide the third-party service party with QoS guarantee services based on the actual needs of the service party.

Description

Technical Field

[0001] The present application relates to the field of mobile communication services, and in particular to a service quality verification method, device, storage medium and electronic device. Background Art

[0002] At present, the mobile communications field has realized the opening of QoS (Quality of Service, QoS) capabilities to third-party service providers (Third Party, 3rd Party). This capability is to open the QoS configuration and policies within the mobile communication network to third-party service providers through the setting of standard application programming interfaces (Application Programming Interface, API). Third-party service providers can adjust and set QoS network parameters according to their needs to ensure the quality of third-party services. At the same time, operators can add value to their existing mobile communication networks based on this method.

[0003] However, in actual mobile communication services, due to the influence of the actual communication environment, human failures, dynamic business policy changes, etc., there are currently the following key problems: the business / application layer cannot know the current actual business communication quality, and cannot submit a network QoS control application to the mobile communication network from the perspective of the actual business communication quality; the actual QoS_APP on the business / application side does not match the QoS_NET configured at the network layer; limited by the confidentiality requirements of the mobile network, the business / application layer cannot know from the mobile network side whether the current network layer configured QoS_NET is suitable for the current business.

[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0005] The embodiments of the present application provide a service quality verification method, device, storage medium and electronic device to at least solve the technical problems that the communication quality on the application side and the communication quality on the network side cannot be linked due to the influence of the actual communication environment, human failures, dynamic policy changes of the service, etc. in actual mobile communication services; the third-party service party cannot dynamically match and adjust the network communication quality parameter configuration based on the application side communication quality; and the operator cannot provide the third-party service party with QoS guarantee services based on the actual needs of the service party.

[0006] According to one aspect of an embodiment of the present application, a service quality verification method is provided, including: a service quality QoS verification server receives a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of a target client terminal and a communication quality parameter corresponding to the target identifier, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate; when the verification request passes the verification, verifying the communication quality parameter to obtain a QoS detection result, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the target client terminal; sending the QoS detection result to the third-party server, and receiving an evaluation result returned by the third-party server, wherein the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device; and executing a processing strategy corresponding to the evaluation result according to the evaluation result.

[0007] Optionally, the communication quality parameters are verified to obtain QoS detection results, including: obtaining a comparison parameter coefficient corresponding to the communication quality parameter; determining a first comparison parameter corresponding to the target client based on the communication quality parameter and the comparison parameter coefficient; determining a target interval to which the first comparison parameter belongs, and calling the QoS configuration policy corresponding to the target interval as the QoS target configuration policy.

[0008] Optionally, determining the target interval to which the first comparison parameter belongs includes: obtaining the second comparison parameters corresponding to each of the multiple client terminals other than the target client terminal; sorting the first comparison parameter and the second comparison parameter based on a predetermined numerical order to obtain a sorting result; dividing the sorting result into a preset number of intervals, wherein the multiple intervals include: the target interval.

[0009] Optionally, determining a first comparison parameter corresponding to the target client based on the communication quality parameter and the comparison parameter coefficient includes: obtaining the comparison parameter coefficient corresponding to each communication quality parameter; determining the product of each communication quality parameter and its corresponding comparison parameter coefficient to obtain multiple products; and summing the multiple products to obtain the first comparison parameter corresponding to the target client.

[0010] Optionally, different processing strategies are executed according to the evaluation results, including: when the evaluation results indicate that the QoS target configuration strategy can be executed based on the core network device, the QoS target configuration strategy is sent to the core network device to execute the QoS target configuration strategy.

[0011] According to another aspect of an embodiment of the present application, a service quality verification method is also provided, including: a third-party server receives a verification request from a target client terminal, wherein the verification request carries at least a target identifier and communication quality parameters of the target client terminal, wherein the communication quality parameters include at least one of the following: service delay duration, packet loss rate; performing authentication verification on the verification request, and if the authentication verification of the verification request passes, returning a verification response to the target client terminal, and forwarding the verification request to a service quality QoS verification server; receiving a QoS detection result returned by the QoS verification server, wherein the QoS verification server is used to analyze the communication quality parameters to obtain a QoS detection result corresponding to the target identifier, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the target client terminal.

[0012] According to another aspect of an embodiment of the present application, a service quality verification method is also provided, including: a client terminal collects end-to-end application data; determines communication quality parameters based on the application data, wherein the communication quality parameters include at least one of the following: service delay duration, packet loss rate; sends a verification request to a third-party server; wherein the verification request carries at least a target identifier and communication quality parameters of the client terminal, wherein the third-party server is used to forward the verification request to a service quality QoS verification server, and the QoS verification server is used to analyze the communication quality parameters to obtain a QoS detection result corresponding to the target identifier, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the client terminal; receives a response result returned by the third-party server, wherein the response result is used to indicate that the core network device has successfully executed the QoS target configuration policy.

[0013] Optionally, after receiving the QoS detection results returned by the QoS verification server, the above method also includes: evaluating the QoS detection results to obtain evaluation results, and sending the evaluation results to the QoS verification server, wherein the evaluation results are used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device.

[0014] According to another aspect of an embodiment of the present application, a service quality verification device is also provided, including: a receiving module, used for a service quality QoS verification server to receive a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of a target client terminal and a communication quality parameter corresponding to the target identifier; a verification device, used to verify the communication quality parameters to obtain a QoS detection result; a sending module, used to send the QoS detection result to a third-party server; and an execution module, used to execute a processing strategy corresponding to the evaluation result according to the evaluation result.

[0015] According to another aspect of an embodiment of the present application, a non-volatile storage medium is further provided, the storage medium including a stored program, wherein when the program is running, any service quality verification method of the device where the storage medium is located is controlled.

[0016] According to another aspect of an embodiment of the present application, there is also provided an electronic device comprising: a processor; and a memory for storing processor executable instructions; wherein the processor is configured to execute instructions to implement any one of the quality of service verification methods.

[0017] In an embodiment of the present application, a QoS verification algorithm is adopted, and a verification request forwarded by a third-party server is received through a service quality QoS verification server; when the verification request passes the verification, the communication quality parameters are verified to obtain a QoS detection result; the QoS detection result is sent to a third-party server, and an evaluation result returned by the third-party server is received; a processing strategy corresponding to the evaluation result is executed according to the evaluation result, thereby achieving the purpose of providing a QoS verification method and business mode for operators and adding value to the operator's 5G network, thereby achieving a technical effect of providing a third-party service party with a method for dynamically adjusting the network QoS based on the application QoS situation and application requirements to meet the personalized needs of third-party services, and further solving the problem that the communication quality on the application side and the communication quality on the network side cannot be linked due to the actual communication environment, human failures, dynamic business policy changes, etc. in actual mobile communication services; the third-party service party cannot dynamically match and adjust the network communication quality parameter configuration based on the application side communication quality; the operator cannot provide the third-party service party with QoS guarantee service technical problems based on the actual needs of the service party. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0019] Figure 1 is a flow chart of an optional service verification method according to an embodiment of the present application;

[0020] Figure 2 is a schematic diagram of an optional QoS verification method architecture according to an embodiment of the present application;

[0021] Figure 3 is a business flow chart of an optional QoS verification method according to an embodiment of the present application;

[0022] Figure 4 is a flowchart of another optional service verification method according to an embodiment of the present application;

[0023] Figure 5 is a flowchart of another optional service verification method according to an embodiment of the present application;

[0024] Figure 6 A schematic diagram of the structure of an optional service quality inspection device according to an embodiment of the present application;

[0025] Figure 7 It is a schematic block diagram of an optional example electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] According to an embodiment of the present application, a service quality verification method embodiment is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0029] Figure 1 The service quality verification method according to the embodiment of the present application is as follows: Figure 1 As shown, the method comprises the following steps:

[0030] Step S102, the quality of service QoS verification server receives a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of the target client terminal and a communication quality parameter corresponding to the target identifier, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate.

[0031] Step S104: if the verification request passes the verification, the communication quality parameters are verified to obtain a QoS detection result, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the target client terminal.

[0032] Step S106: Send the QoS detection result to the third-party server, and receive the evaluation result returned by the third-party server, wherein the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device.

[0033] Step S108: executing a processing strategy corresponding to the evaluation result according to the evaluation result.

[0034] Optionally, the communication quality parameters are verified to obtain QoS detection results, which can be achieved by the following method: obtaining a comparison parameter coefficient corresponding to the communication quality parameter; determining a first comparison parameter corresponding to the target client based on the communication quality parameter and the comparison parameter coefficient; determining a target interval to which the first comparison parameter belongs, and calling the QoS configuration policy corresponding to the target interval as the QoS target configuration policy.

[0035] In some optional embodiments of the present application, determining the target interval to which the first comparison parameter belongs includes the following steps: first, obtaining the second comparison parameters corresponding to each of the multiple client terminals other than the target client terminal; then, sorting the first comparison parameter and the second comparison parameter based on a predetermined numerical value order to obtain a sorting result; finally, dividing the sorting result into a preset number of intervals, wherein the multiple intervals include: a target interval.

[0036] In some embodiments of the present application, determining a first comparison parameter corresponding to a target client based on a communication quality parameter and a comparison parameter coefficient includes the following steps: first, obtaining the comparison parameter coefficient corresponding to each communication quality parameter; then determining the product of each communication quality parameter and its corresponding comparison parameter coefficient to obtain multiple products; and finally, summing the multiple products to obtain the first comparison parameter corresponding to the target client.

[0037] It is easy to notice that, when the evaluation result indicates that the QoS target configuration policy can be executed based on the core network device, the QoS target configuration policy is sent to the core network device to execute the QoS target configuration policy.

[0038] For example, the communication quality parameters are verified to obtain the QoS detection results, which can be achieved through the QoS verification algorithm. First, based on the agreement with the third-party service provider, the QoS verification algorithm selects the QoS_APP comparison parameter coefficient N (n1, n2.....n n ), generally, the comparison parameter coefficient N is set based on the business requirements of the third-party business. The specific steps are as follows: Step 1, calculate the QoS_APP comparison parameter X QoS_APP， X QoS_APP =n 1* Latency_APP+n2*Lost_APP+.....n n *X n； Step 2: Count X users X QoS_APP And sort by value, where the sorting vector is: X QoS_APP (UE1),X QoS_APP (UE2)....,X QoS_APP (UEx), where X QoS_APP (UE1) <X QoS_APP (UE2).... <X QoS_APP (UEx) The third step is to obtain the value interval of user QoS_APP. Each interval has X / M users, where interval 1 is represented by X QoS_APP (UE1),....,X QoS_APP (UE X / M ); interval 2 is represented by X QoS_APP (UE X / M ),....,X QoS_APP (UE 2X / M );....;Interval M is represented by X QoS_APP (UE (X-X / M) )....X QoS_APP (UE X ); Step 4: Match QoS_NET_Policy for the user according to the interval to which the user belongs. For example, UE1 belongs to interval 1, and interval 1 matches QoS_NET_Policy. M， The matching rule is preset based on the matching rule expected by the third-party service provider, and the M QoS_NET_Policies correspond one-to-one to the interval to which the user belongs.

[0039] Through the above steps, the service quality QoS verification server can receive the verification request forwarded by the third-party server; when the verification request passes the verification, the communication quality parameters are verified to obtain the QoS detection result; the QoS detection result is sent to the third-party server, and the evaluation result returned by the third-party server is received; according to the evaluation result, the processing strategy corresponding to the evaluation result is executed, thereby achieving the purpose of providing a QoS verification method and business mode for operators and adding value to the operator's 5G network, thereby achieving a technical effect of providing a third-party service party with a way to dynamically adjust the network QoS based on the application QoS situation and application requirements to meet the personalized needs of third-party services, and further solving the problem that the communication quality on the application side and the communication quality on the network side cannot be linked due to the actual communication environment, human failures, dynamic business policy changes, etc. in actual mobile communication services; the third-party service party cannot dynamically match and adjust the network communication quality parameter configuration based on the application side communication quality; the operator cannot provide the third-party service party with the technical problem of QoS guarantee service based on the actual needs of the service party.

[0040] Figure 2 Schematic diagram of the QoS verification method architecture in an optional embodiment of the present application. Figure 2 As shown, in this embodiment, the functional entities include a terminal QoS verification APP client, a QoS verification platform, a third-party service server AF, and a 5GC network device (such as PCF). First, the UE side includes a Qos verification APP, whose main functions are to collect application data, perform QoS_APP calculations on the collected data, and perform basic communication access authentication; the QoS verification platform includes a basic communication access authentication module, a QoS verification API module, a QoS verification calculation module, a QoS_NET_Policy pre-storage module, and a QoS_APP storage module.

[0041] For example, the main functions of the terminal QoS verification APP client include: collecting end-to-end application data of user services on the terminal side; calculating the actual service QoS of the user (denoted as QoS_APP), where QoS_APP is the QoS verification APP client on the terminal side based on the user's application data, and statistically obtains the user's actual communication quality. It is a set of data vectors, including a set of communication quality parameters, such as end-to-end service delay Latency_APP, packet loss rate Lost_APP, wireless quality Radio_APP, which can be expressed as QoS_APP (Latency_APP, Lost_APP, Radio_APP...., Xn); passing QoS_APP to the third-party server AF.

[0042] Furthermore, the main functions of the QoS verification platform are: authenticating the service request of the third-party server; QoS verification API, opening the QoS verification function to the third-party service party in the form of standard API encapsulation; storing M QoS_NET_Policies, QoS_NET_Policy corresponds to the policy template for executing QoS_NET parameters on the mobile network side, expressed as QoS_NET_Policy (QoS_NET_Policy1, ..., QoS_NET_PolicyM); storing the QoS_APP of X user UEs, QoS_APP (Latency_APP, Lost_APP, Radio_APP...., Xn); based on the analysis of the QoS proofreading algorithm, the QoS verification platform compares QoS_APP with QoS_NET, guides and adjusts the QoS_NET settings according to the QoS_APP, and applies to the mobile communication network to reselect and configure QoS_NET; communicates with 5GC to execute QoS_NET_Policy configuration.

[0043] Figure 3 is a business flow chart of a QoS verification method according to an optional embodiment of the present application, such as Figure 3 As shown, the process mainly includes:

[0044] 1) The UE terminal QoS verification platform sends a QoS_Verification_Request request to the third-party service server AF, which carries the UE identifier (UEID), which is a UE identifier recognizable by the mobile communication network, such as the user communication number, etc. If the QoS verification APP can only provide a service identifier, the QoS verification platform needs to provide a mapping between the UE service identifier and the communication UE identifier.

[0045] 2) The third-party service server AF authenticates the request and returns a QoS_Verification_Response.

[0046] 3) The third-party service server AF sends a QoS_Verification_Request request to the QoS verification platform, and performs authentication verification on the request.

[0047] 4) The QoS verification platform authenticates the request and returns a QoS_Verification_Response.

[0048] 5) The QoS verification APP collects QoS_APP data. QoS_APP is a set of data vectors, including a set of communication quality parameters, such as end-to-end service delay Latency_APP, packet loss rate Lost_APP, and wireless quality Radio_APP, which can be expressed as QoS_APP (Latency_APP, Lost_APP, Radio_APP...., Xn).

[0049] 6) The QoS verification APP sends QoS_APP, UEID to AF through QoS_APP_Delivery, and AF sends it to the QoS verification platform.

[0050] 7) QoS Verification Platform Based on QoS proofreading algorithm analysis, the QoS Verification Platform matches QoS_APP with pre-stored QoS_NET_Policy, and guides and adjusts QoS_NET settings according to QoS_APP.

[0051] Among them, the QoS verification algorithm applied by the QoS verification platform is:

[0052] ① Based on the agreement with the third-party service provider, the QoS verification algorithm selects a set of QoS_APP comparison parameter coefficients N (n1, n2.....nn). Generally, the comparison parameter coefficient N is set based on the business requirements of the third-party service.

[0053] ② Calculate the QoS_APP comparison parameter XQoS_APP. XQoS_APP=n1*Latency_APP+n2*Lost_APP+.....nn*Xn

[0054] ③ Count X users XQoS_APP and sort them by value. The sorting vector is XQoS_APP(UE1),XQoS_APP(UE2)....,XQoS_APP(UEx), where XQoS_APP(UE1) <XQoS_APP(UE2)....<XQoS_APP(UEx)

[0055] ④ Obtain the numerical range of user QoS_APP, with X / M users in each range.

[0056] Interval 1, XQoS_APP(UE1),....,XQoS_APP(UEX / M)

[0057] Interval 2, XQoS_APP(UEX / M),....,XQoS_APP(UE2X / M) ....

[0059] Interval M, XQoS_APP(UE(XX / M))....XQoS_APP(UEX)

[0060] ⑤ According to the interval to which the user belongs, match the QoS_NET_Policy for the user. For example, UE1 belongs to interval 1, and interval 1 matches QoS_NET_Policy1.

[0061] The matching rule is preset by a third-party service provider, and the M QoS_NET_Policies correspond one-to-one to the interval to which the user belongs.

[0062] 8) After the QoS verification platform has completed the comparison, the QoS verification result (for example, the interval number of the newly matched user and other parameters that can represent the QoS verification result) is returned to the AF through QoS_Verification_Result.

[0063] 9) AF evaluates the QoS verification result, and its evaluation method is a third-party internal business logic, which is not within the scope of this patent.

[0064] 10) AF returns its evaluation result to the QoS verification platform and indicates whether the QoS verification platform can perform subsequent 5GC configuration through QoS_Verification_Result_Response.

[0065] 11) After receiving the confirmation instruction, the QoS verification platform retrieves the adjusted QoS_NET_Policy template according to the interval to which the user belongs, and sends it to the 5GC network device (such as PCF) to execute the new QoS policy configuration.

[0066] Figure 4 is a flow chart of another optional service verification method according to an embodiment of the present application, such as Figure 4 As shown, the process includes:

[0067] S402, the client terminal collects end-to-end application data;

[0068] S404, determining a communication quality parameter according to the application data, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate;

[0069] S406, sending a verification request to a third-party server, wherein the verification request carries at least a target identifier and a communication quality parameter of the client terminal; wherein the third-party server is used to forward the verification request to a quality of service QoS verification server, and the QoS verification server is used to analyze the communication quality parameters to obtain a QoS detection result corresponding to the target identifier, wherein the QoS detection result is used to characterize a QoS target configuration policy corresponding to the client terminal;

[0070] S408, receiving a response result returned by the third-party server, wherein the response result is used to indicate that the core network device has successfully executed the QoS target configuration policy.

[0071] Through the above steps, the client terminal can collect end-to-end application data; determine the communication quality parameters according to the application data; send a verification request to a third-party server, wherein the third-party server is used to forward the verification request to the service quality QoS verification server, and the QoS verification server is used to analyze the communication quality parameters to obtain the QoS detection result corresponding to the target identifier; receive the response result returned by the third-party server, thereby achieving the purpose of providing a QoS verification method and business mode for operators and adding value to the operator's 5G network, thereby achieving a technical effect of providing a third-party service party with a way to dynamically adjust the network QoS based on the application QoS situation and application requirements to meet the personalized needs of third-party services, and further solves the problem that the communication quality on the application side and the communication quality on the network side cannot be linked due to the actual communication environment, human failures, dynamic business policy changes and other situations in actual mobile communication services; the third-party service party cannot dynamically match and adjust the network communication quality parameter configuration based on the application side communication quality; the operator cannot provide the third-party service party with QoS guarantee service technical problems based on the actual needs of the service party.

[0072] Figure 5 is a flow chart of another optional service verification method according to an embodiment of the present application, such as Figure 5 As shown, the process includes:

[0073] S502, the third-party server receives a verification request from a target client terminal, wherein the verification request carries at least a target identifier and a communication quality parameter of the target client terminal, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate;

[0074] S504, performing authentication verification on the verification request, and returning a verification response to the target client terminal if the verification request passes the authentication verification, and forwarding the verification request to the quality of service QoS verification server;

[0075] S506, receiving the QoS detection result returned by the QoS verification server, wherein the QoS verification server is used to analyze the communication quality parameters to obtain the QoS detection result corresponding to the target identifier, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the target client terminal.

[0076] It is easy to notice that after receiving the QoS detection result returned by the QoS verification server, the QoS detection result can be evaluated to obtain an evaluation result, and then the evaluation result is sent to the QoS verification server. It should be noted that the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device. It can be understood that when the evaluation result indicates that the QoS target configuration policy can be executed based on the core network device, the QoS target configuration policy can be sent to the core network device to execute the QoS target configuration policy.

[0077] For example, after the QoS verification platform completes the comparison, it returns the QoS verification result (for example, the interval number of the newly matched user and other parameters that can represent the QoS verification result) to the AF through QoS_Verification_Result; the AF evaluates the QoS verification result; the AF returns its evaluation result to the QoS verification platform, and indicates whether the QoS verification platform can perform subsequent 5GC configuration through QoS_Verification_Result_Response; after receiving the confirmation indication, the QoS verification platform retrieves the adjusted QoS_NET_Policy template according to the interval to which the user belongs, and sends it to the 5GC network device (such as PCF) to execute the new QoS policy configuration.

[0078] Through the above steps, the third-party server can receive the verification request from the target client terminal; perform authentication verification on the verification request, and return the verification response to the target client terminal when the authentication verification of the verification request passes, and forward the verification request to the service quality QoS verification service; receive the QoS detection result returned by the QoS verification server, so as to achieve the purpose of providing a QoS verification method and business mode for operators and adding value to the operator's 5G network, thereby achieving the technical effect of providing a third-party service party with a way to dynamically adjust the network QoS based on the application QoS situation and application requirements to meet the personalized needs of third-party services, and further solve the problem that the communication quality on the application side and the communication quality on the network side cannot be linked due to the actual communication environment, human failures, dynamic business policy changes, etc. in actual mobile communication services; the third-party service party cannot dynamically match and adjust the network communication quality parameter configuration based on the application side communication quality; the operator cannot provide the third-party service party with QoS guarantee service technical problems based on the actual needs of the service party.

[0079] Figure 6 A structural diagram of an optional service quality inspection device according to an embodiment of the present application is as follows: Figure 6 As shown, the device comprises:

[0080] A receiving module 62, configured to receive a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of a target client terminal and a communication quality parameter corresponding to the target identifier;

[0081] Verification device 64, used to verify the communication quality parameters to obtain QoS detection results;

[0082] A sending module 66, configured to send the QoS detection result to the third-party server;

[0083] The execution module 68 is used to execute a processing strategy corresponding to the evaluation result according to the evaluation result.

[0084] In the service quality verification device, a receiving module 62 is used for the service quality QoS verification server to receive a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of a target client terminal and a communication quality parameter corresponding to the target identifier; a verification device 64 is used to verify the communication quality parameter to obtain a QoS detection result; a sending module 66 is used to send the QoS detection result to the third-party server; an execution module 68 is used to execute a processing strategy corresponding to the evaluation result according to the evaluation result, thereby achieving the purpose of providing an operator with a QoS verification method and a business mode, and adding value to the operator's 5G network, thereby achieving a technical effect of providing a third-party service party with a way to dynamically adjust the network QoS based on the application QoS situation and application requirements to meet the personalized needs of the third-party service, thereby solving the problem that the communication quality on the application side and the communication quality on the network side cannot be linked due to the influence of the actual communication environment, human failures, dynamic business policy changes, etc. in the actual mobile communication service; the third-party service party cannot dynamically match and adjust the network communication quality parameter configuration based on the application side communication quality; the operator cannot provide the third-party service party with a QoS guarantee service technical problem based on the actual needs of the service party.

[0085] According to another aspect of an embodiment of the present application, a non-volatile storage medium is further provided, the storage medium including a stored program, wherein when the program is running, a device where the storage medium is located is controlled to execute any one of the page synchronization methods.

[0086] Specifically, the above storage medium is used to store program instructions for the following functions to implement the following functions:

[0087] Receive a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of a target client terminal and a communication quality parameter corresponding to the target identifier, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate; if the verification request passes the verification, verify the communication quality parameter to obtain a QoS detection result, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the target client terminal; send the QoS detection result to the third-party server, and receive an evaluation result returned by the third-party server, wherein the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device; and execute a processing strategy corresponding to the evaluation result according to the evaluation result.

[0088] Optionally, in this embodiment, the above-mentioned storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the above-mentioned contents. More specific examples of the above-mentioned storage medium may include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above-mentioned contents.

[0089] In an exemplary embodiment of the present application, a computer program product is further provided, including a computer program, and when the computer program is executed by a processor, any of the above-mentioned service quality verification methods is implemented.

[0090] Optionally, the computer program may implement the following steps when executed by a processor:

[0091] Receive a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of a target client terminal and a communication quality parameter corresponding to the target identifier, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate; if the verification request passes the verification, verify the communication quality parameter to obtain a QoS detection result, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the target client terminal; send the QoS detection result to the third-party server, and receive an evaluation result returned by the third-party server, wherein the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device; and execute a processing strategy corresponding to the evaluation result according to the evaluation result.

[0092] According to an embodiment of the present application, an electronic device is provided, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute any one of the above-mentioned service quality verification methods.

[0093] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0094] Figure 7 A schematic block diagram of an example electronic device 700 that can be used to implement an embodiment of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0095] like Figure 7 As shown, the device 700 includes a computing unit 701, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 702 or a computer program loaded from a storage unit 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0096] A number of components in the device 700 are connected to the I / O interface 705, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a storage unit 708, such as a disk, an optical disk, etc.; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0097] The computing unit 701 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as a quality of service verification method. For example, in some embodiments, the quality of service verification method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 708. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 700 via the ROM 702 and / or the communication unit 709. When the computer program is loaded into the RAM 703 and executed by the computing unit 701, one or more steps of the quality of service verification method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the quality of service verification method in any other appropriate manner (e.g., by means of firmware).

[0098] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0099] The program code for implementing the method of the present application can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, implements the functions / operations specified in the flow chart and / or block diagram. The program code can be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0100] In the context of the present application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0101] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0102] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0103] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.

[0104] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0105] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0106] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0107] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0108] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0109] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0110] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A method for verifying quality of service, characterized in that: include: The quality of service QoS verification server receives a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of a target client terminal and a communication quality parameter corresponding to the target identifier, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate; If the verification request passes the verification, verify the communication quality parameter to obtain a QoS detection result, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the target client terminal; Sending the QoS detection result to the third-party server, and receiving an evaluation result returned by the third-party server, wherein the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device; A processing strategy corresponding to the evaluation result is executed according to the evaluation result.

2. The method according to claim 1, characterized in that Verifying the communication quality parameters to obtain QoS detection results includes: Obtaining a comparison parameter coefficient corresponding to the communication quality parameter; Determining a first comparison parameter corresponding to the target client according to the communication quality parameter and the comparison parameter coefficient; Determine a target interval to which the first comparison parameter belongs, and call a QoS configuration policy corresponding to the target interval as the QoS target configuration policy.

3. The method according to claim 2, characterized in that Determining the target interval to which the first comparison parameter belongs includes: Acquire second comparison parameters corresponding to each of the other plurality of client terminals except the target client terminal; Sorting the first comparison parameter and the second comparison parameter based on a predetermined numerical value order to obtain a sorting result; The sorting result is divided into a preset number of intervals, wherein the preset number of intervals includes: the target interval.

4. The method according to claim 2, characterized in that: Determining a first comparison parameter corresponding to the target client according to the communication quality parameter and the comparison parameter coefficient includes: Obtaining comparison parameter coefficients corresponding to each of the communication quality parameters; Determine the product of each communication quality parameter and its corresponding comparison parameter coefficient to obtain a plurality of products; The multiple products are summed to obtain a first comparison parameter corresponding to the target client.

5. The method according to claim 1, characterized in that Different processing strategies are implemented according to the evaluation results, including: In a case where the evaluation result indicates that the QoS target configuration policy can be executed based on the core network device, the QoS target configuration policy is sent to the core network device to execute the QoS target configuration policy.

6. A method for verifying quality of service, characterized in that: include: The client terminal collects end-to-end application data; Determining a communication quality parameter according to the application data, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate; Sending a verification request to a third-party server, wherein the verification request carries at least the target identifier of the client terminal and the communication quality parameter; wherein the third-party server is used to forward the verification request to a quality of service QoS verification server, wherein the QoS verification server is used to analyze the communication quality parameters, obtain a QoS detection result corresponding to the target identifier, and send the QoS detection result to the third-party server, wherein the third-party server is further used to evaluate the QoS detection result to obtain an evaluation result, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the client terminal, and the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device; Receive a response result returned by the third-party server, wherein the response result is used to indicate that the core network device has successfully executed the QoS target configuration policy.

7. A method for verifying quality of service, characterized in that: include: The third-party server receives a verification request from a target client terminal, wherein the verification request carries at least a target identifier and a communication quality parameter of the target client terminal, wherein the communication quality parameter includes at least one of the following: service delay duration, packet loss rate; Performing authentication verification on the verification request, and if the verification request passes the authentication verification, returning a verification response to the target client terminal, and forwarding the verification request to a quality of service QoS verification server; Receiving a QoS detection result returned by a QoS verification server, wherein the QoS verification server is used to analyze the communication quality parameter to obtain a QoS detection result corresponding to the target identifier, and the QoS detection result is used to characterize a QoS target configuration policy corresponding to the target client terminal; The QoS detection result is evaluated to obtain an evaluation result, and the evaluation result is sent to the QoS verification server, wherein the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device.

8. A service quality verification device, characterized in that: include: A receiving module, configured to receive a verification request forwarded by a third-party server, wherein the verification request carries at least a target identifier of a target client terminal and a communication quality parameter corresponding to the target identifier; A verification device, used for verifying the communication quality parameter to obtain a QoS detection result when the verification request passes the verification, wherein the QoS detection result is used to characterize the QoS target configuration policy corresponding to the target client terminal; A sending module, used to send the QoS detection result to the third-party server, wherein the third-party server is used to evaluate the QoS detection result to obtain an evaluation result, and the evaluation result is used to indicate whether the QoS verification server can execute the QoS target configuration policy based on the core network device; The receiving module is further used to receive the evaluation result returned by the third-party server; An execution module is used to execute a processing strategy corresponding to the evaluation result according to the evaluation result.

9. A non-volatile storage medium, characterized in that: The storage medium includes a stored program, wherein when the program is running, the device where the storage medium is located is controlled to execute the service quality verification method according to any one of claims 1 to 7.

10. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the service quality verification method as described in any one of claims 1 to 7.

Images