Quality of service speed limiting method and device

The remote process call interface of the service quality system receives and processes node service quality information, dynamically adjusts the service quality speed limit of multi-node application services, solves the problem of QoS speed limit adjustment caused by uneven node traffic, and achieves efficient bandwidth allocation and application service performance improvement.

CN119892741APending Publication Date: 2025-04-25CHINA TELECOM CLOUD TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411747347.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-11-29
Publication Date
2025-04-25

AI Technical Summary

Technical Problem

The prior art is difficult to effectively arrange the service quality speed limit for multi-node application services, especially in the case of uneven node traffic, which makes it difficult to adjust the QoS speed limit.

Method used

Through the remote process call interface of the service quality system, the node service quality information reported by the target node of the application service is received, the target speed limit information is determined based on this information, and the node speed limit of the target node is dynamically updated.

Benefits of technology

Dynamic adjustment of service quality speed limit for multi-node application services is achieved, ensuring that key applications can obtain the necessary bandwidth when network pressure is high, avoid network congestion and packet loss, and improve the performance and efficiency of application services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119892741A_ABST
    Figure CN119892741A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of cloud computing video views, and provides a service quality speed limiting method and device, and the method comprises the steps: receiving node service quality information reported by a target node of an application service through a remote procedure call interface of a service quality system, the node service quality information comprises node flow information and node speed limit information; triggering a node updating condition in response to the node service quality information, and determining target speed limit information of the target node based on the node service quality information; and sending the target speed limit information to the target node, so that the target node updates the node speed limit information according to the target speed limit information. According to the technical scheme provided by one or more embodiments, the service quality speed limit of each node in the multi-node application service can be well arranged, and the node speed limit of each node can be dynamically adjusted.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the technical field of cloud computing video view, and in particular to a method and device for limiting the speed of quality of service. Background Art

[0002] Quality of Service (QoS) plays a vital role in network design. By managing factors such as network bandwidth, delay, jitter, and packet errors, QoS technology can provide better and more predictable network services. QoS technology plays an important role in multimedia, real-time voice and video communications, online games, and other delay-sensitive applications.

[0003] QoS speed limit is an important technology in QoS technology. The significance of QoS speed limit is that by controlling the bandwidth allocation between various services and applications in the network and balancing the network traffic between various services and applications, it can prevent some applications with high bandwidth usage (such as end-to-end P2P downloads) from occupying too much network resources, thereby affecting other important network services (such as online video conferencing or critical data transmission).

[0004] QoS speed limit can ensure that key applications can still obtain the necessary bandwidth when the network pressure is high, ensuring the operation efficiency. However, the existing application service deployment mode usually forms a multi-node application service in the form of a cluster, and the traffic of each node of the application service is uneven from time to time, making it difficult to deploy QoS speed limit for multi-node application services. Summary of the invention

[0005] In view of this, one or more embodiments of the present disclosure provide a service quality rate limiting method and device, which can better arrange the service quality rate limiting of each node in a multi-node application service and dynamically adjust the node rate limiting of each node.

[0006] In a first aspect, the present disclosure provides a service quality speed limit method, which is applied to a service quality system, and the method includes: utilizing a remote procedure call interface of the service quality system to receive node service quality information reported by a target node of an application service, wherein the node service quality information includes node traffic information and node speed limit information; in response to triggering a node update condition according to the node service quality information, determining a target speed limit information of the target node based on the node service quality information; and sending the target speed limit information to the target node so that the target node updates the node speed limit information according to the target speed limit information.

[0007] In a second aspect, the present disclosure provides a service quality speed limit method, which is applied to application services, and the method includes: utilizing a remote procedure call interface of a service quality system to report node service quality information of a target node of the application service to the service quality system, wherein the node service quality information includes node traffic information and node speed limit information; receiving target speed limit information returned by the service quality system, wherein the target speed limit information is determined by the service quality system based on the node service quality information after the node service quality information triggers a node update condition; and updating the node speed limit information of the target node according to the target speed limit information.

[0008] In a third aspect, the present disclosure provides a service quality speed limit device, which is applied to a service quality system, and the device includes: a first receiving unit, used to use the remote procedure call interface of the service quality system to receive node service quality information reported by the target node of the application service, the node service quality information including node traffic information and node speed limit information; a computing unit, used to trigger a node update condition in response to the node service quality information, and determine the target speed limit information of the target node based on the node service quality information; a first sending unit, used to send the target speed limit information to the target node, so that the target node updates the node speed limit information according to the target speed limit information.

[0009] In a fourth aspect, the present disclosure provides a service quality speed limit device, which is applied to application services, and the device includes: a second sending unit, used to use the remote procedure call interface of the service quality system to report the node service quality information of the target node of the application service to the service quality system, and the node service quality information includes node traffic information and node speed limit information; a second receiving unit, used to receive the target speed limit information returned by the service quality system, and the target speed limit information is determined by the service quality system based on the node service quality information after the node service quality information triggers a node update condition; an updating unit, used to update the node speed limit information of the target node according to the target speed limit information.

[0010] In a fifth aspect, the present disclosure provides an electronic device, comprising a memory and a processor, wherein the memory is used to store a computer program, and when the computer program is executed by the processor, the service quality speed limiting method of the first aspect or the second aspect is implemented.

[0011] In a sixth aspect, the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and when the computer program is executed by a processor, the service quality speed limiting method of the first aspect or the second aspect is implemented.

[0012] The technical solution provided by one or more embodiments of the present disclosure can utilize the remote procedure call interface of the service quality system to receive the node service quality information of the target node reported by the application service. After the node update condition is triggered, the node speed limit of the target node can be updated according to the target speed limit information determined by the service quality system. The design of the remote procedure call interface can decouple the application service from the service quality system and improve the stability and reliability of the overall system. By updating the node speed limit of the target node, the service quality speed limit rules of each node of the application service can be flexibly iterated according to the evolution process of the application service.

[0013] The technical solution provided by one or more embodiments of the present disclosure can dynamically adjust the service quality speed limit rules of each node of the application service. In this way, it can ensure that key applications can obtain the necessary bandwidth in a timely manner when the network pressure is high, and ensure the operation efficiency. Dynamically adjusting the service quality speed limit rules of each node of the application service can also help prevent network congestion and data packet loss of the application service, improve the performance and efficiency of the entire application service, and better meet the actual needs of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The features and advantages of the embodiments of the present disclosure may be more clearly understood by referring to the accompanying drawings, which are schematic and should not be construed as limiting the present disclosure in any way. In the accompanying drawings:

[0015] Figure 1 A schematic diagram showing the steps of a service quality rate limiting method in one embodiment of the present disclosure is shown;

[0016] Figure 2 A schematic diagram showing the steps of another quality of service rate limiting method in one embodiment of the present disclosure is shown;

[0017] Figure 3 A schematic diagram showing the composition structure of a service quality rate limiting system in one embodiment of the present disclosure is shown;

[0018] Figure 4 A schematic diagram of functional units of a quality of service rate limiting device in one embodiment of the present disclosure is shown;

[0019] Figure 5 A schematic diagram of functional units of another quality of service rate limiting device in one embodiment of the present disclosure is shown;

[0020] Figure 6 A schematic structural diagram of an electronic device in one embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0021] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.

[0022] The degradation judgment method of the landing page provided in one embodiment of the present disclosure can be applied to an offline test device. The offline test device can be an electronic device with data processing capabilities. For example, the offline test device can be a personal computer, a workstation, etc. In addition, the method can also be applied to software running in the above-mentioned offline test device.

[0023] In the related art, the deployment mode of many application services basically exists in the form of clusters, using multiple independent server nodes to collaboratively process tasks and provide services, forming a multi-node application service. Each node of the application service can be an independent server. They can communicate and collaborate with each other to jointly complete the functions of the application service.

[0024] In related technologies, if the traffic of each node of a multi-node application service is balanced, then the node service quality setting will be relatively simple. N nodes can each bear 1 / N of the traffic. However, the actual situation is often not the case. Uneven traffic often occurs, which poses a challenge to dynamic service quality setting.

[0025] In view of this, a service quality speed limit method provided in an embodiment of the present disclosure can dynamically adjust the QoS speed limit of each node without breaking the overall QoS speed limit conditions of the application service. In this way, for a multi-node distributed application service, it can be ensured that each application node can dynamically adjust the QoS speed limit rules according to the actual situation.

[0026] See also Figure 1 , a service quality speed limiting method provided by an embodiment of the present disclosure may include the following steps.

[0027] S11: using the remote procedure call interface of the service quality system, receiving node service quality information reported by the target node of the application service, wherein the node service quality information includes node flow information and node speed limit information.

[0028] In this embodiment, the application service can process multiple tasks and requests at the same time, and these tasks and requests can be distributed to different nodes for processing, thereby improving the reliability and availability of the application service. The application service as a whole can set service quality speed limit rules to form service speed limit information. Each node of the application service can also set its own service quality speed limit rules to form node speed limit information.

[0029] In this embodiment, the Remote Procedure Call interface (RPC) is a computer communication protocol that allows a program (such as an application service) to request a service from another program (such as a quality of service system) over a network without paying attention to the details of the underlying network technology. The design of the remote procedure call interface can decouple the application service from the quality of service system and improve the stability and reliability of the overall system.

[0030] In this embodiment, the service quality system can be a high-availability system in master-slave mode composed of service discovery middleware such as zookeeper and etcd. The service quality system in master-slave mode can have a master node and multiple slave nodes to improve the availability and fault tolerance of the system. For example, the master node can handle external requests, while the slave node can be used to handle backup tasks or provide read-only services, thereby distributing the load; the data of the master node can be copied to the slave node, which increases the redundancy of the data and reduces the risk of data loss; when the master node fails, the slave node can quickly take over the service to reduce system downtime.

[0031] In this embodiment, the node service quality information may include node identification information, node traffic information, and node speed limit information. The node traffic information may refer to the total amount of data or data rate passing through the node within a specific time period. The node speed limit information may be speed limit information of different service quality indicator dimensions, such as QPS (Queries Per Second) speed limit, uplink bandwidth speed limit, and downlink bandwidth speed limit.

[0032] S12: In response to the node service quality information triggering a node update condition, determine the target speed limit information of the target node based on the node service quality information.

[0033] In this embodiment, the node update condition can be triggered by the node flow information and the node speed limit information. For example, the node update condition can be that the node flow is lower than the first ratio of the node speed limit for a period of time, indicating that the node speed limit is set too high and needs to be lowered; the node update condition can also be that the node flow is higher than the second ratio of the node speed limit for a period of time, indicating that the node speed limit is set too low and needs to be increased.

[0034] In this embodiment, after the node update condition is triggered, the service quality system can extract valid information from the node service quality information, and can determine the target speed limit information of the target node through a preset algorithm or a preset model. The target speed limit information can be a preferred solution for adjusting the service quality speed limit of the target node, which can ensure that the traffic of the target node will neither be far below the service quality speed limit nor far above the service quality speed limit.

[0035] In this embodiment, there are multiple target nodes in the application service. When the node service quality information of any target node triggers the node update condition, the target speed limit of the target node can be determined. At the same time, since the service speed limit of the application service (equivalent to the sum of the node speed limits) is usually unchanged, after determining the target speed limit of a target node, it is generally necessary to determine the node speed limits of all other target nodes in the application service. The node speed limit of each target node can be determined by the same algorithm rule or calculation model to increase the calculation efficiency.

[0036] In some embodiments, the node update condition is triggered in response to the node service quality information, and the target speed limit information of the target node is determined based on the node service quality information, including: judging whether to trigger the node update condition according to a comparison result of the node traffic information and the node speed limit information; in response to the triggering of the node update condition, determining the target speed limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service.

[0037] In some embodiments, the determination of whether to trigger the node update condition is based on a comparison result of the node traffic information and the node speed limit information, including: if the ratio of the node traffic information to the node speed limit information is lower than a first threshold, triggering the first update condition; if the ratio of the node traffic information to the node speed limit information is higher than a second threshold, triggering the second update condition; if both the first update condition and the second update condition are triggered, triggering the node update condition.

[0038] In a practical application example, the data form of A(C, L) can be used to indicate the node flow information and the node speed limit information at the same time. Among them, A is the node identifier, C is the current node flow, and L is the current node speed limit. The first threshold can be 40%, and the second threshold can be 80%. When C is lower than 40% of L, node A can be considered to be in an unsteady state, and the current node speed limit L of node A can be appropriately lowered to determine the target node speed limit L' of node A. When C is higher than 80% of L, node A can also be considered to be in an unsteady state, and the current node speed limit L of node A can be appropriately increased to determine the target node speed limit L' of node A. When C is between 40% and 80% of L, node A can be considered to be in a steady state, and the current node speed limit L of node A can be kept unchanged.

[0039] It should be noted that if the ratio of the current node traffic C of all nodes of the application service to the current node speed limit L is lower than 40% in some cases and between 40% and 80% in others, the node update condition will not be triggered. If the ratio of the current node traffic C of all nodes of the application service to the current node speed limit L is higher than 80% in some cases and between 40% and 80% in others, the node update condition will not be triggered.

[0040] Only when the nodes of the application service are significantly unbalanced, that is, when the ratio of C to L of some nodes is too low (for example, lower than 40%), and the ratio of C to L of some nodes is too high (for example, higher than 80%), will the node update condition be triggered. At this time, a target speed limit information can be determined for each node of the application service, and the node speed limit information can be updated once.

[0041] The node update condition is triggered only when both the first update condition and the second update condition are triggered, which can effectively avoid the occurrence of an infinite loop (for example, the ratio of C to L of all nodes is too low, and the node speed limit information of all nodes will be continuously tried, but after updating the ratio of C to L of all nodes is still too low), which can ensure the stability and reliability of the service quality speed limit method.

[0042] In some embodiments, determining the target speed limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service includes: determining a target parameter based on a ratio of the node traffic information and the service traffic information; and determining the target speed limit information based on the product of the target parameter and the service speed limit information.

[0043] In an actual application example, A(C, L) can be used to indicate both node traffic information and node speed limit information. Among them, A is the node identifier, C is the current node traffic, and L is the current node speed limit. When determining the target node speed limit L' of node A, the calculation formula used can be: L'=C / Ctotal*Ltotal. "Ctotal" can represent the current statistical traffic of each node of the application service, that is, the current service traffic. "Ltotal" can represent the current service speed limit of the application service.

[0044] In some embodiments, determining the target speed limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service includes: determining a target parameter based on a ratio of the node traffic information and the service traffic information; determining first target speed limit information based on the product of the target parameter and the service speed limit information; determining second target speed limit information based on the first target speed limit information and a burst coefficient; wherein the first target speed limit information represents an average speed limit of the node traffic, the second target speed limit information represents a maximum value of the node burst traffic, and the burst coefficient may be preset (e.g., 130%, 150%, 180%, etc.).

[0045] In a practical application example, A(C, L) can be used to indicate both node traffic information and node speed limit information. Among them, A is the node identifier, C is the current node traffic, and L is the current node speed limit. When determining the first target speed limit L' of node A, the calculation formula used can be: L'=C / Ctotal*Ltotal. "Ctotal" can represent the current statistical traffic of each node of the application service, that is, the current service traffic. "Ltotal" can represent the current service speed limit of the application service. After determining the first target speed limit L' of node A, it can be multiplied by a burst coefficient of 150% to determine the second target speed limit of node A.

[0046] S13: Send the target speed limit information to the target node, so that the target node updates the node speed limit information according to the target speed limit information.

[0047] In this embodiment, the target node can receive the corresponding target speed limit information and update its own node speed limit information, so that the node speed limit can be dynamically adjusted to ensure that the ratio of the node flow to the node speed limit is within a reasonable range.

[0048] In some embodiments, the target speed limit information may include first target speed limit information for indicating the average speed limit of the node traffic, and second target speed limit information for indicating the maximum value of the node burst traffic. For the target node, a token bucket speed limit algorithm may be selected, and the first target speed limit information and the second target speed limit information may be used as two parameters of the token bucket speed limit algorithm to configure the node speed limit of the target node. The advantage of the token bucket speed limit algorithm is smooth speed limit, and the token generation rate adjustment is relatively flexible.

[0049] In an actual application example, the nodes of the application service use the token bucket algorithm to update the node speed limit, which involves two key parameters: the first target speed limit and the second target speed limit burst. The limit parameter defines the average rate at which the node can continuously transmit data. In the token bucket algorithm, limit usually indicates the rate at which tokens are added to the bucket, that is, how many tokens can be added per second. Each token represents the transmission permission for a data unit (such as 1KB). The burst parameter defines the maximum amount of data that a node can send at one time without exceeding the average rate limit. In the token bucket algorithm, burst indicates the maximum capacity of the bucket, that is, how many tokens can be stored in the bucket at most. When the bucket is full, newly arrived data must wait until there are enough tokens available in the bucket.

[0050] The workflow of the token bucket algorithm is roughly as follows:

[0051] a. Token generation: The system adds tokens to the bucket at the rate specified by limit.

[0052] b. Data transmission: When a data packet arrives, the node checks whether there are available tokens in the bucket. If so, the corresponding number of tokens are removed from the bucket and the data packet is allowed to pass; if not, the data packet will wait until tokens are available in the bucket, or be discarded directly, depending on the implementation method.

[0053] c. Burst processing: If the number of tokens in the bucket is not enough to meet the current data transmission needs, but the total number of tokens (including tokens in the bucket and tokens waiting) does not exceed the burst, then these data packets can still be transmitted because they are regarded as burst traffic. Once the burst is exceeded, the additional data packets will be delayed or discarded.

[0054] By adjusting the limit and burst parameters, the token bucket algorithm can flexibly control the network traffic of the node, ensuring the stability of the node while allowing a certain degree of burst traffic on the node to adapt to different network environments and business needs.

[0055] See also Figure 2 , a service quality speed limiting method provided by an embodiment of the present disclosure may include the following steps.

[0056] S21: Using the remote procedure call interface of the service quality system, reporting the node service quality information of the target node of the application service to the service quality system, wherein the node service quality information includes node flow information and node speed limit information.

[0057] S22: Receive target speed limit information returned by the service quality system, where the target speed limit information is determined by the service quality system based on the node service quality information after the node service quality information triggers a node update condition.

[0058] S23: updating the node speed limit information of the target node according to the target speed limit information.

[0059] The service quality rate limiting method provided in steps S21 to S23 of this embodiment is the counterpart method of the technical solution defined in steps S11 to S13 above. For related explanations, please refer to the corresponding contents of steps S11 to S13, which will not be repeated here.

[0060] In some embodiments, the target speed limit information is determined by the service quality system based on the node service quality information after the node service quality information triggers the node update condition, including: based on the comparison result of the node traffic information and the node speed limit information, the service quality system determines whether the node update condition is triggered; after the node update condition is triggered, based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service, the service quality system determines the target speed limit information of the target node.

[0061] In some embodiments, the service quality system determines whether the node update condition is triggered based on the comparison result of the node traffic information and the node speed limit information, including: if there is a ratio of the node traffic information to the node speed limit information, which is lower than a first threshold, the service quality system determines that the first update condition is triggered; if there is a ratio of the node traffic information to the node speed limit information, which is higher than a second threshold, the service quality system determines that the second update condition is triggered; if both the first update condition and the second update condition are triggered, the service quality system determines that the node update condition is triggered.

[0062] In some embodiments, the service quality system determines the target speed limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service, including: based on the ratio of the node traffic information and the service traffic information, the service quality system determines the target parameter; based on the product of the target parameter and the service speed limit information, the service quality system determines the target speed limit information.

[0063] In some embodiments, determining the target speed limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service includes: determining a target parameter based on a ratio of the node traffic information and the service traffic information; determining first target speed limit information based on the product of the target parameter and the service speed limit information; determining second target speed limit information based on the first target speed limit information and a burst coefficient; wherein the first target speed limit information represents an average speed limit of the node traffic, the second target speed limit information represents a maximum value of the node burst traffic, and the burst coefficient may be preset.

[0064] For relevant explanations, please refer to the corresponding content of step S12, which will not be repeated here.

[0065] See also Figure 3 A quality of service rate limiting system provided by an embodiment of the present disclosure may include a quality of service system and an application service subsystem.

[0066] The QoS system can be a high-availability system with master-slave mode, created through service discovery middleware such as zookeeper and etcd, and containing multiple QoS system nodes. The QoS system can provide an RPC interface for receiving the current QoS status of the node reported by the application service node. By customizing the logic that conforms to the business speed limit policy, the QoS system can return the appropriate target QoS status to the application service node to achieve the purpose of dynamic speed limit of the application service node.

[0067] The application service can be a multi-node application service, which can report the current QoS status of each node by calling the RPC interface of the QoS system. The QoS system then performs a comprehensive rule analysis and gives the appropriate node speed limiter for each node. The memory of each node can maintain the node speed limiterList of the node. LimiterList can include different types of QoS speed limit information. According to the returned target QoS status, the application service node can update the node speed limit list.

[0068] In this embodiment, the current QoS status of the node reported by the application service node may include qosType, limitQos, currentQos, and nodeId fields. The qosType field may define the QoS type, such as QPS speed limit, bandwidth speed limit, etc. The limitQos field may define the QoS speed limit threshold. The currentQos field may define the actual current traffic of the node. The nodeId field may identify the node, and the host information may be used to distinguish the node.

[0069] In this embodiment, the QoS system returns the appropriate target QoS state to the application service node, which may include limitQos and burst fields. The limitQos field may define the target QoS speed limit threshold. The Burst field may define the maximum speed limit capacity and the maximum burst flow value.

[0070] In this implementation, the application service node may use a token bucket rate limiting algorithm to adjust the node rate limit.

[0071] In an actual application example, the application service has nodes A1, A2, and A3, and the QoS system has nodes Q1, Q2, and Q3. According to the user latitude limit for downloading picture requests, the application service has a QPS speed limit of 1000. Referring to the above, a description specification A(C, L) can be defined: A is the node identifier, C is the current node traffic, and L is the current node speed limit. For example, A1(C1, L1) can indicate that the current QPS of node A1 is C1, and the current QPS speed limit is L1.

[0072] In some actual application scenarios of traffic balancing, the states of each node of the application service can be A1 (200, 330), A2 (220, 330), and A3 (220, 330), and each node has balanced traffic.

[0073] In some actual application scenarios with unbalanced traffic, the states of each node of the application service may be A1 (100, 330), A2 (100, 330), and A3 (300, 330). In this case, a strategy needs to be customized to dynamically adjust the QPS speed limit of each node and ensure that the sum of the QPS speed limits of each node does not exceed 1000. The QPS speed limit adjustment rules can be as follows.

[0074] If C is lower than 40% of L, the QPS speed limit needs to be appropriately reduced, and the new L'=C / C total*L total;

[0075] If C is higher than 80% of L, the QPS speed limit needs to be appropriately increased, and the new L'=C / Ctotal*Ltotal.

[0076] Among them, "C total" can represent the current statistical traffic of each node of the application service, that is, the current service traffic, for example, C total = C1 + C2 + C3; "L total" can represent the current service speed limit of the application service, for example, L total is the QPS speed limit of the application service, L total = 1000.

[0077] In an actual application scenario, the states of each node of the application service may be A1 (100, 330), A2 (100, 330), and A3 (300, 330).

[0078] Because C1 is lower than 40% of L1, that is, 100<330*40%, L1 drops to 1000*(100 / (100+100+300)=200, and the state of node A1 is updated to A1(100, 200).

[0079] Because C2 is lower than 40% of L2, that is, 100<330*40%, L2 drops to 1000*(100 / (100+100+300)=200, and the state of node A2 is updated to A2(100, 200).

[0080] Because C3 is higher than 80% of L3, that is, 300>300*80%, L3 increases to 1000*(300 / (100+100+300)=600, and the state of node A3 is updated to A3(300,600).

[0081] In this way, when the QPS of node A3 increases, the QPS speed limit of node A3 is also appropriately increased, ensuring that the QPS speed limit of node A3 will not be at a low level, making the threshold of the QPS speed limit of node A3 too low.

[0082] In another practical application scenario, when the QPS of node A3 decreases and the QPS of node A1 increases, the states of the nodes of the application service can be A1 (200, 200), A2 (100, 200), and A3 (100, 600). According to the QPS speed limit adjustment rules, the following allocation can be made:

[0083] A1(200,1000*(200 / 400)=500);

[0084] A2(100,1000*(100 / 400)=250);

[0085] A3(100,1000*(100 / 400)=250).

[0086] In this way, A1 can be guaranteed to meet more subsequent QPS.

[0087] It is worth noting that although the current QPS of node A2 is between 40% and 80% of the QPS speed limit, since the states of node A1 and node A3 have jointly triggered the QPS speed limit adjustment rule, node A2 also needs to follow the adjustment and update the QPS speed limit.

[0088] The technical solution provided by one or more embodiments of the present disclosure can utilize the remote procedure call interface of the service quality system to receive the node service quality information of the target node reported by the application service. After the node update condition is triggered, the node speed limit of the target node can be updated according to the target speed limit information determined by the service quality system. The design of the remote procedure call interface can decouple the application service from the service quality system and improve the stability and reliability of the overall system. By updating the node speed limit of the target node, the service quality speed limit rules of each node of the application service can be flexibly iterated according to the evolution process of the application service.

[0089] The technical solution provided by one or more embodiments of the present disclosure can dynamically adjust the service quality speed limit rules of each node of the application service. In this way, it can ensure that key applications can obtain the necessary bandwidth in a timely manner when the network pressure is high, and ensure the operation efficiency. Dynamically adjusting the service quality speed limit rules of each node of the application service can also help prevent network congestion and data packet loss of the application service, improve the performance and efficiency of the entire application service, and better meet the actual needs of users.

[0090] In addition, the technical solution provided by one or more embodiments of the present disclosure also provides a dynamic adjustment method for the service quality speed limit based on the token bucket algorithm, which can be widely used in the service quality speed limit of distributed application systems. Moreover, for sudden large traffic scenarios, a relatively smooth traffic curve can be obtained.

[0091] See also Figure 4 The present disclosure also provides a service quality rate limiting device, which is applied to a service quality system, and includes:

[0092] The first receiving unit 401 is used to receive node service quality information reported by the target node of the application service by using the remote procedure call interface of the service quality system, wherein the node service quality information includes node flow information and node speed limit information;

[0093] A calculation unit 402 is configured to trigger a node update condition in response to the node service quality information, and determine the target speed limit information of the target node based on the node service quality information;

[0094] The first sending unit 403 is configured to send the target speed limit information to the target node, so that the target node updates the node speed limit information according to the target speed limit information.

[0095] In one embodiment, the calculation unit 402 is specifically used to determine whether the node update condition is triggered based on the comparison result of the node traffic information and the node speed limit information; in response to the triggering of the node update condition, the target speed limit information of the target node is determined based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service.

[0096] In one embodiment, the calculation unit 402 includes a first calculation subunit 4021. The first calculation subunit 4021 is configured to trigger a first update condition if a ratio of the node flow information to the node speed limit information is lower than a first threshold; trigger a second update condition if a ratio of the node flow information to the node speed limit information is higher than a second threshold; and trigger the node update condition if both the first update condition and the second update condition are triggered.

[0097] In one embodiment, the calculation unit 402 includes a second calculation subunit 4022. The second calculation subunit 4022 is configured to determine a target parameter based on a ratio of the node flow information to the service flow information, and determine the target speed limit information based on a product of the target parameter and the service speed limit information.

[0098] See also Figure 5 The present disclosure also provides a service quality rate limiting device, which is applied to application services and includes:

[0099] The second sending unit 501 is used to report the node service quality information of the target node of the application service to the service quality system by using the remote procedure call interface of the service quality system, wherein the node service quality information includes node flow information and node speed limit information;

[0100] A second receiving unit 502 is configured to receive target speed limit information returned by the service quality system, where the target speed limit information is determined by the service quality system based on the node service quality information after the node service quality information triggers a node update condition;

[0101] The updating unit 503 is configured to update the node speed limit information of the target node according to the target speed limit information.

[0102] In one embodiment, the target speed limit information is determined by the service quality system based on the node service quality information after the node service quality information triggers the node update condition, including: based on the comparison result of the node traffic information and the node speed limit information, the service quality system determines whether the node update condition is triggered; after the node update condition is triggered, based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service, the service quality system determines the target speed limit information of the target node.

[0103] In one embodiment, the service quality system determines whether the node update condition is triggered based on the comparison result of the node traffic information and the node speed limit information, including: if there is a ratio of the node traffic information to the node speed limit information, which is lower than a first threshold, the service quality system determines that the first update condition is triggered; if there is a ratio of the node traffic information to the node speed limit information, which is higher than a second threshold, the service quality system determines that the second update condition is triggered; if both the first update condition and the second update condition are triggered, the service quality system determines that the node update condition is triggered.

[0104] In one embodiment, the service quality system determines the target speed limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service speed limit information of the application service, including: based on the ratio of the node traffic information and the service traffic information, the service quality system determines the target parameter; based on the product of the target parameter and the service speed limit information, the service quality system determines the target speed limit information.

[0105] Each unit described in the above embodiments may be implemented by a computer chip or a product having a certain function. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

[0106] For the convenience of description, the above devices are described in terms of functions and are described separately in various units. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0107] See also Figure 6The present disclosure also provides an electronic device, which includes a memory and a processor, wherein the memory is used to store a computer program, and when the computer program is executed by the processor, the above-mentioned service quality speed limiting method is implemented.

[0108] The present disclosure also provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and when the computer program is executed by a processor, the above-mentioned service quality speed limiting method is implemented.

[0109] The processor may be a central processing unit (CPU). The processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or a combination of the above chips.

[0110] As a non-transitory computer-readable storage medium, the memory can be used to store non-transitory software programs, non-transitory computer executable programs and modules, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor executes various functional applications and data processing of the processor by running the non-transitory software programs, instructions and modules stored in the memory, that is, implementing the method in the above method embodiment.

[0111] The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the processor, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0112] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD), etc.; the storage medium can also include a combination of the above-mentioned types of memory.

[0113] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the embodiments of the device, equipment, and storage medium, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0114] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

[0115] Although the embodiments of the present disclosure have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present disclosure, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A service quality rate limiting method, characterized in that: The method is applied to a quality of service system, and the method comprises: Utilizing the remote procedure call interface of the service quality system, receiving node service quality information reported by the target node of the application service, wherein the node service quality information includes node flow information and node speed limit information; In response to triggering a node update condition by the node service quality information, determining target speed limit information of the target node based on the node service quality information; The target speed limit information is sent to the target node, so that the target node updates the node speed limit information according to the target speed limit information.

2. The method according to claim 1, characterized in that The triggering of the node update condition in response to the node service quality information and determining the target rate limit information of the target node based on the node service quality information includes: According to the comparison result of the node flow information and the node speed limit information, determining whether the node update condition is triggered; In response to the triggering of the node update condition, the target rate limit information of the target node is determined based on the node traffic information, the service traffic information of the application service, and the service rate limit information of the application service.

3. The method according to claim 2, characterized in that The determining whether to trigger the node update condition according to the comparison result of the node flow information and the node speed limit information includes: If the ratio of the node flow information to the node speed limit information is lower than a first threshold, a first update condition is triggered; If the ratio of the node flow information to the node speed limit information is higher than a second threshold, a second update condition is triggered; If both the first update condition and the second update condition are triggered, the node update condition is triggered.

4. The method according to claim 2, characterized in that: The determining the target rate limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service rate limit information of the application service includes: Determining a target parameter based on a ratio of the node flow information to the service flow information; The target speed limit information is determined based on a product of the target parameter and the service speed limit information.

5. A service quality rate limiting method, characterized in that: The method is applied to application services, and the method comprises: Using a remote procedure call interface of a quality of service system, reporting node quality of service information of a target node of the application service to the quality of service system, wherein the node quality of service information includes node flow information and node speed limit information; receiving target speed limit information returned by the quality of service system, the target speed limit information being determined by the quality of service system based on the node quality of service information after the node quality of service information triggers a node update condition; The node speed limit information of the target node is updated according to the target speed limit information.

6. The method according to claim 5, characterized in that The target speed limit information is determined by the service quality system based on the node service quality information after the node service quality information triggers the node update condition, including: According to the comparison result of the node flow information and the node speed limit information, the service quality system determines whether the node update condition is triggered; After the node update condition is triggered, the service quality system determines the target rate limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service rate limit information of the application service.

7. The method according to claim 6, characterized in that The service quality system determines whether the node update condition is triggered according to the comparison result of the node flow information and the node speed limit information, including: If there is a ratio of the node traffic information to the node speed limit information that is lower than a first threshold, the service quality system determines that a first update condition is triggered; If there is a ratio of the node flow information to the node speed limit information that is higher than a second threshold, the service quality system determines that a second update condition is triggered; If both the first update condition and the second update condition are triggered, the quality of service system determines that the node update condition is triggered.

8. The method according to claim 6, characterized in that The service quality system determines the target rate limit information of the target node based on the node traffic information, the service traffic information of the application service, and the service rate limit information of the application service, including: The service quality system determines a target parameter based on a ratio of the node flow information to the service flow information; The quality of service system determines the target rate limit information based on a product of the target parameter and the service rate limit information.

9. A service quality rate limiting device, characterized in that: The device is applied to a service quality system, and comprises: A first receiving unit, configured to receive node service quality information reported by a target node of an application service by using a remote procedure call interface of the service quality system, wherein the node service quality information includes node flow information and node speed limit information; a computing unit, configured to trigger a node update condition in response to the node service quality information, and determine a target speed limit information of the target node based on the node service quality information; The first sending unit is used to send the target speed limit information to the target node, so that the target node updates the node speed limit information according to the target speed limit information.

10. A service quality rate limiting device, characterized in that: The device is applied to application services, and the device includes: A second sending unit is used to report node service quality information of the target node of the application service to the service quality system by using a remote procedure call interface of the service quality system, wherein the node service quality information includes node flow information and node speed limit information; A second receiving unit, configured to receive target speed limit information returned by the service quality system, wherein the target speed limit information is determined by the service quality system based on the node service quality information after the node service quality information triggers a node update condition; An updating unit is used to update the node speed limit information of the target node according to the target speed limit information.