Bandwidth adjusting method and device

Abstract

The invention discloses a bandwidth adjustment method and device, and relates to the technical field of bandwidth adjustment. The specific embodiment of the method comprises the following steps: acquiring a configuration update message of a configuration management center monitored by a monitoring component; the configuration updating message indicates updating of importance values of a plurality of service systems; obtaining first access traffic of the plurality of service systems in the first historical time period; comparing the first access traffic with a network bandwidth upper limit shared by the plurality of service systems; and in response to the condition that the first access flow is greater than or equal to the network bandwidth upper limit, adjusting the bandwidths corresponding to the plurality of service systems according to the updated importance value indicated by the configuration update message. According to the embodiment of the invention, the dynamic real-time adjustment of the importance of the service system is ensured at the peak of access traffic, the bandwidth quota of the system is automatically adjusted in time, the operation of the service system with a higher grade after the importance is adjusted can be guaranteed preferentially, and the loss possibly caused by bandwidth overload is reduced to the greatest extent.

Description

Technical Field

[0001] The present invention relates to the technical field of bandwidth adjustment, and in particular to a bandwidth adjustment method and device. Background Art

[0002] In the current era of big data, the performance and stability of key platforms used to process, transmit and store massive amounts of data are constantly facing challenges. In order to ensure that the platform can run stably and efficiently, bandwidth protection has become a vital task. Current flow limiting technology is highly dependent on the traffic quotas set in advance for business systems. During data peaks, operation and maintenance personnel are required to manually lower the traffic quotas of unimportant business systems and manually restore the traffic quotas of the business systems after the peaks. This bandwidth protection method is time-consuming and labor-intensive, with low accuracy, and can only adjust bandwidth according to the pre-set traffic quotas. It has low flexibility and poor real-time performance, and cannot timely prioritize the operation of important business systems. Summary of the invention

[0003] In view of this, an embodiment of the present invention provides a bandwidth adjustment method and device, including: obtaining a configuration update message of a configuration management center monitored by a monitoring component; the configuration update message indicates the update of the importance values ​​of multiple business systems; obtaining the first access flow of multiple business systems in a first historical period; comparing the first access flow with the upper limit of the network bandwidth shared by multiple business systems; in response to the first access flow being greater than or equal to the upper limit of the network bandwidth, adjusting the bandwidths corresponding to the multiple business systems respectively according to the updated importance values ​​indicated by the configuration update message. Thus, by dynamically updating the importance values ​​of the business systems and timely monitoring the update of the importance values, it is possible to adjust the importance of different business systems at any time, and adjust the bandwidth of each business system according to the importance values ​​updated in real time by the business systems during the peak access period, thereby ensuring that during the peak access flow, the importance of the business systems is dynamically and real-time adjusted, and the system bandwidth quota is adjusted in a timely and automatic manner, ensuring that the operation of the business systems with higher importance levels after the importance adjustment can be given priority, and minimizing the losses that may be caused by bandwidth overload; reducing the human cost of bandwidth adjustment, and improving the efficiency and reliability of bandwidth management.

[0004] To achieve the above objective, according to one aspect of an embodiment of the present invention, a bandwidth adjustment method is provided.

[0005] A bandwidth adjustment method according to an embodiment of the present invention comprises: obtaining a configuration update message from a configuration management center monitored by a monitoring component; the configuration update message indicates an update of importance values ​​of multiple business systems; obtaining first access traffic of the multiple business systems in a first historical period; comparing the first access traffic with an upper limit of a network bandwidth shared by the multiple business systems; in response to the first access traffic being greater than or equal to the upper limit of the network bandwidth, adjusting bandwidths corresponding to the multiple business systems respectively according to the updated importance values ​​indicated by the configuration update message.

[0006] Optionally, for a business system that has been limited among multiple business systems, adjusting the bandwidths corresponding to the multiple business systems respectively includes: determining a limited business system that has been limited from the multiple business systems; determining a business system to be adjusted whose importance value has changed from the limited business system; determining current bandwidth quotas corresponding to the business systems to be adjusted respectively; adjusting the bandwidth corresponding to the business system to be adjusted from the current bandwidth quota to a target bandwidth; the target bandwidth corresponds to the updated importance value of the business system to be adjusted.

[0007] Optionally, the business system to be adjusted includes one or more of the following business systems: a first business system whose updated importance value is greater than the importance value before updating; and a second business system whose updated importance value is less than the importance value before updating.

[0008] Optionally, the updated target bandwidth corresponding to the first service system is greater than the target bandwidth before the update; and the updated target bandwidth corresponding to the second service system is less than the target bandwidth before the update.

[0009] Optionally, for business systems that are not limited in multiple business systems, the bandwidths corresponding to the multiple business systems are adjusted, including: determining a non-limited business system that is not limited from multiple business systems; determining a business system whose updated importance value is lower than a first threshold in the non-limited business system as a first business system to be limited; adjusting the bandwidth of the first business system to be limited to the first bandwidth within a first time period; the first time period and the first bandwidth both correspond to the updated importance value of the first business system to be limited.

[0010] Optionally, the method provided by the present invention also includes: after executing the step of adjusting the bandwidth of the first business system to be limited to the first bandwidth within the first time period, in response to the second access traffic of multiple business systems in the second historical period being still greater than or equal to the network bandwidth upper limit and lasting for more than a preset response time, limiting the flow of other business systems in the non-limited business system except the first business system to be limited.

[0011] Optionally, limiting the flow of other business systems except the first business system to be limited in the non-limited business system, including: determining a second business system to be limited whose importance value is not lower than the first threshold but lower than the second threshold from other business systems; determining the second time duration and second bandwidth corresponding to the second business system to be limited according to the updated importance value; adjusting the bandwidth of the second business system to be limited to the second bandwidth within the second time duration; the second time duration is greater than the first time duration, and the second bandwidth is greater than the first bandwidth.

[0012] Optionally, the method provided by the present invention also includes: continuously monitoring the access traffic of multiple business systems within a preset time period; in response to the access traffic within the preset time period being less than a safe traffic threshold and continuing for a safe period of time, adjusting the bandwidth of multiple business systems to a preset bandwidth quota.

[0013] To achieve the above objective, according to another aspect of an embodiment of the present invention, a bandwidth adjustment device is provided.

[0014] A bandwidth adjustment device according to an embodiment of the present invention includes: an update message acquisition module, which is used to acquire a configuration update message from a configuration management center monitored by a monitoring component; the configuration update message indicates an update of importance values ​​of multiple business systems; an access traffic monitoring module, which is used to acquire a first access traffic of multiple business systems within a first historical period; and compare the first access traffic with an upper limit of a network bandwidth shared by multiple business systems; and a bandwidth adjustment module, which is used to adjust the bandwidths corresponding to the multiple business systems respectively according to the updated importance values ​​indicated by the configuration update message in response to the first access traffic being greater than or equal to the upper limit of the network bandwidth.

[0015] To achieve the above objective, according to another aspect of an embodiment of the present invention, an electronic device for bandwidth adjustment is provided.

[0016] An electronic device for bandwidth adjustment according to an embodiment of the present invention comprises: one or more processors; a storage device for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement a bandwidth adjustment method according to an embodiment of the present invention.

[0017] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided.

[0018] A computer-readable storage medium according to an embodiment of the present invention stores a computer program, and when the program is executed by a processor, a bandwidth adjustment method according to an embodiment of the present invention is implemented.

[0019] An embodiment of the above invention has the following advantages or beneficial effects: by obtaining the configuration update message of the configuration management center monitored by the monitoring component; the configuration update message indicates the update of the importance values ​​of multiple business systems; obtaining the first access flow of multiple business systems in the first historical period; comparing the first access flow with the upper limit of the network bandwidth shared by multiple business systems; in response to the first access flow being greater than or equal to the upper limit of the network bandwidth, adjusting the bandwidths corresponding to the multiple business systems respectively according to the updated importance values ​​indicated by the configuration update message. Thus, by dynamically updating the importance values ​​of the business systems and timely monitoring the update of the importance values, it is possible to adjust the importance of different business systems at any time, and adjust the bandwidth of each business system according to the importance values ​​updated in real time by the business systems during the peak access period, thereby ensuring that during the peak access flow, the importance of the business systems is dynamically and real-time adjusted, and the system bandwidth quota is adjusted in a timely and automatic manner, ensuring that the operation of the business systems with higher importance levels after the importance adjustment can be given priority, minimizing the losses that may be caused by bandwidth overload; reducing the labor cost of bandwidth adjustment, and improving the efficiency and reliability of bandwidth management.

[0020] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0022] Figure 1 is a schematic diagram of main steps of a bandwidth adjustment method according to an embodiment of the present invention;

[0023] Figure 2 is a schematic diagram of operation logic of bandwidth adjustment according to an embodiment of the present invention;

[0024] Figure 3 is a schematic diagram of operation logic of hierarchical current limiting according to an embodiment of the present invention;

[0025] Figure 4 is another operation logic diagram of bandwidth adjustment according to an embodiment of the present invention;

[0026] Figure 5 is a schematic diagram of a result of simulating current limiting of a business system according to an embodiment of the present invention;

[0027] Figure 6 is a schematic diagram of a result of simulating the lifting of current limiting of a business system according to an embodiment of the present invention;

[0028] Figure 7 is a schematic diagram of main steps of another bandwidth adjustment method according to an embodiment of the present invention;

[0029] Figure 8 is a schematic diagram of main modules of a bandwidth adjustment device according to an embodiment of the present invention;

[0030] Fig. 9 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;

[0031] Fig.10 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0032] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0033] It should be noted that the collection, collection, updating, analysis, processing, use, transmission, storage and other aspects of user personal information involved in the technical solution of this disclosure are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security and national security.

[0034] It should be pointed out that the embodiments of the present invention and the technical features therein may be combined with each other without conflict.

[0035] Figure 1 is a schematic diagram of main steps of a bandwidth adjustment method according to an embodiment of the present invention.

[0036] like Figure 1 As shown, the bandwidth adjustment method of the embodiment of the present invention mainly includes steps S101-S104:

[0037] Step S101: Acquire a configuration update message from a configuration management center monitored by a monitoring component; the configuration update message indicates an update of importance values ​​of multiple business systems.

[0038] With the rapid development of technologies such as big data and cloud computing, in the current big data era, Kafka, as a key platform for processing, transmitting and storing massive amounts of data, is also facing constant challenges in terms of performance and stability. In particular, the bandwidth usage of the Kafka cluster is facing a major test. In order to ensure that the Kafka cluster can run stably and efficiently, bandwidth protection has become a vital task. The Kafka cluster supports the operation of multiple business systems, and multiple business systems may have different importance. Therefore, when performing bandwidth protection, it is necessary to perform differentiated flow control on each business system according to its importance, so as to ensure that high-importance business systems are given priority. In actual scenarios, the importance of each business system may change dynamically, so it is also necessary to monitor the configuration update messages of the configuration management center in real time through the monitoring component. The configuration management center can be the distributed coordination service component Zookeeper that the Kafka cluster relies on, which is configured with the importance value of each business system. Business personnel can temporarily adjust the importance value of the business system through the configuration management center.

[0039] The logic of the bandwidth adjustment method in this embodiment is as follows: Figure 2 As shown in the figure, first, the importance values ​​of multiple business systems and their updates are registered to the configuration management center, such as Zookeeper. The listening service of the Kafka platform listens to the updates of the importance values ​​in Zookeeper. When the bandwidth is determined to be overloaded, the hierarchical flow control of multiple business systems is performed. The logic of hierarchical flow control is as follows: Figure 3 As shown, the flow control of three service levels in multiple service systems is taken as an example, for example, the flow control of service systems with importance values ​​of 0, 1, and 2 is taken as an example. It can be understood that the service system can be divided into any number of levels according to the service level, and the importance values ​​of 0, 1, 2, and 3 in the embodiment of the present invention are only used as examples and are not limited.

[0040] The Kafka platform can access a variety of production / consumption businesses, where a variety of production / consumption businesses correspond to multiple business systems. According to the difference in business importance, corresponding importance values ​​are set for multiple business systems. The basis for business classification is shown in Table 1.

[0041] Table 1

[0042]

[0043] When the access traffic is large, that is, when the bandwidth is overloaded, it is necessary to adjust the corresponding bandwidth quota according to the importance of the business system to limit the user's access to the business system with lower importance, while ensuring that the user's access request to the business system with higher importance is responded to in time. The bandwidth quotas of business systems of different importance are shown in Table 2.

[0044] Table 2

[0045] Importance value Bandwidth quota (W>a>b>c) / (M / s) 3 The maximum bandwidth of the Kafka cluster (preset bandwidth quota) W 2 a 1 b 0 c

[0046] In actual application scenarios, according to the needs of business operation, there may be a need to temporarily reduce or increase the importance of a certain business system, such as changing the importance value of business system A from 0 to 2, or changing the importance value of business system B from 3 to 2. At the same time, the corresponding bandwidth quota of the business system whose importance value changes also changes accordingly, such as changing the bandwidth quota of business system A from 1M / s to 10M / s, or changing the bandwidth quota of business system B from the preset bandwidth quota WM / s to 10M / s.

[0047] In order to be able to adjust the bandwidth of each business system in real time according to the above-mentioned bandwidth adjustment parameters, such as changes in importance value and / or bandwidth quota, so as to ensure the operation of important businesses in a timely manner, the bandwidth adjustment parameters can be managed through Zookeeper. In an optional embodiment of the present invention, the configuration management center can be Zookeeper. Specifically, the bandwidth adjustment parameters set by the user for multiple business systems respectively through the Kafka platform are written into the database, and the alterConfigWithZk method of ConfigCommand.scala of the Kafka server is called using the API to register the bandwidth adjustment parameters corresponding to the multiple business systems to the ZooKeeper of the Kafka service. This process is as follows: Figure 4 shown.

[0048] Kafka's Broker listens to configuration changes by establishing a session with ZooKeeper at startup and registering a listener on the parameter configuration node. When the node data in ZooKeeper changes, such as an importance value configuration update, it notifies the Broker that registered the listener. The Broker's ZooKeeper client library receives these notifications and triggers the corresponding callback function to handle the parameter configuration changes. Through this listener mechanism, Kafka can ensure that all Brokers in the cluster can be informed of bandwidth parameter configuration changes in a timely manner and maintain the consistency of the cluster state.

[0049] In addition, in an optional embodiment of the present invention, in addition to modifying or updating the service levels of multiple business systems, the service levels of business systems can also be expanded, such as assigning a new importance value and its corresponding bandwidth quota to a new service request accessed by the Kafka platform, and registering the new importance value and its bandwidth quota to the configuration management center, that is, to the parameter configuration node in ZooKeeper. In addition to adding new service levels, the original service levels can also be deleted, and the bandwidth adjustment parameters corresponding to the service levels to be deleted in the configuration management, such as importance values ​​and / or corresponding bandwidth quotas, can be adjusted. It can be seen that by setting up a configuration management center, the scalability and flexibility of the bandwidth adjustment system are improved.

[0050] In an optional embodiment of the present invention, a configuration update message of a parameter configuration node of ZooKeeper is monitored through a Kafka service. The configuration update message includes updates of importance values ​​corresponding to multiple business systems. The configuration update message may also include updates of bandwidth quotas corresponding to multiple importance values.

[0051] When the access traffic corresponding to multiple business systems is small, there is no need to limit the access requests of multiple business systems, that is, the bandwidth quota of each business system can be kept at a larger bandwidth, such as the maximum bandwidth shared by each business system. When the access traffic is large, that is, when the bandwidth is overloaded, it is necessary to limit the traffic based on the importance of the business system to give priority to the normal operation of important business systems. When a configuration update message is obtained, it is necessary to adjust the bandwidth quota of each business system according to the latest importance value indicated by the configuration update message, thereby realizing dynamic adjustment of the bandwidth quota according to changes in the business system level and timely giving priority to the normal operation of important business systems.

[0052] Step S102: Acquire the first access traffic of multiple business systems in the first historical period, wherein the first historical period may be 0.5 hours, 1 hour, 2 hours, etc. before the moment when the acquisition operation is performed, and may be set according to historical experience, and is not limited thereto.

[0053] Step S103: Compare the first access traffic with the upper limit of the network bandwidth shared by multiple business systems. After obtaining the access traffic for this period, compare the access traffic with the upper limit of the network bandwidth configured for the multiple business systems to determine whether there is a bandwidth overload. For example, the configured network bandwidth upper limit is 100M / s, but the obtained access traffic reaches 1000M / s, so bandwidth overload occurs, and it is necessary to perform flow limiting operations on each business system. And it is necessary to perform flow limiting operations on each business system based on the latest bandwidth adjustment parameters, such as the latest importance value corresponding to each business system.

[0054] In an optional embodiment of the present invention, the flow limiting operation performed on each service system is hierarchical flow limiting, that is, when bandwidth overload occurs, the service system with the lowest service level, such as the service system with an importance value of 3, is firstly flow limited, and then a preset time period is waited, and then the preset time period before this moment, such as the access traffic within 5 minutes, is obtained, and it is confirmed whether there is still bandwidth overload. If there is no bandwidth overload, there is no need to continue to limit the flow of service systems of other service levels; if there is still bandwidth overload, it is necessary to limit the flow of the service system with the second lowest service level, such as the service system with an importance value of 2. Then continue to observe the bandwidth overload situation, and decide whether to continue to limit the flow of service systems of other levels according to the observation results.

[0055] Step S104: In response to the first access flow being greater than or equal to the upper limit of the network bandwidth, the bandwidths corresponding to the multiple business systems are adjusted according to the updated importance values ​​indicated in the configuration update message. According to the above situation, when the configuration update message is obtained and the bandwidth is overloaded, the bandwidths of the multiple business systems are adjusted according to the updated importance values, including: bandwidth adjustment for business systems that have been subjected to flow limiting operations, and bandwidth adjustment for business systems that have not been subjected to flow limiting operations.

[0056] In an optional embodiment of the present invention, for a business system that has been limited among multiple business systems, the bandwidths corresponding to the multiple business systems are adjusted, including: determining a limited business system that has been limited from multiple business systems; determining a business system to be adjusted whose importance value has changed from the limited business system; determining the current bandwidth quotas corresponding to the business systems to be adjusted; adjusting the bandwidth corresponding to the business system to be adjusted from the current bandwidth quota to the target bandwidth; the target bandwidth corresponds to the updated importance value of the business system to be adjusted. This embodiment is for a business system that has been subjected to a flow limiting operation, determining whether its importance value has changed, for a business system whose importance value has changed, determining its corresponding updated bandwidth according to the updated importance value, and adjusting the current bandwidth quota of the business system to the updated bandwidth, thereby realizing bandwidth protection operations according to the dynamically updated service level of the business system, and timely and dynamically giving priority to ensuring the normal operation of important business systems.

[0057] In an optional embodiment of the present invention, the business system to be adjusted includes one or more of the following business systems: a first business system whose importance value after update is greater than the importance value before update; a second business system whose importance value after update is less than the importance value before update. There are two types of bandwidth adjustment for the limited flow business system. One is that the business level is improved. For example, the limited flow business system A has an importance value of 0 before update and an importance value of 2 after update; the limited flow business system C has an importance value of 1 before update and an importance value of 3 after update. The other is that the business level is reduced. For example, the limited flow business system B has an importance value of 3 before update and an importance value of 2 after update; the limited flow business system D has an importance value of 2 before update and an importance value of 1 after update.

[0058] In an optional embodiment of the present invention, the updated target bandwidth corresponding to the first business system is greater than the target bandwidth before the update; the updated target bandwidth corresponding to the second business system is less than the target bandwidth before the update. For example, the bandwidth quota of the limited-flow business system A before the update was 1M / s, and its bandwidth quota after the update is 10M / s; the bandwidth quota of the limited-flow business system C before the update was 5M / s, and its bandwidth quota after the update is 100M / s. For example, the bandwidth quota of the limited-flow business system B before the update was 100M / s, and its bandwidth quota after the update is 10M / s; the bandwidth quota of the limited-flow business system D before the update was 10M / s, and its bandwidth quota after the update is 5M / s.

[0059] The hierarchical current limiting logic reference of the embodiment of the present invention Figure 3 As shown. First, start limiting the flow from the business system with the lowest business level. For example, adjust the bandwidth of the business system with an importance value of 0 from the preset bandwidth quota, such as WM / s, to 1M / s. After the adjustment takes effect, determine whether the bandwidth is still in an overloaded state and continues for a preset period of time, such as 10 minutes. If so, perform flow limiting operations on the business system of the second lowest level, and repeat the above operations until all flow limiting operations are performed on multiple business systems. The full execution of flow limiting operations here can refer to setting the bandwidth of some non-important business systems to be less than the preset bandwidth quota, and setting the bandwidth of another part of the important business systems to the preset bandwidth quota; it can also refer to setting the bandwidth of all business systems to be less than the preset bandwidth quota.

[0060] It is understandable that after the flow limiting operation is performed on all business systems, there may still be a bandwidth overload. For example, during promotional activities on e-commerce platforms, the user access traffic is huge. Even if the flow limiting operation is performed on business systems of all business levels, bandwidth overload still exists. Therefore, the technical effect of this embodiment is to minimize the losses caused by bandwidth overload.

[0061] In an optional embodiment of the present invention, for a business system that is not limited in a plurality of business systems, the bandwidths corresponding to the plurality of business systems are adjusted, including: determining a non-limited business system that is not limited from a plurality of business systems; determining a business system whose updated importance value is lower than a first threshold value in the non-limited business system as a first business system to be limited; adjusting the bandwidth of the first business system to be limited to the first bandwidth within a first duration; the first duration and the first bandwidth both correspond to the updated importance value of the first business system to be limited. For the case where all business systems are not limited, first, according to the updated importance value, within a preset duration, such as 0 minutes, the bandwidth of the business system with an updated importance value of 0 is immediately adjusted to the corresponding target bandwidth, such as 1M / s. For the case where some business systems are not limited, according to the updated importance value, it is determined that the business systems with importance values ​​of 0 and 1 have performed the limiting operation, and the non-limited business systems are business systems with importance values ​​of 2 and 3, and the bandwidth of the business system with importance value of 2 is adjusted to the target bandwidth, such as 10M / s, within a preset duration, such as 10 minutes. This embodiment achieves the technical effect of giving priority to ensuring the normal operation of important business systems by performing more severe flow limiting operations on business systems with lower levels, thereby reducing the impact of bandwidth overload on important businesses.

[0062] After the flow limiting is performed on the service system with a lower service level, the bandwidth overload phenomenon is still serious, and the flow limiting operation needs to be continued. In an optional embodiment of the present invention, the method also includes: after executing the step of adjusting the bandwidth of the first service system to be limited to the first bandwidth within the first time period, in response to the second access traffic of multiple service systems in the second historical period is still greater than or equal to the network bandwidth upper limit and the duration exceeds the preset reaction time, the flow limiting is performed on other service systems except the first service system to be limited in the non-flow-limited service system. After the flow limiting operation of the lower-level service system is performed and the preset reaction time is waited, it is ensured that the flow limiting operation of the service system of this level has taken effect. At this time, if the bandwidth overload is still serious, then the flow limiting is performed on other non-flow-limited service systems, and the other non-flow-limited service systems correspond to one or more service levels. If other non-flow-limited service systems correspond to only one service level, then the corresponding bandwidth can be directly adjusted to the target bandwidth.

[0063] In the case where other unrestricted business systems correspond to multiple business levels, in order to determine a business system with a lower level from business systems with multiple business levels, in an optional embodiment of the present invention, other business systems except the first business system to be restricted in the unrestricted business system are restricted, including: determining a second business system to be restricted whose importance value is not lower than the first threshold but lower than the second threshold from other business systems; determining the second duration and second bandwidth corresponding to the second business system to be restricted according to the updated importance value; adjusting the bandwidth of the second business system to be restricted to the second bandwidth within the second duration; the second duration is greater than the first duration, and the second bandwidth is greater than the first bandwidth. Among them, the first threshold and the second threshold can be set according to the importance values ​​of multiple business systems, and the purpose is to determine the level of multiple business systems by comparing the importance values ​​with the thresholds. The buffer time for executing the restriction operation on the business system with a lower level is shorter, that is, the time for executing the restriction operation on the business system with a lower level is more urgent, so that the bandwidth resources tend to the business system with a higher business level earlier. In addition, the bandwidth quota corresponding to the business system with a lower level is smaller, so that the bandwidth resources tend to the business system with a higher business level more.

[0064] In an optional embodiment of the present invention, in order to lift the flow limiting measures on each business system after the access peak, the method also includes: continuously monitoring the access flow of multiple business systems within a preset period of time; in response to the access flow within the preset period of time being less than the safety flow threshold and continuing for a safe period of time, adjusting the bandwidth of multiple business systems to a preset bandwidth quota. When it is monitored that the access flow is continuously less than the safety flow threshold for a reliable period of time, that is, when the bandwidth is sufficient, the bandwidth of multiple business systems is restored to the preset bandwidth quota, such as 100M / s, that is, each business system is restored to a state where it can respond to user access immediately.

[0065] During the period when each business system executes flow control, the system responds to the user's access request as follows: first calculate the time the user needs to wait before the access request is responded to; feedback the waiting time to the user client; end the access request; after the waiting time, receive the user's access request again and respond directly to it. The method for calculating the waiting time is:

[0066] O*S=(S+N)*T (1)

[0067] N=(OT) / T*W (2)

[0068] Where O is the bandwidth before the flow limit, and T is the bandwidth after the flow limit. After the time S, the bandwidth O is adjusted to T. After the bandwidth adjustment, the broker needs to delay for a period of time N before responding to the bandwidth adjustment operation. Therefore, the waiting time N = (OT) / T * W. The waiting time N is fed back to the user's client so that the user can initiate an access request again after the waiting time N. The user's access request includes storing data in the corresponding business system (production request) or obtaining data from the corresponding business system (consumption request).

[0069] The bandwidth adjustment method of this embodiment is further illustrated below:

[0070] Taking consumption (data acquisition) requests as an example, W = 50 (W is the preset bandwidth quota, also called the single-machine bandwidth threshold of each business system), c = 1, b = 5, a = 10. During the peak access period, the data acquisition programs of four different levels of business systems with importance values ​​of 0, 1, 2, and 3 are started. The test results when the hierarchical flow control is triggered are as follows: Figure 5 As shown, the business system with an importance value of 0 is immediately limited to 1M / s, the business system with an importance value of 1 is limited to 5M / s after 5 minutes, the business system with an importance value of 2 is limited to 10M / s after 10 minutes, and the business system with an importance value of 3 is not limited. That is, the flow is limited step by step from low to high levels, and bandwidth is allocated preferentially to systems with high importance levels, which is in line with the expectations of the invention.

[0071] The bandwidth adjustment method of this embodiment is further illustrated below:

[0072] Based on the above embodiment, W is modified to 1000 (simulated access peak has passed), and it can be seen that all business systems are consuming normally without being restricted. The test results are as follows Figure 6 As shown, it is consistent with the expectation of elastic bandwidth protection based on the access traffic tidal value.

[0073] The bandwidth adjustment method of this embodiment is further illustrated below. The bandwidth adjustment method of this embodiment mainly includes the following steps: Figure 7 As shown:

[0074] Step S701: Acquire a configuration update message from a configuration management center monitored by a monitoring component; the configuration update message indicates an update of importance values ​​of multiple business systems.

[0075] Step S702: Obtain the first access traffic of multiple business systems in the first historical period.

[0076] Step S703: Determine whether the first access traffic is greater than or equal to the upper limit of the network bandwidth shared by multiple business systems. If yes, execute step S704; if not, execute step S701.

[0077] Step S704: Determine the service system to be adjusted whose importance value has changed from the limited service systems.

[0078] Step S705: adjusting the bandwidth corresponding to the service system to be adjusted from the current bandwidth quota to the target bandwidth; the target bandwidth corresponds to the updated importance value of the service system to be adjusted.

[0079] Step S706: performing a hierarchical flow limiting operation on the non-flow limiting service system according to the updated importance value.

[0080] Step S707: Continuously monitor the access traffic of multiple business systems within a preset time period.

[0081] Step S708: In response to the access traffic within the preset time period being less than the safety traffic threshold and continuing for a safety period, the bandwidth of the plurality of business systems is adjusted to a preset bandwidth quota.

[0082] The bandwidth adjustment method of the embodiment of the present invention obtains the configuration update message of the configuration management center monitored by the monitoring component; the configuration update message indicates the update of the importance values ​​of multiple business systems; obtains the first access flow of multiple business systems in the first historical period; compares the first access flow with the upper limit of the network bandwidth shared by multiple business systems; in response to the first access flow being greater than or equal to the upper limit of the network bandwidth, according to the updated importance value indicated by the configuration update message, adjusts the bandwidths corresponding to the multiple business systems respectively. Thus, by dynamically updating the importance value of the business system and timely monitoring the update of the importance value, it is achieved that the importance of different business systems can be adjusted at any time, and the bandwidth of each business system is adjusted according to the importance value updated in real time by the business system during the peak access period, thereby ensuring that when the access flow peaks, the importance of the business system is dynamically and real-time adjusted, and the system bandwidth quota is adjusted in a timely and automatic manner, ensuring that the operation of the business system with a higher level of importance after the importance adjustment can be given priority, and the loss that may be caused by bandwidth overload is minimized to the greatest extent; the human cost of bandwidth adjustment is reduced, and the efficiency and reliability of bandwidth management are improved.

[0083] Figure 8 4 is a schematic diagram of main modules of a bandwidth adjustment device according to an embodiment of the present invention.

[0084] like Figure 8 As shown, the bandwidth adjustment device 800 of the embodiment of the present invention includes:

[0085] The update message acquisition module 801 is used to acquire the configuration update message of the configuration management center monitored by the monitoring component; the configuration update message indicates the update of the importance values ​​of multiple business systems;

[0086] The access traffic monitoring module 802 is used to obtain the first access traffic of multiple business systems in the first historical period; and compare the first access traffic with the upper limit of the network bandwidth shared by the multiple business systems;

[0087] The bandwidth adjustment module 803 is used to adjust the bandwidths corresponding to the multiple business systems respectively according to the updated importance values ​​indicated by the configuration update message in response to the first access traffic being greater than or equal to the network bandwidth upper limit.

[0088] In an optional embodiment of the present invention, for a business system that has been limited in multiple business systems, the bandwidth adjustment module 803 is further used to determine a limited business system that has been limited from the multiple business systems; determine a business system to be adjusted whose importance value has changed from the limited business system; determine the current bandwidth quota corresponding to the business systems to be adjusted; adjust the bandwidth corresponding to the business system to be adjusted from the current bandwidth quota to the target bandwidth; the target bandwidth corresponds to the updated importance value of the business system to be adjusted.

[0089] In an optional embodiment of the present invention, the business system to be adjusted includes one or more of the following business systems: a first business system whose updated importance value is greater than the importance value before the update; a second business system whose updated importance value is less than the importance value before the update.

[0090] In an optional embodiment of the present invention, the updated target bandwidth corresponding to the first service system is greater than the target bandwidth before the update; and the updated target bandwidth corresponding to the second service system is less than the target bandwidth before the update.

[0091] In an optional embodiment of the present invention, for a business system that is not limited in multiple business systems, the bandwidth adjustment module 803 is also used to determine a non-limited business system that is not limited from multiple business systems; determine a business system in the non-limited business system whose updated importance value is lower than a first threshold as a first business system to be limited; adjust the bandwidth of the first business system to be limited to the first bandwidth within a first time period; the first time period and the first bandwidth both correspond to the updated importance value of the first business system to be limited.

[0092] In an optional embodiment of the present invention, the bandwidth adjustment module 803 is also used to, after executing the step of adjusting the bandwidth of the first business system to be limited to the first bandwidth within the first time period, in response to the second access traffic of multiple business systems in the second historical period being still greater than or equal to the network bandwidth upper limit and lasting for more than a preset response time, limit the flow of other business systems in the non-limited business system except the first business system to be limited.

[0093] In an optional embodiment of the present invention, the bandwidth adjustment module 803 is also used to determine a second service system to be limited whose importance value is not lower than the first threshold but lower than the second threshold from other service systems; determine the second duration and second bandwidth corresponding to the second service system to be limited according to the updated importance value; adjust the bandwidth of the second service system to be limited to the second bandwidth within the second duration; the second duration is greater than the first duration, and the second bandwidth is greater than the first bandwidth.

[0094] In an optional embodiment of the present invention, the bandwidth adjustment module 803 is also used to continuously monitor the access traffic of multiple business systems within a preset time period; in response to the access traffic within the preset time period being less than the safe traffic threshold and continuing for a safe period of time, the bandwidth of the multiple business systems is adjusted to a preset bandwidth quota.

[0095] The bandwidth adjustment device of the embodiment of the present invention obtains the configuration update message of the configuration management center monitored by the monitoring component; the configuration update message indicates the update of the importance values ​​of multiple business systems; obtains the first access flow of multiple business systems in the first historical period; compares the first access flow with the upper limit of the network bandwidth shared by multiple business systems; in response to the first access flow being greater than or equal to the upper limit of the network bandwidth, according to the updated importance value indicated by the configuration update message, adjusts the bandwidths corresponding to the multiple business systems respectively. Thus, by dynamically updating the importance value of the business system and timely monitoring the update of the importance value, it is possible to adjust the importance of different business systems at any time, and adjust the bandwidth of each business system according to the importance value updated in real time by the business system during the peak access period, thereby ensuring that when the access flow peaks, the importance of the business system is dynamically and real-time adjusted, and the system bandwidth quota is adjusted in a timely and automatic manner, ensuring that the operation of the business system with a higher level of importance after the importance adjustment can be given priority, and minimizing the losses that may be caused by bandwidth overload; reducing the human cost of bandwidth adjustment, and improving the efficiency and reliability of bandwidth management.

[0096] Fig. 9 An exemplary system architecture 900 to which the bandwidth adjustment method or bandwidth adjustment device according to the embodiment of the present invention can be applied is shown.

[0097] like Fig. 9As shown, the system architecture 900 may include a Kafka platform end 901, networks 902, 903, a configuration management end 904, and business system ends 905, 906, 907. The networks 902, 903 are used to provide a medium for communication links between the Kafka platform end 901, the configuration management end 904, and the business system ends 905, 906, 907. The networks 902, 903 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0098] The Kafka platform end 901 and the business system ends 905, 906, and 907 interact with the configuration management end 904 through the networks 902 and 903 to receive or send messages, etc. The configuration management end 904 is a platform for configuring and managing the importance value of the business system. The Kafka platform end 901 obtains the configuration update message of the importance value of the business system from the configuration management end 904, and adjusts the bandwidth corresponding to the business system ends 905, 906, and 907 according to the updated importance value.

[0099] The Kafka platform end 901 may be a server that provides various services, for example, the Kafka platform end 901 provides a background management server that supports the configuration management end 904 in obtaining configuration update messages and analyzing and processing the configuration update messages. The background management server may analyze and process the obtained configuration update messages, and adjust the bandwidth corresponding to the business system ends 905, 906, and 907 according to the processing results, for example, according to the updated importance value.

[0100] It should be noted that the bandwidth adjustment method provided in the embodiment of the present invention is generally executed by the Kafka platform end 901 , and accordingly, the bandwidth adjustment device is generally arranged in the Kafka platform end 901 .

[0101] It should be understood that Fig. 9 The number of Kafka platform terminals, networks, configuration management terminals, and business system terminals in the above description is only for illustration purposes. Any number of Kafka platform terminals, networks, configuration management terminals, and business system terminals may be provided as required.

[0102] Reference below Fig.10 , which shows a schematic diagram of the structure of a computer system 1000 of an electronic device suitable for implementing an embodiment of the present invention. Fig.10 The Kafka platform end shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0103] like Fig.10As shown, the computer system 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage part 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the computer system 1000 are also stored. The CPU 1001, the ROM 1002, and the RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0104] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed, so that a computer program read therefrom is installed into the storage section 1008 as needed.

[0105] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1009, and / or installed from the removable medium 1011. When the computer program is executed by the central processing unit (CPU) 1001, the above-mentioned functions defined in the system of the present invention are executed.

[0106] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0107] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0108] The modules involved in the embodiments of the present invention may be implemented by software or hardware. The modules described may also be set in a processor, for example, it may be described as: a processor includes an update message acquisition module, an access traffic monitoring module, and a bandwidth adjustment module. The names of these modules do not constitute a limitation on the modules themselves in some cases, for example, the bandwidth adjustment module may also be described as a "module for adjusting the bandwidths corresponding to multiple business systems".

[0109] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes: obtaining a configuration update message of a configuration management center monitored by a monitoring component; the configuration update message indicates the update of the importance values ​​of multiple business systems; obtaining the first access traffic of multiple business systems in a first historical period; comparing the first access traffic with the upper limit of the network bandwidth shared by multiple business systems; in response to the first access traffic being greater than or equal to the upper limit of the network bandwidth, adjusting the bandwidths corresponding to the multiple business systems respectively according to the updated importance values ​​indicated by the configuration update message.

[0110] According to the technical solution of the embodiment of the present invention, by obtaining the configuration update message of the configuration management center monitored by the monitoring component; the configuration update message indicates the update of the importance values ​​of multiple business systems; obtaining the first access flow of multiple business systems in the first historical period; comparing the first access flow with the upper limit of the network bandwidth shared by multiple business systems; in response to the first access flow being greater than or equal to the upper limit of the network bandwidth, adjusting the bandwidths corresponding to the multiple business systems respectively according to the updated importance values ​​indicated by the configuration update message. Thus, by dynamically updating the importance values ​​of the business systems and timely monitoring the updates of the importance values, it is possible to adjust the importance of different business systems at any time, and adjust the bandwidth of each business system according to the importance values ​​updated in real time by the business systems during the peak access period, thereby ensuring that during the peak access flow, the importance of the business systems is dynamically and real-time adjusted, and the system bandwidth quota is adjusted in a timely and automatic manner, ensuring that the operation of the business systems with higher importance levels after the importance adjustment can be given priority, minimizing the losses that may be caused by bandwidth overload; reducing the labor cost of bandwidth adjustment, and improving the efficiency and reliability of bandwidth management.

[0111] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A bandwidth adjustment method, characterized in that: include: Get the configuration update message of the configuration management center monitored by the monitoring component; The configuration update message indicates the update of importance values ​​of multiple business systems; Obtaining first access traffic of the plurality of business systems in a first historical period; Comparing the first access traffic with an upper limit of a network bandwidth shared by the multiple business systems; In response to the first access traffic being greater than or equal to the network bandwidth upper limit, the bandwidths respectively corresponding to the multiple business systems are adjusted according to the updated importance values ​​indicated by the configuration update message.

2. The method according to claim 1, characterized in that For a business system whose flow has been limited among the multiple business systems, adjusting the bandwidths respectively corresponding to the multiple business systems includes: Determining a flow-limited service system that has been flow-limited from the multiple service systems; Determining a service system to be adjusted whose importance value has changed from the flow-limited service systems; Determine the current bandwidth quotas corresponding to the service systems to be adjusted respectively; The bandwidth corresponding to the service system to be adjusted is adjusted from the current bandwidth quota to the target bandwidth; the target bandwidth corresponds to the updated importance value of the service system to be adjusted.

3. The method according to claim 2, characterized in that The business system to be adjusted includes one or more of the following business systems: A first business system whose importance value after update is greater than the importance value before update; A second service system whose updated importance value is smaller than the importance value before updating.

4. The method according to claim 3, characterized in that The updated target bandwidth corresponding to the first service system is greater than the target bandwidth before the update; The updated target bandwidth corresponding to the second service system is smaller than the target bandwidth before the update.

5. The method according to claim 1, characterized in that For a service system among the multiple service systems that is not limited in flow, adjusting bandwidths respectively corresponding to the multiple service systems includes: Determining a non-flow-limited service system that is not flow-limited from the multiple service systems; Determine a service system whose updated importance value is lower than a first threshold in the non-current-limited service system as the first service system to be current-limited; The bandwidth of the first service system to be limited is adjusted to a first bandwidth within a first time period; the first time period and the first bandwidth both correspond to the updated importance value of the first service system to be limited.

6. The method according to claim 5, characterized in that Also includes: After executing the step of adjusting the bandwidth of the first business system to be limited to the first bandwidth within a first time period, in response to the second access traffic of the multiple business systems in the second historical period being still greater than or equal to the network bandwidth upper limit and lasting for more than a preset response time, the other business systems in the non-limited business system except the first business system to be limited are limited.

7. The method according to claim 6, characterized in that The limiting the flow of other service systems in the non-flow-limited service system except the first service system to be flow-limited includes: Determine, from the other service systems, a second service system to be limited, the importance value of which is not lower than the first threshold but lower than the second threshold; Determining, according to the updated importance value, a second duration and a second bandwidth corresponding to the second service system to be limited; The bandwidth of the second service system to be limited is adjusted to the second bandwidth within the second time period; the second time period is greater than the first time period, and the second bandwidth is greater than the first bandwidth.

8. The method according to claim 7, characterized in that Also includes: Continuously monitoring the access traffic of the multiple business systems within a preset time period; In response to the access traffic within the preset time period being less than the safety traffic threshold and continuing for a safety period, the bandwidth of the multiple business systems is adjusted to a preset bandwidth quota.

9. A bandwidth adjustment device, characterized in that: include: An update message acquisition module is used to obtain configuration update messages from the configuration management center monitored by the monitoring component; The configuration update message indicates the update of importance values ​​of multiple business systems; An access traffic monitoring module, used to obtain the first access traffic of the plurality of business systems in a first historical period; and comparing the first access traffic with an upper limit of a network bandwidth shared by the multiple business systems; The bandwidth adjustment module is used to adjust the bandwidths corresponding to the multiple business systems respectively according to the updated importance values ​​indicated by the configuration update message in response to the first access traffic being greater than or equal to the network bandwidth upper limit.

10. An electronic device for bandwidth adjustment, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 8.

11. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

12. A computer program product, comprising a computer program, characterized in that When the program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images