Data Processing Method, Apparatus and Cloud Service System
By dynamically adjusting the bandwidth of each working node in the central node of the cloud service system, and based on the current traffic information and preset thresholds, the network instability caused by burst traffic is solved, and efficient resource utilization and dynamic balance of performance is achieved.
Patent Information
- Application Number
- CN202510162260.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-14
- Publication Date
- 2025-06-20
- Estimated Expiration
- 2045-02-14
AI Technical Summary
In cloud service systems, burst traffic can easily lead to instability in the environment network, and existing capacity expansion and traffic supervision solutions have problems of wasted resources and low utilization.
By obtaining the current traffic information of each work node at the central node of the cloud service system, counting the total traffic information, determining the bandwidth adjustment strategy based on the preset threshold, and adjusting the bandwidth of each work node to achieve dynamic balance.
The dynamic balance between network stability and performance of cloud service systems is achieved, avoiding resource waste and improving the utilization rate of network resources.
Smart Images

Figure CN119629062B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of this specification relate to the technical field of cloud services, and particularly to a data processing method. Background Art
[0002] With the development of computer technology, cloud technology has made great progress. In a cloud environment, especially in the scenarios of private clouds and dedicated clouds, computer clusters in a computer room are usually located within the same network environment. If there is sudden traffic, the networks of other nodes in the entire computer room will also be affected.
[0003] Generally, the environmental network is prone to instability due to sudden traffic. This instability can be solved by expanding equipment, but simply expanding equipment will cause waste of resources. Another solution is to perform traffic supervision or traffic shaping on the traffic, and prevent traffic peaks by pre-configuring traffic rules and bandwidth limits of network nodes. However, this processing method is not flexible enough and has a low utilization rate of network resources. Summary of the Invention
[0004] In view of this, the embodiments of this specification provide a data processing method. One or more embodiments of this specification also relate to a data processing device, a cloud service system, an electronic device, a computer-readable storage medium, and a computer program product to solve the technical defects existing in the prior art.
[0005] According to the first aspect of the embodiments of this specification, a data processing method is provided, which is applied to a central node of a cloud service system. The cloud service system includes a central node and at least one working node. The method includes:
[0006] Obtain the current traffic information corresponding to each working node;
[0007] Statistically calculate the current total traffic information corresponding to the cloud service system according to each current traffic information, and determine a bandwidth adjustment strategy according to the current total traffic information and a preset traffic threshold;
[0008] Determine at least one target working node according to the bandwidth adjustment strategy, and obtain the current node bandwidth information corresponding to each target working node;
[0009] Adjust each current node bandwidth information according to the bandwidth adjustment strategy to generate the target node bandwidth information corresponding to each target working node.
[0010] According to the second aspect of the embodiments of this specification, a cloud service system is provided, including a central node and at least one working node;
[0011] The central node is configured to allocate the current traffic allocation information corresponding to each working node to each working node;
[0012] Each working node is configured to send network status information to the central node;
[0013] The central node is further configured to: statistically calculate the current total traffic information corresponding to the cloud service system according to the current traffic information of each working node; determine a bandwidth adjustment policy according to the current total traffic information and a preset traffic threshold; determine at least one target working node according to the bandwidth adjustment policy, and obtain the current node bandwidth information corresponding to each target working node; adjust each current node bandwidth information according to the bandwidth adjustment policy, generate the target node bandwidth information corresponding to each target working node, and send the target node bandwidth information corresponding to each target working node to each target working node, where the current traffic information includes the current traffic allocation information and the network status information;
[0014] Each target working node is configured to update the bandwidth information according to the target node bandwidth information.
[0015] According to a third aspect of the embodiments of the present specification, a data processing device is provided, which is applied to the central node of a cloud service system. The cloud service system includes a central node and at least one working node. The device includes:
[0016] An acquisition module, configured to acquire the current traffic information corresponding to each working node;
[0017] A statistics module, configured to statistically calculate the current total traffic information corresponding to the cloud service system according to each current traffic information, and determine a bandwidth adjustment policy according to the current total traffic information and a preset traffic threshold;
[0018] A determination module, configured to determine at least one target working node according to the bandwidth adjustment policy, and obtain the current node bandwidth information corresponding to each target working node;
[0019] An adjustment module, configured to adjust each current node bandwidth information according to the bandwidth adjustment policy, and generate the target node bandwidth information corresponding to each target working node.
[0020] According to a fourth aspect of the embodiments of the present specification, an electronic device is provided, including:
[0021] A memory and a processor;
[0022] The memory is used to store computer programs / instructions, and the processor is used to execute the computer programs / instructions. When the computer programs / instructions are executed by the processor, the steps of the above method are implemented.
[0023] According to the fifth aspect of the embodiments of this specification, a computer-readable storage medium is provided, which stores a computer program / instructions. When the computer program / instructions are executed by a processor, the steps of the above method are implemented.
[0024] According to the sixth aspect of the embodiments of this specification, a computer program product is provided, including a computer program / instructions. When the computer program / instructions are executed by a processor, the steps of the above method are implemented.
[0025] The data processing method provided by the embodiments of this specification combines the real-time network environment in the cloud service system to adaptively generate a bandwidth adjustment strategy suitable for the current network condition, rather than specifying a bandwidth adjustment rule once for all. Thus, it is possible to dynamically adjust the node bandwidth information of each working node according to the current total traffic information in the cloud service system, and adaptively adjust the network bandwidth of each working node according to the environmental network situation. Through this method, it can be ensured that the cloud service system achieves a dynamic balance between network stability and network performance, while ensuring stability, it can also make full use of network bandwidth resources. Description of the Drawings
[0026] Figure 1 is a schematic diagram of the architecture of a cloud service system provided by an embodiment of this specification;
[0027] Figure 2 is a flowchart of a data processing method provided by an embodiment of this specification;
[0028] Figure 3 is a schematic diagram of the structure of a data processing device provided by an embodiment of this specification;
[0029] Figure 4 is a block diagram of the structure of an electronic device provided by an embodiment of this specification. Detailed Embodiments
[0030] Many specific details are set forth in the following description in order to provide a thorough understanding of this specification. However, this specification can be implemented in many other ways different from those described herein, and those skilled in the art can make similar generalizations without departing from the connotation of this specification. Therefore, this specification is not limited by the specific embodiments disclosed below.
[0031] The terms used in one or more embodiments of this specification are for the purpose of describing specific embodiments only and are not intended to limit one or more embodiments of this specification. The singular forms "a", "the", and "said" used in one or more embodiments of this specification and the appended claims are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of this specification refers to and encompasses any and all possible combinations of one or more of the associated listed items.
[0032] It should be understood that although the terms first, second, etc. may be used in one or more embodiments of this specification to describe various information, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of one or more embodiments of this specification, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to a determination".
[0033] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this specification are all information and data that have been authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant laws, regulations, and standards in the relevant regions, and corresponding operation entrances are provided for users to select authorization or rejection.
[0034] First, the noun terms involved in one or more embodiments of this specification are explained.
[0035] Traffic policing: By controlling network traffic, it supervises the traffic. It is usually applied to limit the network speed in the ingress direction of the network. For the traffic that arrives, it makes a judgment. If it exceeds the preset threshold, the packet is discarded or a degradation policy is executed; otherwise, it passes through, thus achieving the effect of preventing burst traffic. When the traffic enters the network, it is marked and classified, and when it reaches the other end, operations such as passing, packet dropping, and degradation are performed according to the threshold and different traffic classes.
[0036] Traffic shaping: It is also a way to control network traffic. In a traffic shaping policy, the traffic is usually distributed to a transmission queue, and traffic limiting methods such as token buckets are applied to the queue for transmission. Traffic shaping policies are usually applied to the egress of the network to match the upstream and downstream packet speeds and avoid the downstream being filled with upstream traffic, resulting in network packet loss.
[0037] Token Bucket: A traffic throttling algorithm that controls the data sending rate through a "bucket". A certain number of tokens are stored in the bucket, and each token represents the sending permission for a data packet. The system adds tokens to the bucket at a fixed rate, and the sending of data packets consumes tokens. If there are no tokens in the bucket, the data packets need to wait.
[0038] In the cloud environment scenario, especially in the private cloud and dedicated cloud scenarios, the computer clusters in the computer room are on the same network. If there is bursty traffic, the networks of other nodes in the entire computer room will also be affected.
[0039] When the environmental network becomes unstable due to bursty traffic, the environmental network devices are usually expanded and upgraded to cope with possible future traffic peaks. However, most of the time, the environmental network operates with a relatively low and stable load, and blindly expanding the capacity will cause a great waste of resources. Therefore, in practical applications, traffic supervision or traffic shaping is also considered. By pre-configuring traffic rules, bandwidth limits, etc. of network nodes, traffic peaks can be prevented, but this solution is not flexible enough and the utilization rate of network resources is not high enough.
[0040] Based on this, in this specification, a data processing method is provided. This specification also relates to a data processing device, a cloud service system, an electronic device, a computer-readable storage medium, and a computer program product, which will be described in detail one by one in the following embodiments.
[0041] See Figure 1 , Figure 1 shows a schematic architecture diagram of a cloud service system provided by an embodiment of this specification. As Figure 1 shown, the cloud service system includes a central node 102 and at least one working node 104 (multiple working nodes 104 are shown in the figure).
[0042] The central node 102 is configured to allocate the corresponding current traffic allocation information for each working node to each working node;
[0043] Each working node 104 is configured to send network status information to the central node;
[0044] The central node is further configured to statistically calculate the current total traffic information corresponding to the cloud service system according to the current traffic information of each working node; determine a bandwidth adjustment policy according to the current total traffic information and a preset traffic threshold; determine at least one target working node according to the bandwidth adjustment policy, and obtain the current node bandwidth information corresponding to each target working node; adjust the current node bandwidth information according to the bandwidth adjustment policy, generate the target node bandwidth information corresponding to each target working node, and send the target node bandwidth information corresponding to each target working node to each target working node, where the current traffic information includes current traffic allocation information and network status information;
[0045] Each target working node is configured to update the bandwidth information according to the target node bandwidth information.
[0046] Among them, the central node 102 is responsible for traffic transit within the cloud service system environment and acts like a router. The working node 104 is responsible for processing each service traffic.
[0047] In a specific embodiment provided in this specification, the traffic sent to the cloud service system will first be concentrated in the central node, and then each service traffic will be allocated to each working node in the central node. Therefore, the current traffic information corresponding to each working node will be retained in the central node.
[0048] At the same time, each working node will regularly send the network status information of the working node to the central node. The network status information can be understood as the information used to characterize the network status when the working node is performing network data processing. For example, network latency, packet loss rate, etc. In practical applications, a proxy detector (monitor_agent) will be deployed in each working node. The monitor_agent is a detection module deployed on the working node and is responsible for collecting the network status information of each working node and uploading it to the central detector (monitor_server) in the central node.
[0049] The monitor_server is deployed in the central node and is responsible for centrally receiving the network status information sent by the monitor_agent in each working node and simultaneously obtaining the current traffic allocation information corresponding to the working node.
[0050] In practical applications, the central node adjusts the traffic in each working node according to the current traffic information of each working node, so as to generate corresponding traffic adjustment strategies. Specifically, a Quality of Service Decision Module (qos_decider) is deployed in the central node. The qos_decider is used to connect to the monitor_server, obtain the data in the monitor_server control, process it accordingly, generate corresponding target node bandwidth information, and send the target node bandwidth information to the corresponding target working nodes. The target working node can be understood as the node that needs to adjust the bandwidth information.
[0051] A Quality of Service Execution Module (qos_client) is deployed in the working node, which is responsible for receiving the target node bandwidth information sent by the qos_decider in the central node and adjusting the bandwidth of the working node according to the target node bandwidth information.
[0052] It should be noted that for any working node, there is corresponding rated bandwidth information and current node bandwidth information. Among them, the rated bandwidth information can be understood as the maximum network bandwidth determined based on the physical attributes of the network card of the working node, and the current bandwidth information can be understood as the network available bandwidth controlled by software. In practical applications, the current bandwidth information can be restricted and expanded through software control, and the adjusted bandwidth information is called the target node bandwidth information. The target node bandwidth information should be less than or equal to the rated bandwidth information, that is, the adjustment of the bandwidth size at the software level cannot exceed the network size at the physical level of the network card.
[0053] In the cloud service system provided in the embodiments of this specification, the central node statistically calculates the current total traffic information corresponding to the cloud service system according to the current traffic information of each working node. The current total traffic information is the real-time traffic information in the current cloud service system. It is necessary to determine the bandwidth adjustment strategy according to the current total traffic information and the preset traffic threshold, that is, to determine how to adjust the working nodes in the cloud service system and which working nodes in the cloud service system to adjust. After adjusting the bandwidth information of each target working node according to the bandwidth adjustment strategy, the target node bandwidth information corresponding to each target working node is sent to each target working node. The bandwidth information is updated according to the target node bandwidth information in each target working node.
[0054] The cloud service system provided by the embodiments of this specification has the working nodes report their respective corresponding network status information, and then combines the current traffic allocation information of each working node to adaptively generate a traffic adjustment strategy suitable for the current network condition, rather than specifying traffic adjustment rules in a one-time pre-determined manner. It can achieve restricting the egress of large-traffic nodes in the case of traffic peaks, so as to achieve the effect of peak shaving and valley filling, making the total network load in the cloud service system change smoothly. After the traffic peak, it can also adaptively increase the network bandwidth of each working node according to the network environment of the cloud service system, so as to achieve the purpose of making full use of the performance of the environmental network infrastructure.
[0055] See Figure 2 , Figure 2 FIG. shows a flowchart of a data processing method provided according to an embodiment of this specification, which is applied to the central node of a cloud service system. The cloud service system includes a central node and at least one working node, and specifically includes the following steps.
[0056] Step 202: Obtain the current traffic information corresponding to each working node.
[0057] In the data processing method provided in this embodiment, it is applied to the central node of the cloud service system in the above Figure 1 embodiment. The cloud service system includes a central node and working nodes. The central node is responsible for traffic transfer within the cloud service system environment. The traffic sent to this cloud service system will first be concentrated in the central node, and then each service traffic will be allocated to each working node in the central node. The current traffic information corresponding to each working node will be retained in the central node. Therefore, the central node will obtain the current traffic information corresponding to each working node.
[0058] Among them, the current traffic information can be understood as the information related to traffic of a working node at a certain time point. For example, if a certain working node currently has a bandwidth occupancy of 200M, then the current traffic load of this working node is 200M. The packet loss rate, network latency, etc. of this working node are all information related to the traffic of this working node. Therefore, information such as traffic load, network latency, and packet loss rate are all the current traffic information corresponding to this working node.
[0059] In a specific implementation manner provided in this specification, obtaining the current traffic information corresponding to each working node includes:
[0060] Read the current traffic allocation information corresponding to each working node;
[0061] Receive the network status information reported by each working node;
[0062] Determine the current traffic information according to the current traffic allocation information and network status information corresponding to each working node.
[0063] In a specific implementation provided by the embodiments of this specification, the current traffic information of a working node consists of at least two parts, namely the current traffic allocation information of the working node and the network status information. Among them, the current traffic allocation information can be understood as the traffic load information of the working node, and the network status information can be understood as the information used to characterize the network status when the working node performs network data processing.
[0064] The current traffic allocation information of the working node is directly obtained from the central node, and the network status information is reported by each working node. In the central node, the current traffic information corresponding to each working node can be determined according to the current traffic allocation information and network status information corresponding to each working node.
[0065] In another specific implementation provided by the embodiments of this specification, the central node can also directly obtain the network status information and current traffic allocation information reported by each working node.
[0066] Step 204: Statistically calculate the current total traffic information corresponding to the cloud service system according to each current traffic information, and determine a bandwidth adjustment strategy according to the current total traffic information and a preset traffic threshold.
[0067] After obtaining the current traffic information of each working node, the current total traffic information in the cloud service system can be statistically calculated. The current total traffic information can be understood as the total traffic information entering the cloud service system at the current moment. Through the current total traffic information, the bandwidth usage situation in the cloud service system can be determined, and further whether the cloud service system is currently operating at a high load can be determined.
[0068] After determining the current total traffic information, it is possible to further determine whether it is necessary to adjust the bandwidth of the working node according to the current total traffic information, that is, to determine the overall bandwidth adjustment strategy for the cloud service system. It should be noted that the bandwidth adjustment strategy here refers to adjusting the available bandwidth information of each working node, and the rated bandwidth information of each working node cannot be adjusted.
[0069] In a specific implementation provided by this specification, statistically calculating the current total traffic information corresponding to the cloud service system according to each current traffic information includes:
[0070] Statistically calculate the current total traffic allocation information corresponding to the cloud service system according to the current traffic allocation information corresponding to each working node.
[0071] In this implementation, statistically calculating the current total traffic information of the cloud service system specifically refers to statistically calculating the current traffic allocation information corresponding to each working node, and determining the current total traffic allocation information according to the sum of the current traffic allocation information corresponding to each working node.
[0072] For example, taking a cloud service system with 3 working nodes as an example for explanation, where the current traffic allocation information of working node 1 is 200M, the current traffic allocation information of working node 2 is 400M, and the current traffic allocation information of working node 3 is 300M, then the total current traffic allocation information is 900M (200M + 300M + 400M). In the method provided in the embodiments of this specification, the total current traffic information specifically includes the total current traffic allocation information. In subsequent processing, only the total current traffic allocation information needs to be used to determine the bandwidth adjustment strategy.
[0073] In a specific embodiment provided in this specification, determining the bandwidth adjustment strategy according to the total current traffic information and a preset traffic threshold includes:
[0074] Obtain the preset traffic threshold;
[0075] In the case where the total current traffic information is greater than the preset traffic threshold, determine that the bandwidth adjustment strategy is a bandwidth restriction strategy;
[0076] In the case where the total current traffic information is less than or equal to the preset traffic threshold, determine that the bandwidth adjustment strategy is a bandwidth relaxation strategy.
[0077] After determining the total current traffic information, the bandwidth adjustment strategy can be determined according to the total current traffic information and the preset traffic threshold. The total current traffic information and the preset traffic threshold are used to judge the traffic load status of the current cloud service system. If the total current traffic information is greater than the preset traffic threshold, it is determined that the cloud service system has a high load; if the total current traffic information is less than or equal to the preset traffic threshold, it means that the cloud service system has a low load.
[0078] In this embodiment, if the total current traffic information is greater than the preset traffic threshold, it means that the cloud service system has a high load and the bandwidth of some nodes in the cloud service system needs to be restricted, that is, the current bandwidth adjustment strategy is a bandwidth restriction strategy. The bandwidth restriction strategy refers to restricting the bandwidth of certain working nodes.
[0079] If the total current traffic information is less than or equal to the preset traffic threshold, it means that the cloud service system has a low load and the bandwidth of some nodes in the cloud service system can be relaxed, that is, the current bandwidth adjustment strategy is a bandwidth relaxation strategy. The bandwidth relaxation strategy refers to relaxing the bandwidth of certain working nodes.
[0080] Step 206: Determine at least one target working node according to the bandwidth adjustment strategy, and obtain the current node bandwidth information corresponding to each target working node.
[0081] After determining the bandwidth adjustment strategy, further determine the working nodes that need to have their bandwidth adjusted. In the method provided in the embodiments of this specification, at least one target working node is determined according to the bandwidth adjustment strategy, and the target working node is the working node that needs to have its bandwidth adjusted.
[0082] In this embodiment, some working nodes can be adjusted according to the actual situation, without the need to adjust all working nodes. Furthermore, the working nodes corresponding to different bandwidth adjustment strategies are also different. Therefore, it is necessary to determine the target working nodes according to the bandwidth adjustment strategy.
[0083] In a specific embodiment provided in this specification, determining at least one target working node according to the bandwidth adjustment strategy includes S2062 - S2064:
[0084] S2062. When the bandwidth adjustment strategy is a bandwidth throttling strategy, sort the current traffic information corresponding to each working node in descending order, and determine at least one target working node from the sorting result.
[0085] In the process of determining the target working node, it is necessary to classify according to the bandwidth adjustment strategy. In this embodiment, the bandwidth throttling strategy is taken as an example for explanation. When bandwidth throttling adjustment is required, it indicates that the traffic load in the cloud service system is relatively large, and the bandwidth of some working nodes needs to be restricted. Therefore, it is necessary to screen out the working nodes with larger traffic information and throttle them.
[0086] Specifically, in the scenario where the bandwidth adjustment strategy is a bandwidth throttling strategy, sort the current traffic information corresponding to each working node in descending order. Furthermore, sort the current traffic allocation information corresponding to each working node in descending order. In the sorting result, determine at least one target working node in the order from front to back.
[0087] There are many ways to determine at least one target working node. For example, a preset number of working nodes can be selected from the sorting result as the target working nodes; working nodes with current traffic allocation information greater than a preset threshold can also be used as the target working nodes; the bandwidth utilization rate of the working nodes can also be calculated based on the current traffic allocation information, and the working nodes with a bandwidth utilization rate greater than the preset threshold can be used as the target working nodes. In the method provided in the embodiments of this specification, the specific implementation manner of determining at least one target working node is not limited.
[0088] In a specific embodiment provided in the embodiments of this specification, determining at least one target working node from the sorting result includes:
[0089] Select reference working nodes from the sorting result according to a preset quantity;
[0090] Filter each reference working node according to the node whitelist to obtain at least one target working node, where the node whitelist includes nodes that do not perform bandwidth throttling.
[0091] In an actual cloud service system, different working nodes may deploy different business services. Some business services have high requirements for real-time performance and need a higher bandwidth to ensure the normal operation of the services. If bandwidth throttling is performed on the working nodes corresponding to such business services, it may affect the business services.
[0092] In a specific implementation process, the operation and maintenance personnel can also add the working nodes where some business services with high requirements for real-time performance are located to the node whitelist. The node whitelist is used to save the nodes that do not perform bandwidth throttling, that is, even if the nodes in the node whitelist meet the conditions for bandwidth throttling, no node throttling processing is performed on them.
[0093] Based on this, first select the working nodes corresponding to the preset quantity in the sorting result as reference working nodes according to the preset quantity. Then filter each reference working node through the node whitelist to determine whether there are working nodes in the node whitelist among the reference working nodes. If a certain reference working node is in the node whitelist, the reference working node can be removed from the reference working node set. The reference working nodes filtered by the node whitelist are the target working nodes.
[0094] For example, taking the preset quantity as 5 as an example for explanation, select the top 5 working nodes, namely Working Node 1, Working Node 2, Working Node 3, Working Node 4, and Working Node 5 as reference working nodes in the order of the current traffic information from large to small. Subsequently, compare these 5 working nodes with the node whitelist and find that Working Node 2 and Working Node 3 exist in the node whitelist. Therefore, it is not necessary to perform bandwidth throttling processing on Working Node 2 and Working Node 3, and then remove Working Node 2 and Working Node 3 from the reference working nodes. Finally, determine that Working Node 1, Working Node 4, and Working Node 5 are the target working nodes.
[0095] S2064. When the bandwidth adjustment policy is a bandwidth relaxation policy, read the bandwidth throttling node list, and determine at least one target working node in the bandwidth throttling node list, where the bandwidth throttling node list saves the nodes whose current node bandwidth information is less than the rated bandwidth information.
[0096] In this embodiment, the bandwidth adjustment policy is taken as an example of the bandwidth relaxation policy for explanation. When bandwidth relaxation adjustment is required, it indicates that the traffic load in the cloud service system is relatively small, and the bandwidth of some working nodes can be appropriately relaxed.
[0097] In practical applications, if the bandwidth of a certain working node has not been restricted, its corresponding bandwidth limit is still its rated bandwidth, which is determined by the physical performance of the network card of the working node and cannot be relaxed through software-level adjustment. Therefore, in the method provided in the embodiments of this specification, it is necessary to relax the bandwidth of the nodes that have undergone bandwidth restriction.
[0098] Based on this, a list of bandwidth-restricted nodes is obtained. The list of bandwidth-restricted nodes stores the nodes that have undergone bandwidth restriction in history, and the current node bandwidth information has not yet been restored to the rated bandwidth. For example, for a certain working node, its rated bandwidth is 800M, that is, the traffic limit that the working node can withstand is 800M. If this working node has been restricted in previous operations and the current node bandwidth information is 600M, it means that this working node has been restricted through software control, so that the current traffic limit that this working node can withstand is 600M. At this time, the current node bandwidth is less than the rated bandwidth, indicating that this working node has experienced bandwidth restriction. Therefore, this working node is stored in the list of bandwidth-restricted nodes. If after subsequent bandwidth relaxation operations, the current node bandwidth information of this working node is adjusted to 800M, which is the same as the rated bandwidth, it means that the current node bandwidth information of this working node has been restored to the rated bandwidth. Therefore, this working node can be removed from the list of bandwidth-restricted nodes.
[0099] In this embodiment, a bandwidth relaxation operation is performed on the working nodes in the list of bandwidth-restricted nodes. Specifically, determining at least one target working node in the list of bandwidth-restricted nodes includes:
[0100] Determining the working nodes to be processed in the list of bandwidth-restricted nodes, and obtaining the current traffic information corresponding to each working node to be processed;
[0101] Determining at least one target working node according to the current traffic information corresponding to each working node to be processed.
[0102] In practical applications, although the bandwidth load in the cloud service system is relatively low, if all are released at once, it is still possible to cause a sudden increase in the bandwidth load in the cloud service system, thus bringing a poor user experience. Therefore, in this embodiment, it is still necessary to gradually relax the bandwidth of the working nodes that have been restricted.
[0103] Specifically, first determine the to-be-processed working nodes from the bandwidth-limited node list. Here, the to-be-processed working nodes can be understood as the working nodes saved in this bandwidth-limited node list. At the same time, obtain the current traffic information corresponding to each to-be-processed working node. And determine at least one target working node according to the current traffic information corresponding to each to-be-processed working node.
[0104] The current traffic information represents the current traffic-related information of each to-be-processed working node. If the current traffic information of a certain to-be-processed working node has not reached the limit value of this working node, even if its bandwidth is relaxed in time, it will not bring favorable effects to its services. In other words, in the method provided in the embodiments of this specification, if it is necessary to relax the bandwidth of a certain working node, it is necessary to relax the working node whose current traffic information exceeds the limit value of the working node.
[0105] Based on this, it is necessary to further determine the working status of each to-be-processed working node according to the current traffic information. The current traffic information includes current traffic allocation information and network status information;
[0106] Determining at least one target working node according to the current traffic information corresponding to each to-be-processed working node includes:
[0107] According to the current traffic allocation information corresponding to each to-be-processed working node, calculate the traffic occupancy rate corresponding to each to-be-processed working node;
[0108] Determine that the to-be-processed working node with a traffic occupancy rate greater than the preset threshold and / or a network status information greater than the network status threshold is the target working node.
[0109] In practical applications, calculate the traffic occupancy rate corresponding to each to-be-processed working node according to the current traffic allocation information corresponding to each to-be-processed working node. This traffic occupancy rate can be understood as the ratio between the current traffic allocation information and the current node bandwidth information of this working node.
[0110] If the traffic occupancy rate of a certain to-be-processed working node exceeds the preset threshold, it means that the traffic load in this to-be-processed working node is relatively high, and it is necessary to relax its current node bandwidth information. In addition, the network status information corresponding to the to-be-processed working node can also be considered, such as the network delay and packet loss rate corresponding to the to-be-processed working node, etc. If the network status information is greater than the network status threshold, for example, the network delay of a certain to-be-processed working node is greater than the preset network delay, or the packet loss rate is greater than the preset packet loss rate, etc., it means that this to-be-processed working node needs more network resources for service processing. Therefore, it is necessary to appropriately relax the current node bandwidth information of this to-be-processed working node.
[0111] In practical applications, the traffic occupancy rate and the network information status can both be used as conditions for determining the target working node. Only one of the two judgment conditions needs to be satisfied, or both need to be satisfied simultaneously. In the method provided in the embodiments of this specification, no limitation is imposed on this, and it shall be subject to the actual application.
[0112] After determining the target working node, it is also necessary to obtain the current node bandwidth information corresponding to each target working node simultaneously. The current node bandwidth information can be understood as the maximum bandwidth currently corresponding to each target working node. For example, if the current node bandwidth information of a certain target working node is 600M, it means that the target working node can currently pass a maximum of 600M of traffic. It should be noted that the current node bandwidth information here specifically refers to the bandwidth information that can be software-limited or relaxed, rather than the rated bandwidth information of the target working node.
[0113] Step 208: Adjust the current node bandwidth information according to the bandwidth adjustment policy to generate the target node bandwidth information corresponding to each target working node.
[0114] After determining the target working node and the current node bandwidth information corresponding to the target working node, the current node bandwidth information can be adjusted according to the bandwidth adjustment policy to generate the target node bandwidth information corresponding to each target working node.
[0115] Among them, the target node bandwidth information can be understood as the node bandwidth information adjusted according to the bandwidth adjustment policy after software control for the target working node.
[0116] In a specific implementation manner provided in the embodiments of this specification, adjusting the current node bandwidth information according to the bandwidth adjustment policy to generate the target node bandwidth information corresponding to each target working node includes:
[0117] When the bandwidth adjustment policy is a bandwidth limit policy, obtain the preset limit ratio information;
[0118] Determine the target working node to be processed and the current node bandwidth information to be processed corresponding to the target working node to be processed, where the target working node to be processed is any one of at least one target working node;
[0119] Calculate the target node bandwidth information corresponding to the target working node to be processed according to the current node bandwidth information to be processed and the preset limit ratio information;
[0120] Add the target working node to be processed to the bandwidth limit node list.
[0121] In this embodiment, taking the bandwidth adjustment policy as the bandwidth restriction policy scenario as an example for explanation, when the bandwidth adjustment policy is the bandwidth restriction policy, the preset restriction ratio information is obtained. The preset restriction ratio information is the ratio value preset for restricting the bandwidth information. For example, in practical applications, the preset restriction ratio information can be 80% or 90%, etc.
[0122] After determining the preset restriction ratio information, the current node bandwidth information of each target working node can be restricted according to the preset restriction ratio information. Here, the to-be-processed target working node is taken as an example for explanation. The to-be-processed target working node is any one of the target working nodes.
[0123] Determine the to-be-processed target working node and the to-be-processed current node bandwidth information corresponding to the to-be-processed target working node, and calculate the target node bandwidth information corresponding to the to-be-processed target working node according to the to-be-processed current node bandwidth information and the preset restriction ratio information.
[0124] For example, taking the to-be-processed target working node 1 as an example for explanation, the to-be-processed current node bandwidth information corresponding to it is 800M. Now it is necessary to restrict its bandwidth. The preset restriction ratio information is 80%. After restricting according to the preset restriction ratio information, the obtained target node bandwidth information is 640M (800M * 80%).
[0125] After the to-be-processed target working node is subjected to the bandwidth restriction operation, the working node needs to be added to the bandwidth restriction node list, so that if bandwidth relaxation is required subsequently, the target working node can be determined from the bandwidth restriction node list. It should be noted that adding the to-be-processed target working node to the bandwidth restriction node list can be adding the IP address, MAC code, etc. of the to-be-processed target working node to the bandwidth restriction node list.
[0126] In another specific embodiment provided in the embodiments of this specification, adjusting the current node bandwidth information according to the bandwidth adjustment policy to generate the target node bandwidth information corresponding to each target working node includes:
[0127] In the case where the bandwidth adjustment policy is the bandwidth relaxation policy, obtain the preset relaxation ratio information;
[0128] Determine the to-be-processed target working node and the to-be-processed current node bandwidth information corresponding to the to-be-processed target working node, where the to-be-processed target working node is any one of at least one target working node;
[0129] Calculate the target node bandwidth information corresponding to the to-be-processed target working node according to the to-be-processed current node bandwidth information and the preset relaxation ratio information.
[0130] In this embodiment, taking the bandwidth adjustment policy as the bandwidth relaxation policy scenario as an example for explanation, when the bandwidth adjustment policy is the bandwidth relaxation policy, the preset relaxation ratio information is obtained. The preset relaxation ratio information is a ratio value preset for relaxing the bandwidth information. For example, in practical applications, the preset relaxation ratio information can be 110% or 120%, etc.
[0131] After determining the preset relaxation ratio information, the current node bandwidth information of each target working node can be relaxed according to the preset relaxation ratio information. Here, taking the target working node to be processed as an example for explanation, the target working node to be processed is any one of the target working nodes.
[0132] Determine the target working node to be processed and the corresponding current node bandwidth information of the target working node to be processed, and calculate the target node bandwidth information corresponding to the target working node to be processed according to the current node bandwidth information to be processed and the preset relaxation ratio information.
[0133] For example, taking the target working node 2 to be processed as an example for explanation, the corresponding current node bandwidth information to be processed is 600M. Now it is necessary to relax its bandwidth. The preset relaxation ratio information is 120%. Then, after relaxation according to the preset relaxation ratio information, the obtained target node bandwidth information is 720M (600M * 120%).
[0134] It should be noted that when relaxing the bandwidth of the target working node to be processed, the physical performance of the network card in the target working node to be processed also needs to be considered, and the relaxed bandwidth information cannot exceed the rated bandwidth information of the target working node to be processed. In another specific embodiment provided in the embodiments of this specification, the method further includes:
[0135] Obtaining the rated bandwidth information corresponding to the target working node to be processed;
[0136] When the target node bandwidth information is greater than or equal to the rated bandwidth information, the rated bandwidth information of the target working node to be processed is used as the target node bandwidth information, and the target working node to be processed is removed from the bandwidth reduction node list.
[0137] In practical applications, when relaxing the target working node to be processed, it is also necessary to obtain the rated bandwidth information corresponding to the target working node to be processed. Compare the target node bandwidth information with the rated bandwidth information. If the target node bandwidth information is less than the rated bandwidth information, the target node bandwidth information can be directly used. If the target node bandwidth information is greater than or equal to the rated bandwidth information, the rated bandwidth information needs to be used as the target node bandwidth information of the target working node to be processed.
[0138] If the target node bandwidth information of the target working node to be processed is the same as the rated bandwidth information, it means that the bandwidth of the target working node to be processed is not restricted at this time. In this case, the target working node to be processed can be removed from the bandwidth throttling node list.
[0139] In another specific implementation manner provided by the embodiments of this specification, the method further includes:
[0140] Receiving bandwidth adjustment requests sent by each working node;
[0141] In response to the bandwidth adjustment request and the bandwidth adjustment policy, screening out target working nodes from each working node, and sending the target node bandwidth information corresponding to each target working node to each target working node.
[0142] In the method provided by the embodiments of this specification, after the central node calculates the target node bandwidth information corresponding to each target working node, the target node bandwidth information corresponding to each target working node can be sent to the corresponding target working node. It can also be that each working node sends a bandwidth adjustment request to the central node, and the central node determines which working nodes need to adjust the bandwidth according to the bandwidth adjustment requests of each working node and the bandwidth adjustment policy, and uses the working nodes that need to adjust the bandwidth as target working nodes, and at the same time sends the target node bandwidth information corresponding to each target working node to each target working node.
[0143] For example, the central node determines that working node 1 and working node 2 are target working nodes according to the bandwidth adjustment policy. After the cloud service system receives the bandwidth adjustment requests sent by working node 1 and working node 2, it sends the target node bandwidth information of working node 1 and working node 2 to working node 1 and working node 2 respectively.
[0144] After each target working node obtains the corresponding target node bandwidth information, it can update the current node bandwidth information. It should be noted that the current node bandwidth information of the working node refers to the bandwidth information corresponding to the working node in the current state, and the target node bandwidth information is the bandwidth information that the working node is about to adjust to. Each working node can update the current node bandwidth information with the target node bandwidth information. After the update is completed, the current node bandwidth information is the same as the target node bandwidth information.
[0145] The data processing method provided in the embodiments of this specification, in combination with the real-time network environment in the cloud service system, adaptively generates a bandwidth adjustment strategy suitable for the current network condition, rather than specifying a bandwidth adjustment rule once. Thus, it can achieve restricting the egress of large-traffic nodes in the case of traffic peaks, achieving the effect of peak shaving and valley filling, making the total bandwidth load in the cloud service system change smoothly; after the traffic peak, it can also adaptively increase the network bandwidth of the working nodes according to the environmental network conditions, achieving the purpose of making full use of the performance of the network infrastructure. Through this method, it can ensure that the cloud service system reaches a dynamic balance between network stability and network performance, ensuring stability while also making full use of network bandwidth resources.
[0146] Corresponding to the above method embodiments, this specification also provides embodiments of a data processing device. Figure 3 The structural schematic diagram of a data processing device provided by an embodiment of this specification is shown. As Figure 3 shown, the device is applied to the central node of the cloud service system. The cloud service system includes a central node and at least one working node, and includes:
[0147] An acquisition module 302, configured to acquire the current traffic information corresponding to each working node;
[0148] A statistics module 304, configured to count the current total traffic information corresponding to the cloud service system according to each current traffic information, and determine a bandwidth adjustment strategy according to the current total traffic information and a preset traffic threshold;
[0149] A determination module 306, configured to determine at least one target working node according to the bandwidth adjustment strategy, and acquire the current node bandwidth information corresponding to each target working node;
[0150] An adjustment module 308, configured to adjust the current node bandwidth information according to the bandwidth adjustment strategy, and generate the target node bandwidth information corresponding to each target working node.
[0151] Optionally, the acquisition module 302 is further configured to:
[0152] Read the current traffic allocation information corresponding to each working node;
[0153] Receive the network status information reported by each working node;
[0154] Determine the current traffic information according to the current traffic allocation information and network status information corresponding to each working node.
[0155] Optionally, the statistics module 304 is further configured to:
[0156] According to the current traffic allocation information corresponding to each working node, count the current total traffic allocation information corresponding to the cloud service system.
[0157] Optionally, the statistics module 304 is further configured to:
[0158] Obtain a preset traffic threshold;
[0159] When the current total traffic information is greater than the preset traffic threshold, determine that the bandwidth adjustment policy is a bandwidth limit policy;
[0160] When the current total traffic information is less than or equal to the preset traffic threshold, determine that the bandwidth adjustment policy is a bandwidth relaxation policy.
[0161] Optionally, the determination module 306 is further configured to:
[0162] When the bandwidth adjustment policy is a bandwidth limit policy, sort the current traffic information corresponding to each working node in descending order, and determine at least one target working node from the sorting result;
[0163] When the bandwidth adjustment policy is a bandwidth relaxation policy, read the bandwidth limit node list, and determine at least one target working node from the bandwidth limit node list, where the bandwidth limit node list stores nodes whose current node bandwidth information is less than the rated bandwidth information.
[0164] Optionally, the determination module 306 is further configured to:
[0165] Select reference working nodes from the sorting result according to a preset quantity;
[0166] Filter each reference working node according to the node whitelist to obtain at least one target working node, where the node whitelist includes nodes that do not perform bandwidth limit.
[0167] Optionally, the adjustment module 308 is further configured to:
[0168] When the bandwidth adjustment policy is a bandwidth limit policy, obtain preset limit ratio information;
[0169] Determine a target working node to be processed and the corresponding current node bandwidth information to be processed for the target working node to be processed, where the target working node to be processed is any one of at least one target working node;
[0170] Calculate the target node bandwidth information corresponding to the target working node to be processed according to the current node bandwidth information to be processed and the preset reduction ratio information;
[0171] Add the target working node to be processed to the bandwidth reduction node list.
[0172] Optionally, the determining module 306 is further configured to:
[0173] Determine a working node to be processed in the bandwidth reduction node list and obtain the corresponding current traffic information for each working node to be processed;
[0174] Determine at least one target working node according to the current traffic information corresponding to each working node to be processed.
[0175] Optionally, the current traffic information includes current traffic allocation information and network status information;
[0176] The determining module 306 is further configured to:
[0177] Calculate the traffic occupancy rate corresponding to each working node to be processed according to the current traffic allocation information corresponding to each working node to be processed;
[0178] Determine that the working node to be processed with a traffic occupancy rate greater than a preset threshold and / or a network status information greater than a network status threshold is a target working node.
[0179] Optionally, the adjustment module 308 is further configured to:
[0180] When the bandwidth adjustment policy is a bandwidth relaxation policy, obtain the preset relaxation ratio information;
[0181] Determine a target working node to be processed and the corresponding current node bandwidth information to be processed for the target working node to be processed, where the target working node to be processed is any one of at least one target working node;
[0182] Calculate the target node bandwidth information corresponding to the target working node to be processed according to the current node bandwidth information to be processed and the preset relaxation ratio information.
[0183] Optionally, the device further includes an elimination module configured to:
[0184] Obtain the rated bandwidth information corresponding to the target working node to be processed;
[0185] When the target node bandwidth information is greater than or equal to the rated bandwidth information, use the rated bandwidth information of the target working node to be processed as the target node bandwidth information, and remove the target working node to be processed from the bandwidth throttling node list.
[0186] Optionally, the apparatus further includes a sending module configured to:
[0187] Receive bandwidth adjustment requests sent by each working node;
[0188] In response to the bandwidth adjustment request and the bandwidth adjustment policy, screen out target working nodes from each working node, and send the target node bandwidth information corresponding to each target working node to each target working node.
[0189] The data processing apparatus provided in the embodiments of this specification adaptively generates a bandwidth adjustment policy suitable for the current network condition in combination with the real-time network environment in the cloud service system, rather than specifying a bandwidth adjustment rule once. Thus, it can limit the egress of large-traffic nodes in the case of traffic peaks, achieve the effect of peak shaving and valley filling, and make the total bandwidth load in the cloud service system change smoothly; after the traffic peak, it can also adaptively increase the network bandwidth of the working nodes according to the environmental network conditions, so as to achieve the purpose of making full use of the performance of the network infrastructure. Through this apparatus, it can ensure that the cloud service system achieves a dynamic balance between network stability and network performance, and while ensuring stability, it can also make full use of network bandwidth resources.
[0190] The above is a schematic solution of a data processing apparatus according to this embodiment. It should be noted that the technical solution of this data processing apparatus and the technical solution of the above data processing method belong to the same concept. For the details not described in the technical solution of the data processing apparatus, reference can be made to the description of the technical solution of the above data processing method.
[0191] Figure 4 FIG. shows a structural block diagram of an electronic device 400 according to an embodiment of this specification. The components of the electronic device 400 include, but are not limited to, a memory 410 and a processor 420. The processor 420 is connected to the memory 410 through a bus 430, and a database 450 is used to store data.
[0192] The electronic device 400 further includes an access device 440, which enables the electronic device 400 to communicate via one or more networks 460. Examples of such networks include the Public Switched Telephone Network (PSTN), Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), or a combination of communication networks such as the Internet. The access device 440 may include one or more of any type of wired or wireless network interfaces (e.g., a network interface card (NIC)), such as an IEEE 802.11 Wireless Local Area Network (WLAN) wireless interface, a Worldwide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth interface, a Near Field Communication (NFC) interface, and so on.
[0193] In one embodiment of this specification, the above components of the electronic device 400 and Figure 4 other components not shown may also be connected to each other, for example, via a bus. It should be understood that Figure 4 the block diagram of the electronic device shown is for illustrative purposes only and is not a limitation on the scope of this specification. Those skilled in the art can add or replace other components as needed.
[0194] The electronic device 400 can be any type of stationary or mobile electronic device, including a mobile computer or mobile electronic device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smartphone), a wearable electronic device (e.g., a smartwatch, smart glasses, etc.) or other types of mobile devices, or a stationary electronic device such as a desktop computer or a Personal Computer (PC). The electronic device 400 can also be a mobile or stationary server.
[0195] Among them, the processor 420 is used to execute the following computer program / instructions, and when the computer program / instructions are executed by the processor, the steps of the above data processing method are implemented.
[0196] The above is a schematic solution of an electronic device according to this embodiment. It should be noted that the technical solution of this electronic device and the technical solution of the above data processing method belong to the same concept. For the details not described in detail in the technical solution of the electronic device, reference can be made to the description of the technical solution of the above data processing method.
[0197] An embodiment of this specification also provides a computer-readable storage medium that stores computer programs / instructions, and when the computer programs / instructions are executed by a processor, the steps of the above data processing method are implemented.
[0198] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the embodiment of the computer-readable storage medium, since it is basically similar to the embodiment of the data processing method, the description is relatively simple, and the relevant parts can refer to the partial description of the embodiment of the data processing method.
[0199] An embodiment of this specification also provides a computer program product, including computer programs / instructions, and when the computer programs / instructions are executed by a processor, the steps of the above data processing method are implemented.
[0200] The above is a schematic solution of a computer program product according to this embodiment. It should be noted that the technical solution of this computer program product and the technical solution of the above data processing method belong to the same concept. For the details not described in detail in the technical solution of the computer program product, reference can be made to the description of the technical solution of the above data processing method.
[0201] The above describes specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be executed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the figures do not necessarily require the particular order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0202] The computer instructions include computer program code, which may be in the form of source code, object code, executable files, or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, removable hard disk, magnetic disk, optical disc, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately increased or decreased according to the requirements of patent practice. For example, in some regions, according to patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.
[0203] It should be noted that the above describes specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require the specific order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential for the embodiments of this specification.
[0204] In the above embodiments, the descriptions of each embodiment have their own focuses. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0205] The preferred embodiments of this specification disclosed above are only used to help explain this specification. The alternative embodiments do not elaborate on all the details and do not limit the invention to the specific embodiments described. Obviously, many modifications and variations can be made according to the content of the embodiments of this specification. This specification selects and specifically describes these embodiments to better explain the principles and practical applications of the embodiments of this specification, so that those skilled in the art can well understand and utilize this specification. This specification is only limited by the claims and their full scope and equivalents.
Claims
1. A data processing method, applied to a central node of a cloud service system, wherein the cloud service system includes a central node and at least one working node, and the method includes: Allocate current traffic allocation information corresponding to each working node to each working node, receive network status information reported by each working node, and determine current traffic information according to the current traffic allocation information and network status information corresponding to each working node, wherein the current traffic information is information related to the traffic at the current moment of the working node; According to each current traffic allocation information, the current total traffic information corresponding to the cloud service system is counted, and the bandwidth adjustment strategy is determined according to the current total traffic information and a preset traffic threshold, wherein the current total traffic information is the total traffic information entering the cloud service system at the current moment; Determine at least one target working node according to the bandwidth adjustment strategy, and obtain current node bandwidth information corresponding to each target working node; The bandwidth information of each current node is adjusted according to the bandwidth adjustment strategy to generate target node bandwidth information corresponding to each target working node.
2. The method according to claim 1, determining a bandwidth adjustment strategy according to the current total traffic information and a preset traffic threshold, comprising: Get the preset flow threshold; When the current total flow information is greater than the preset flow threshold, determining that the bandwidth adjustment strategy is a bandwidth reduction strategy; When the current total flow information is less than or equal to the preset flow threshold, the bandwidth adjustment strategy is determined to be a bandwidth relaxation strategy.
3. The method according to claim 2, determining at least one target working node according to the bandwidth adjustment strategy, comprising: In the case where the bandwidth adjustment strategy is a bandwidth reduction strategy, current traffic information corresponding to each working node is sorted in descending order, and at least one target working node is determined in the sorting result; In the case where the bandwidth adjustment strategy is a bandwidth relaxation strategy, a bandwidth reduction node list is read, and at least one target working node is determined in the bandwidth reduction node list, wherein the bandwidth reduction node list stores nodes whose current node bandwidth information is less than the rated bandwidth information.
4. The method according to claim 3, wherein determining at least one target working node in the sorting result comprises: Selecting a plurality of reference working nodes from the sorting results according to a preset number; The reference working nodes are filtered according to the node whitelist to obtain at least one target working node, wherein the node whitelist includes nodes that are not subject to bandwidth reduction.
5. The method according to claim 1, adjusting the bandwidth information of each current node according to the bandwidth adjustment strategy to generate the target node bandwidth information corresponding to each target working node, comprises: When the bandwidth adjustment strategy is a bandwidth reduction strategy, obtaining preset reduction ratio information; Determine a target working node to be processed and bandwidth information of a current node to be processed corresponding to the target working node to be processed, wherein the target working node to be processed is any one of the at least one target working node; Calculate the target node bandwidth information corresponding to the target working node to be processed according to the bandwidth information of the current node to be processed and the preset reduction ratio information; The target working node to be processed is added to the bandwidth reduction node list.
6. The method according to claim 3, wherein determining at least one target working node in the bandwidth reduction node list comprises: Determine a plurality of to-be-processed working nodes in the bandwidth reduction node list, and obtain current traffic information corresponding to each to-be-processed working node; At least one target working node is determined according to the current traffic information corresponding to each working node to be processed.
7. The method of claim 6, wherein the current traffic information includes current traffic distribution information and network status information; Determining at least one target working node according to current traffic information corresponding to each working node to be processed includes: Calculate the traffic occupancy rate of each working node to be processed according to the current traffic allocation information corresponding to each working node to be processed; Determine the working node to be processed whose traffic occupancy rate is greater than a preset threshold, and / or whose network status information is greater than a network status threshold as the target working node.
8. The method according to claim 1, adjusting the bandwidth information of each current node according to the bandwidth adjustment strategy to generate the target node bandwidth information corresponding to each target working node, comprises: When the bandwidth adjustment strategy is a bandwidth relaxation strategy, obtaining preset relaxation ratio information; Determine a target working node to be processed and bandwidth information of a current node to be processed corresponding to the target working node to be processed, wherein the target working node to be processed is any one of the at least one target working node; The target node bandwidth information corresponding to the target working node to be processed is calculated according to the bandwidth information of the current node to be processed and the preset relaxation ratio information.
9. The method of claim 8, further comprising: Obtain the rated bandwidth information corresponding to the target working node to be processed; When the target node bandwidth information is greater than or equal to the rated bandwidth information, the rated bandwidth information of the target working node to be processed is used as the target node bandwidth information, and the target working node to be processed is removed from the bandwidth reduction node list.
10. The method according to any one of claims 1 to 9, further comprising: Receive bandwidth adjustment requests sent by each working node; In response to the bandwidth adjustment request and the bandwidth adjustment strategy, a target working node is selected from each working node, and target node bandwidth information corresponding to each target working node is sent to each target working node.
11. A cloud service system, comprising a central node and at least one working node; The central node is configured to allocate current traffic allocation information corresponding to each working node to each working node, wherein: The current traffic distribution information is the traffic load information of each working node at the current moment; Each working node is configured to send network status information to the central node; The central node is further configured to count the current total flow information corresponding to the cloud service system according to the current flow distribution information of each working node; Determine a bandwidth adjustment strategy according to the current total flow information and a preset flow threshold, wherein the current total flow information is the total flow information entering the cloud service system at the current moment; determine at least one target working node according to the bandwidth adjustment strategy, and obtain current node bandwidth information corresponding to each target working node; adjust the bandwidth information of each current node according to the bandwidth adjustment strategy, generate target node bandwidth information corresponding to each target working node, and send the target node bandwidth information corresponding to each target working node to each target working node; Each target working node is configured to update bandwidth information according to the target node bandwidth information.
12. A data processing device, applied to a central node of a cloud service system, wherein the cloud service system comprises a central node and at least one working node, and the device comprises: The acquisition module is configured to allocate current traffic allocation information corresponding to each working node to each working node, receive network status information reported by each working node, and determine current traffic information according to the current traffic allocation information corresponding to each working node and the network status information, wherein the current traffic information is information related to the traffic at the current moment of the working node; A statistics module is configured to count the current total traffic information corresponding to the cloud service system according to each current traffic allocation information, and determine the bandwidth adjustment strategy according to the current total traffic information and a preset traffic threshold, wherein the current total traffic information is the total traffic information entering the cloud service system at the current moment; A determination module is configured to determine at least one target working node according to the bandwidth adjustment strategy, and obtain current node bandwidth information corresponding to each target working node; The adjustment module is configured to adjust the bandwidth information of each current node according to the bandwidth adjustment strategy, and generate target node bandwidth information corresponding to each target working node.
13. An electronic device, comprising: Memory and processor; The memory is used to store computer programs / instructions, and the processor is used to execute the computer programs / instructions. When the computer programs / instructions are executed by the processor, the steps of the method described in any one of claims 1 to 10 are implemented.
14. A computer-readable storage medium storing a computer program / instruction, wherein the computer program / instruction, when executed by a processor, implements the steps of the method according to any one of claims 1 to 10.
15. A computer program product, comprising a computer program / instruction, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 10.
Citation Information
Patent Citations
Method and system for transmitting service traffic
CN109120527A
Speed limiting method, system and device
CN110858808A