Method, device and system of scheduling of distributed cache resources

A distributed cache and resource scheduling technology, applied in the field of communication, can solve problems such as increasing the burden on the cache client, high load, and large amount of calculation on the cache client

Active Publication Date: 2014-12-10
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF3 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the large number of virtual nodes that need to be set, the calculation amount of the cache client will also become large, which will increase the burden on the cache client; at the same time, when the load imbalance occurs again in the "circle" with virtual nodes , the exi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device and system of scheduling of distributed cache resources
  • Method, device and system of scheduling of distributed cache resources
  • Method, device and system of scheduling of distributed cache resources

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] Such as figure 2 As shown, the distributed cache resource scheduling method provided in this embodiment includes the following steps:

[0061] 201. Monitor the load value of each cache node in the distributed cache system; the load value here may include but not limited to the memory occupancy rate and bandwidth occupancy rate of each cache node.

[0062] 202. Determine whether there is a load abnormality in the current distributed cache system according to the load value; the load abnormality includes uneven load, too high load, or too low load.

[0063] Generally, if in the current distributed cache system, the difference between the maximum value and the minimum value of the load values ​​of all cache nodes exceeds a threshold (for example, 15%), it is considered that there is load imbalance in the current distributed cache system ;

[0064] If the overall load of all cache nodes is higher than the upper limit (such as 80%) or the minimum value of the load values ...

Embodiment 2

[0080] Such as Figure 4 As shown, the distributed cache resource scheduling method provided in this embodiment includes the following steps:

[0081] 401. Receive a notification message sent by the cache management device, where the message includes location information of an old cache node corresponding to a hash segment of data about to be lost on a virtual circle of the distributed cache system.

[0082] Wherein, the hash segment of the data about to be lost is a hash segment whose belonging cache node has changed after the layout of the cache nodes is adjusted on the virtual circle of the distributed cache system.

[0083] 402. When there is no data to be read by the cache client on the current cache node, access the old cache node according to the location information to acquire and save the data.

[0084] The execution subject of the above steps may be a cache node in the distributed cache system, and the cache node is a new cache node corresponding to the hash segment...

Embodiment 3

[0091] In this embodiment, a specific example will be used to further illustrate a method for implementing resource scheduling in a distributed cache system by moving the positions of cache nodes on the "circle".

[0092] First, judge whether there is uneven load in the current distributed cache system. The specific judgment method has been described above and will not be repeated here; if there is uneven load in the current distributed cache system, you can move the cache node in The layout of the cache nodes in the distributed cache system is adjusted by means of the position on the "circle".

[0093] Specifically, the process of moving the position of the cache node on the "circle", such as Image 6 shown, including:

[0094] 601. Select at least a pair of adjacent cache nodes on the "circle" with the largest load difference.

[0095] When selecting the adjacent cache nodes with the largest load gap on the "circle", the pair with the largest load gap can be selected. This...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method, a device and a system of scheduling of distributed cache resources. Each cache node is distributed on a virtual circle based on a consistent hashing algorithm in a distributed cache system. The method comprises the following steps of monitoring a load value of each cache node in the distributed cache system; judging whether the load in the distributed cache system is abnormal according to the load value; and if the load in the current distributed cache system is abnormal, adjusting layout of the cache nodes in the distributed cache system. According to the method, the device and the system, automatic scheduling of resource distribution in the distributed cache system is implemented, so that resource distribution is in a balance state.

Description

[0001] This application was submitted on December 31, 2009, the application number is 200980118719.2, the divisional application of the Chinese application titled "Distributed Cache Resource Scheduling Method, Device and System", the entire content of which is incorporated in this application by reference middle. technical field [0002] The present invention relates to the field of communication technologies, and in particular to a method, device and system for scheduling distributed cache resources. Background technique [0003] At present, distributed caching is a caching technology commonly used in the field of IT technology, especially in the field of Web technology. It is mainly used in web page caching, database caching, etc. to meet the user's requirements for network system response speed. [0004] In a distributed cache system, the data of the cache client needs to be distributed to each cache node through a certain load balancing algorithm; the most commonly used ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08H04L29/06H04L12/24
Inventor 陈普
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap