Data storage method, data scheduling method, device and system

Abstract

The invention discloses a data storage method, a data scheduling method, a device and a system. The data scheduling method comprises: the server of a distributed cache system obtaining memory use information of each cache node; the server, according to the memory use information of each cache node, determining a source cache node needing data migration, and determining a Hash barrel needing migration on the source cache node and a target cache node capable of accommodating data in the Hash barrel after the source cache node needing the data migration is determined; the server sending a data scheduling instruction to the source cache node so as to instruct the source cache node to migrate the data needing the migration in the Hash barrel to the target cache node; and the server sending a mapping relation updating instruction to a client which the migrated Hash barrel belongs to so as to instruct the client to update the mapping relation between the Hash barrel and the cache nodes according to data migration of this time.

Description

technical field [0001] The present invention relates to the technical field of communication networks, in particular to a data access method, scheduling method, equipment and system. Background technique [0002] In the Web 2.0 era, most applications on the Internet store data in relational databases, and clients read data from the databases. However, as the amount of data increases and the amount of data access increases, a series of problems such as increased database load, performance degradation, slow response, and website display delays will appear. In this context, a memory-based cache server emerges as the times require. . [0003] Usually, existing data access schemes that support multiple clients are implemented through a consistent hash algorithm. The consistent hashing algorithm realizes the distributed storage of data by projecting the hash values ​​of each cache node and data primary key onto a ring space. When judging which cache node a certain data falls in...

AI Technical Summary

Problems solved by technology

It can be seen from this that the introduction of virtual cache nodes makes the data access process more complicated and reduces the data access performance

[0006] 2. In a multi-client environment, the size of a single piece of data on different clients may be different, which results in that even though the number of pieces of data cached on each cache node is the same, the total data size is different, that is, some cache nodes occupy more memory. Many, some cache nodes occupy less memory, and the problem of uneven data distribution is not only not avoided, but may be enlarged, which in turn greatly reduces the memory utilization of cache server nodes

Images