Consistent hash-based hierarchical mixed storage system and method

Abstract

The invention discloses a consistent hash-based hierarchical mixed storage system and method, and belongs to the field of computer storage. The characteristics of various storage mediums can be utilized to the maximum extent; and storage policies are reasonably adopted, so that the system performance is improved. The method comprises the steps of designing a hierarchical consistent hash ring according to difference of the storage mediums and the storage policies; performing hierarchical storage in the hierarchical consistent hash ring through indexes such as access frequencies, capacity and the like by storage objects; introducing a monitoring module for determining data collection frequencies and data migration thresholds in different time periods; introducing a scheduling module for performing reasonable upgrading and downgrading data migration scheduling for cold and hot changes, with time, of data; and managing SSD cluster data information by adopting a forest data structure. The hierarchical storage is performed for load characteristics; different storage mediums and storage policies are provided according to the characteristics of the storage objects; the system flexibility is enhanced and the system read-write performance is improved; and the system stability is ensured.

Description

technical field [0001] The invention belongs to the technical field of hybrid storage, and more specifically relates to a layered hybrid storage system and method based on consistent hashing. Background technique [0002] The design of storage system has always tended to pursue the characteristics of high performance, large capacity and low cost. Traditional hard disk (HDD) has large capacity and low price, but its mechanical characteristics lead to high energy consumption and poor random read and write performance. Solid State Disk (SSD) uses semiconductor technology and flash memory (flash) as the storage medium. Compared with HDD, it has the advantages of fast random read and write speed, low power consumption, and good shock resistance. Since an erase operation is required before writing data to the SSD, its lifespan is affected. In addition, the SSD has a small capacity and is expensive. Obviously, the storage system is not suitable for using SSD as its only storage d...

AI Technical Summary

Problems solved by technology

[0005] In view of the above defects or improvement needs of the prior art, the present invention provides a layered hybrid storage system and method based on consistent hashing, thereby solving the problem that modern storage systems do not comprehensively consider storage media, data size, data coldness, The selection of customer access characteristics and redundant storage strategy ignores the occasional characteristics of customer access, resulting in high data migration frequency, affecting system efficiency and non-universal technical problems

Images