A Hierarchical Hybrid Storage System Based on Consistent Hash

Abstract

The invention discloses a consistent hash-based hierarchical mixed storage system and method, and belongs to the field of computer storage. The characteristics of various storage mediums can be utilized to the maximum extent; and storage policies are reasonably adopted, so that the system performance is improved. The method comprises the steps of designing a hierarchical consistent hash ring according to difference of the storage mediums and the storage policies; performing hierarchical storage in the hierarchical consistent hash ring through indexes such as access frequencies, capacity and the like by storage objects; introducing a monitoring module for determining data collection frequencies and data migration thresholds in different time periods; introducing a scheduling module for performing reasonable upgrading and downgrading data migration scheduling for cold and hot changes, with time, of data; and managing SSD cluster data information by adopting a forest data structure. The hierarchical storage is performed for load characteristics; different storage mediums and storage policies are provided according to the characteristics of the storage objects; the system flexibility is enhanced and the system read-write performance is improved; and the system stability is ensured.

Description

Technical field [0001] The invention belongs to the technical field of hybrid storage, and more specifically, relates to a hierarchical hybrid storage system based on consistent hashing. Background technique [0002] Storage system design has always tended to pursue the characteristics of high performance, large capacity, and low cost. Traditional disks (HDDs) have large capacity and low prices, but their mechanical characteristics lead to high energy consumption and poor random read and write performance. Solid state drives (SSD) use semiconductor technology with flash memory (flash) as the storage medium. Compared with HDD, it has the advantages of fast random read and write speed, low power consumption, and good shock resistance. Since the erasing operation is required before writing data to the SSD, its life span is affected. In addition, the SSD has a small capacity and is expensive. Obviously, the storage system is not suitable for using SSD as its sole storage device, an...

AI Technical Summary

Problems solved by technology

[0005] Aiming at the above defects or improvement needs of the prior art, the present invention provides a layered hybrid storage system based on consistent hashing, thereby solving the problem that modern storage systems do not comprehensively consider storage media, data size, data coldness, and customer access. The selection of characteristics and redundant storage strategy ignores the occasional characteristics of customer access, resulting in high frequency of data migration, affecting system efficiency and non-universal technical problems

Images