Disk cache deduplication method based on mixed page

Abstract

The invention discloses a disk cache deduplication method based on a mixed page. According to a traditional LRU-based disk cache, repeated data blocks with the same content in the cache cannot be identified, so that certain redundant data exists in the cache, meanwhile, the traditional disk cache is based on a fixed page size, the page size is also an important factor influencing the cache hit rate, and the optimal page size can maximize the cache hit rate. According to the disk cache deduplication method based on the mixed page, a mixed page mechanism is introduced into the disk cache, a hugepage is added while a base page is reserved, and the size of the huge page is adjusted in a self-adaptive mode so that the hit rate can be maximized. Meanwhile, the cold and hot degrees of the base pages and the huge pages are monitored, the cold huge pages with the high repetition rate are split into the base pages or the split hot base pages are reconstructed into the huge pages, and dynamic conversion of the base pages and the huge pages is achieved. Duplicate removal processing is conducted on the base page and the huge page through the duplicate data deletion technology, and the duplicate removal rate is kept while the hit rate is maximized.

Description

Technical field [0001] The invention relates to the technical field of disk caching under a hybrid page mechanism, and in particular to a method for deduplication of a disk cache based on a hybrid page. Background technique [0002] Data deduplication technology is the main technical means to eliminate cached redundant data. It performs deduplication detection on the cache space, filters out identical data blocks and deletes them, and only keeps the only copy in the cache, thereby eliminating redundant data in the cache and saving cache space. The deduplication technology can be divided into byte-level deduplication, block-level deduplication, and file-level deduplication according to the deduplication granularity. The byte-level deduplication mainly uses Delta encoding to identify duplicate data, while the block-level and file-level are mainly used. It uses hash algorithms (such as MD5 and SHA-1) to identify corresponding duplicate data blocks. The deduplication process mainly...

AI Technical Summary

Problems solved by technology

[0004] In the process of realizing the present invention, the inventor found that there are at least the following technical problems in the prior art: the traditional disk cache system based on the LRU replacement algorithm cannot effectively identify duplicate data in the cache, resulting in a large amount of redundant data in the cache

Images