Storage system online data compression method, device and equipment

Abstract

The invention discloses a storage system online data compression method, device and equipment, and the method comprises the steps: carrying out the data compression after receiving a compression instruction, and obtaining a compressed data block; Searching corresponding segment metadata according to the main metadata, determining the initial position of the current blank storage area according tothe segment metadata, and storing the compressed data block into a physical disk according to the initial position; After a reading instruction is received, searching corresponding segment metadata according to the main metadata and the reading position of the reading instruction; Determining the position of the data to be read in the physical disk according to the searched segment metadata, and then reading the data; Wherein the segment metadata comprises feature information of segments, and the segments are storage area segments obtained by dividing virtual storage addresses corresponding tothe physical disks according to a fixed length; Wherein the main metadata comprises feature information of the segment metadata. The metadata is segmented, each segment corresponds to the virtual storage address with the fixed length, reading and writing of the compressed data are facilitated, the compression performance is improved, and management of the compressed data is facilitated.

Description

technical field [0001] The invention relates to the technical field of data compression, in particular to an online data compression method, device and equipment for a storage system. Background technique [0002] With the development of the information industry, the demand for storage capacity is increasing, the cost of storage is increasing, and the performance requirements of the storage system are getting higher and higher. Storage systems have increasingly strong requirements for compression functions, and compression technologies are constantly changing. How to improve the compression rate and reduce the compression response time has always been the research direction of the current storage system. [0003] Metadata is data that describes the characteristics of stored data. The characteristics of stored data include data length and storage location, etc. Data reading and writing need to be performed according to metadata. However, in the current metadata implementation...

AI Technical Summary

Problems solved by technology

However, due to the current large storage capacity, the overall data volume of metadata is very large

Therefore, if you need to traverse the metadata every time, it will affect the speed of writing and reading compressed data, and affect the compression performance

And it is not easy to manage all the compressed data, and the efficiency of data management is not high

Images