Storage system online data compression method, device and equipment

A storage system and data compression technology, which is applied in electrical digital data processing, input/output process of data processing, instruments, etc., can solve the problems of large amount of metadata data, not easy to compress data, data management, and low data management efficiency.

Active Publication Date: 2019-04-26
GUANGDONG INSPUR BIG DATA RES CO LTD
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the current large storage capacity, the overall data volume of metadata is very large
Therefore, if you need to traverse the metadata every time, it will affect the ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Storage system online data compression method, device and equipment
  • Storage system online data compression method, device and equipment
  • Storage system online data compression method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050]The core of the present invention is to provide an online data compression method, device and equipment for a storage system. After the metadata is segmented, each segment corresponds to a fixed-length virtual storage address, thereby facilitating the reading and writing of compressed data and improving the compression efficiency. performance, and facilitates the management of compressed data.

[0051] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative effort...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a storage system online data compression method, device and equipment, and the method comprises the steps: carrying out the data compression after receiving a compression instruction, and obtaining a compressed data block; Searching corresponding segment metadata according to the main metadata, determining the initial position of the current blank storage area according tothe segment metadata, and storing the compressed data block into a physical disk according to the initial position; After a reading instruction is received, searching corresponding segment metadata according to the main metadata and the reading position of the reading instruction; Determining the position of the data to be read in the physical disk according to the searched segment metadata, and then reading the data; Wherein the segment metadata comprises feature information of segments, and the segments are storage area segments obtained by dividing virtual storage addresses corresponding tothe physical disks according to a fixed length; Wherein the main metadata comprises feature information of the segment metadata. The metadata is segmented, each segment corresponds to the virtual storage address with the fixed length, reading and writing of the compressed data are facilitated, the compression performance is improved, and management of the compressed data is facilitated.

Description

technical field [0001] The invention relates to the technical field of data compression, in particular to an online data compression method, device and equipment for a storage system. Background technique [0002] With the development of the information industry, the demand for storage capacity is increasing, the cost of storage is increasing, and the performance requirements of the storage system are getting higher and higher. Storage systems have increasingly strong requirements for compression functions, and compression technologies are constantly changing. How to improve the compression rate and reduce the compression response time has always been the research direction of the current storage system. [0003] Metadata is data that describes the characteristics of stored data. The characteristics of stored data include data length and storage location, etc. Data reading and writing need to be performed according to metadata. However, in the current metadata implementation...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06H03M7/30
CPCH03M7/30G06F3/0608
Inventor 王艳清徐洪志郭平加亓国强
Owner GUANGDONG INSPUR BIG DATA RES CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap