A Delta compressed storage component based on block-level data de-duplication

A technology for compressing storage and data, applied in the direction of input/output to the record carrier, etc., can solve the problem that the data deduplication effect is not very ideal and so on

Active Publication Date: 2019-03-08
重庆力合科技创新中心有限公司
View PDF12 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, using a single Delta compression at the file level in the actual storage system, the data deduplication effect is not very ideal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Delta compressed storage component based on block-level data de-duplication
  • A Delta compressed storage component based on block-level data de-duplication
  • A Delta compressed storage component based on block-level data de-duplication

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0097] The invention discloses a Delta compression storage component based on block-level data deduplication, such as figure 1As shown, the Delta compression storage component includes a container access module; the container access module uses a similar index, a similar buffer and a container buffer data structure to run a container storage algorithm and a container recovery algorithm; the container storage algorithm receives The write container command sent by the upper block-level data deduplication storage system performs Delta compression on the container, and writes the Delta-compressed container into the container storage pool on the disk; the container recovery algorithm receives the block-level data of the upper layer The read container command sent by the deduplication storage system reads the specified container from the container storage pool on the disk through the container index, and returns the read container to the upper block-level data deduplication storage s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Delta compressed storage component based on block-level data de-duplication. The Delta compressed storage component comprises a container access module. The container accessmodule uses the similar index, the similar buffer and the container buffer data structure to run the container storage algorithm and the container recovery algorithm. The container storage algorithm receives the block-level data of the upper layer to rewrite the writing container command sent from the storage system, compresses the container by Delta, and writes the container compressed by Delta into the container storage pool on the disk. The container recovery algorithm receives the block-level data of the upper layer to re-store the read container command sent from the storage system, readsthe specified container from the container storage pool on the disk through the container index, and returns the read container to the block-level data of the upper layer to re-store the storage system. The component of the invention can perform Delta compression on similar data blocks, eliminate byte-level duplicate data, and further improve the deletion ratio of duplicate data and the utilization ratio of storage space.

Description

technical field [0001] The invention belongs to the technical field of computer storage backup, in particular to a Delta compression storage component based on block-level data deduplication. Background technique [0002] Currently, data centers generally use data deduplication technology to save storage space and improve resource utilization. Data deduplication refers to the process of eliminating redundant files, data blocks, or bytes to ensure that only a single data instance is stored on the disk. It is also known as a capacity optimization protection technology, used to reduce the capacity of data protection need. Data deduplication mainly uses block compression and Delta compression technologies. [0003] Block compression, also known as block-level data deduplication, is a data deduplication technology currently in the mainstream. Its basic idea is to divide data streams (or files) into blocks, and then eliminate duplicate data blocks. Simple fixed-length blocks wi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06
Inventor 杨天明汤震李景富吴海涛黄平杨奕樊宜和
Owner 重庆力合科技创新中心有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap