Unlock instant, AI-driven research and patent intelligence for your innovation.

A data storage method and device

A data storage and data block technology, applied in the computer field, can solve the problems of large amount of calculation, poor compression effect of deduplication algorithm, etc., and achieve the effect of reducing storage space, reducing complexity, and avoiding bit-by-bit comparison

Active Publication Date: 2021-02-12
HUAWEI TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In the prior art, the deduplication algorithm with better compression effect has a relatively large amount of computation, and the deduplication algorithm with a small amount of computation has relatively poor compression effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data storage method and device
  • A data storage method and device
  • A data storage method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053]The technical solutions in the embodiments of the present invention will be described below in conjunction with the drawings in the embodiments of the present invention.

[0054]According to this application, the storage device of the database server stores data information for the client. The data to be stored on the storage device of the database server can be deduplicated and compressed, or not deduplicated and compressed, but deduplicated. Deletion and compression can greatly reduce the storage space required on the storage device of the database server for the data to be stored, and save storage resources.figure 1 A block diagram of an exemplary networking environment of a data storage system 100 is shown. The data storage system 100 includes a client 102 and a database server 104, and further, may also include a storage device 108. It should be understood that the above naming is only for convenience of description and should not have any limitation on the present invention...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A data storage method and device are used for deduplication and compression of data stored in a database. The method includes: dividing the data block to be saved and the reference data block into N sub-data blocks to be saved with the same size, comparing the sub-data block to be saved and the reference sub-data block corresponding to the same position identification, In the data block, determine the sub-data block that can be deducted and the sub-data block that cannot be deducted, perform the deduplication operation on the sub-data block that can be deleted, select the representative sub-data block of the sub-data block that cannot be de-duplicated, and set the sub-data block that cannot be de-duplicated. The data of the block is XORed with the data representing the sub-data block, and the result of the XOR operation is compressed using run-length coding, and the compressed result and the location information of the non-removable sub-data block are saved. Through the deduplication and compression operations of the data blocks to be saved, the storage space required to save the data blocks to be saved can be reduced.

Description

Technical field[0001]The embodiments of the present invention relate to the field of computers, and in particular, to a data storage method and device.Background technique[0002]With the explosive growth of digital information, data takes up more and more space; with the exponential growth of data, enterprises are facing more and more time points for rapid backup and recovery, managing the cost of saving data and data center space And energy consumption has become more and more serious. Research has found that up to 60% of the data stored in the application system is redundant, and as time goes by, the proportion of data redundancy will increase.[0003]In order to alleviate the space growth problem of storage systems, reduce the space occupied by data, reduce costs, and maximize the use of existing resources, data deduplication technology has become a hot research topic. On the one hand, the use of data deduplication technology (hereinafter referred to as "deduplication") can optimize...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F12/00
CPCG06F3/0608G06F3/0641G06F3/067G06F12/00G06F3/0673
Inventor 李夫路张程伟徐培
Owner HUAWEI TECH CO LTD