Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data de-weighting method and device

A data and block data technology, applied in the field of data deduplication methods and devices, to achieve the effect of reducing data storage space and reducing storage space occupation

Inactive Publication Date: 2018-01-30
RUIJIE NETWORKS CO LTD
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, facing the rapid expansion of data, enterprises need to continuously purchase a large number of storage devices to cope with the ever-increasing storage demand

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data de-weighting method and device
  • Data de-weighting method and device
  • Data de-weighting method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 2

[0084] The embodiment of the present application provides a data deduplication device, which is applied to the above-mentioned network architecture. Refer to Figure 9 As shown in, the device 90 includes:

[0085] Segmentation unit 901, for segmenting the data stream at equal intervals to obtain segment data to be stored, and performing equal-interval block division of each segment data to be stored to obtain block data to be stored;

[0086] The obtaining unit 902 is configured to obtain the block hash value of the block data to be stored and the segment hash value of the segment data to be stored according to the block data to be stored obtained by the segmentation unit 901, wherein the block hash value of the block data to be stored It is used to uniquely index the block data to be stored, and the segment hash value of the segment data to be stored is used to uniquely index the segment data to be stored;

[0087] The search unit 903 is configured to search the block data i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data de-weighting method and device and relates to the field of computer storage. The data de-weighting method and device are used for removing repeated data and reducing a data storage space. The method comprises the steps that a data stream is segmented at equal intervals to obtain to-be-stored segment data, and the to-be-stored segment data is partitioned at equal intervals to obtain to-be-stored block data; according to the to-be-stored block data, block Hash of the to-be-stored block data and segment Hash of the to-be-stored segment data are obtained; the block data identical to the data stream is searched for in existing data according to the segment Hash and the block Hash of the data stream and a segment list; a block pointer of the same block data in thedata stream is set to be a block pointer of the same block data in the existing data; the to-be-stored block data in the block data which is not the same in the data stream is stored, and a block pointer of the to-be-stored block data where the same block data is not found through search is set to be a storage position corresponding to the to-be-stored block data; and the segment Hash, the block Hash and the block pointers of the data stream are stored into the segment list. The embodiment is applied to data storage.

Description

technical field [0001] The invention relates to the field of computer storage, in particular to a data deduplication method and device. Background technique [0002] Hyper Converged Infrastructure (HCI for short) is an infrastructure that integrates storage, network, and computing. In such an architecture environment, virtualization software is integrated in one chassis to support smooth horizontal expansion. Scalable to both large-scale clusters and multiple data centers. Its storage is to pool the local storage of each server node in the cluster through Software Defined Storage (SDS) to form a unified distributed storage. Therefore, the hyper-converged infrastructure solves the problems of long deployment time and difficult expansion of traditional information technology (Information Technology, IT) architecture, and realizes rapid deployment and expansion; simplifies storage and data management in virtual environments, and achieves performance acceleration and capacity o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30G06F3/06
Inventor 赖振旺
Owner RUIJIE NETWORKS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products