Data de-weighting method and device

A data and block data technology, applied in the field of data deduplication methods and devices, to achieve the effect of reducing data storage space and reducing storage space occupation

Inactive Publication Date: 2018-01-30
RUIJIE NETWORKS CO LTD
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, facing the rapid expansion of data, enterprises need to continuously purcha

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data de-weighting method and device
  • Data de-weighting method and device
  • Data de-weighting method and device

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0083] Example 2,

[0084] The embodiment of the present application provides a data deduplication device, which is applied to the above network architecture, refer to Picture 9 As shown in, the device 90 includes:

[0085] The segmentation unit 901 is configured to segment the data stream at equal intervals to obtain segment data to be stored, and perform equal interval segmentation on each segment data to be stored to obtain block data to be stored;

[0086] The obtaining unit 902 is configured to obtain the block hash value of the block data to be stored and the segment hash value of the segment data to be stored according to the block data to be stored obtained by the segmentation unit 901, wherein the block hash value of the block data to be stored Used to uniquely index the data to be stored, and the segment hash value of the data to be stored is used to uniquely index the data to be stored;

[0087] The searching unit 903 is configured to find the same block data as the data ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data de-weighting method and device and relates to the field of computer storage. The data de-weighting method and device are used for removing repeated data and reducing a data storage space. The method comprises the steps that a data stream is segmented at equal intervals to obtain to-be-stored segment data, and the to-be-stored segment data is partitioned at equal intervals to obtain to-be-stored block data; according to the to-be-stored block data, block Hash of the to-be-stored block data and segment Hash of the to-be-stored segment data are obtained; the block data identical to the data stream is searched for in existing data according to the segment Hash and the block Hash of the data stream and a segment list; a block pointer of the same block data in thedata stream is set to be a block pointer of the same block data in the existing data; the to-be-stored block data in the block data which is not the same in the data stream is stored, and a block pointer of the to-be-stored block data where the same block data is not found through search is set to be a storage position corresponding to the to-be-stored block data; and the segment Hash, the block Hash and the block pointers of the data stream are stored into the segment list. The embodiment is applied to data storage.

Description

technical field [0001] The invention relates to the field of computer storage, in particular to a data deduplication method and device. Background technique [0002] Hyper Converged Infrastructure (HCI for short) is an infrastructure that integrates storage, network, and computing. In such an architecture environment, virtualization software is integrated in one chassis to support smooth horizontal expansion. Scalable to both large-scale clusters and multiple data centers. Its storage is to pool the local storage of each server node in the cluster through Software Defined Storage (SDS) to form a unified distributed storage. Therefore, the hyper-converged infrastructure solves the problems of long deployment time and difficult expansion of traditional information technology (Information Technology, IT) architecture, and realizes rapid deployment and expansion; simplifies storage and data management in virtual environments, and achieves performance acceleration and capacity o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F3/06
Inventor 赖振旺
Owner RUIJIE NETWORKS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap