Efficient data migration method and device for deduplication storage system

A storage system and data technology, applied in the direction of file system, file system management, file system function, etc., to achieve the effect of strong adaptability and reduce space cost

Active Publication Date: 2021-11-02
NAT UNIV OF DEFENSE TECH
View PDF16 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Existing data migration methods cannot solve the above problems at one time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Efficient data migration method and device for deduplication storage system
  • Efficient data migration method and device for deduplication storage system
  • Efficient data migration method and device for deduplication storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058]In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0059] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in one or more embodiments of the present specification shall have common meanings understood by those skilled in the art to which the present application belongs. "First", "second" and similar words used in one or more embodiments of the present specification do not indicate any order, quantity or importance, but are only used to distinguish different components. "Comprising" or "comprising" and similar words mean that the elements or items appearing before the word include the elements or items listed after the word and their equivalents, without excluding other elements or items. Words such as "connected" or "con...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an efficient data migration method and device for a deduplication storage system, and the method comprises the steps: receiving a data migration request, determining a corresponding source server, and determining a to-be-migrated file in the source server; based on the to-be-migrated file and a preset number of independent hash functions, determining bit vectors corresponding to the available servers, and determining candidate servers based on the bit vectors; based on the to-be-migrated file, determining file space overlapping data with each candidate server and a data volume of a shared partition block, and based on the file space overlapping data and the data volume, determining a space saving index corresponding to each candidate server; and based on the space-saving index, determining a target migration file and determining a target server in the candidate servers so as to migrate the target migration file to the target server, and updating the bit vector and the space-saving index. Therefore, extra space cost is reduced in the data migration process, and efficient and high-adaptability data migration is carried out.

Description

technical field [0001] The present application relates to the technical field of data migration, and in particular to an efficient data migration method and device for a deduplication storage system. Background technique [0002] With the introduction of de-duplication technology, traditional migration methods face serious challenges. First, deduplication creates a data-sharing dependency within the storage file; breaking this dependency during migration adds additional space overhead. Second, eliminating redundancy increases the risk of data being unavailable if a server crashes. Existing data migration methods cannot solve the above problems at one time. Contents of the invention [0003] In view of this, the purpose of this application is to propose an efficient data migration method and device for a deduplication storage system, so as to solve the above technical problems. [0004] Based on the above purpose, this application provides: [0005] An efficient data mi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/11G06F16/13G06F16/17
CPCG06F16/119G06F16/134G06F16/176
Inventor 郭得科罗来龙程葛瑶夏俊旭张千桢
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products