Method and device for file migration

A file migration and file technology, applied in the storage field, can solve problems that affect the processing performance of node 1, slow migration speed, and high work pressure of node 1, and achieve the effects of improving file migration speed, pressure load balancing, and ensuring data consistency

Active Publication Date: 2019-07-16
ZHEJIANG UNIVIEW TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In the current file migration process, usually all files are migrated by node 1. For example, node 1 migrates file A and file B in distributed sub-volume D1 to distributed sub-volume D2. When there are many files to be migrated, node 1 The work pressure of node 1 is very high, and the migration speed is slow, which affects the processing performance of node 1

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for file migration
  • Method and device for file migration
  • Method and device for file migration

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The terminology used in the present invention is for the purpose of describing specific embodiments only, not limiting the present invention. As used herein and in the claims, the singular forms "a", "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items.

[0041] It should be understood that although the terms first, second, third, etc. may be used in the present invention to describe various information, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, without departing from the scope of the present invention, first information may also be called second information, and similarly, second information may also be called first information. Depend...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device for migrating files. The method comprises the following steps: selecting a first file with a highest priority from all files to be migrated; selecting a first node by using the weight of each node in an overall data set; recording a corresponding relation between each node and the weight of a distributed storage system in the overall data set; and migrating the first file from a source distributed sub volume to a target distributed sub volume via the first node. Through the technical scheme of the invention, all nodes included in the source distributed sub volume participate in a file migration; the file migrating speed can be improved; the situation of the excess pressure of a certain node can be avoided; the processing performance of each node cannot be influenced; the pressure load of the nodes can be balanced; meanwhile, the data consistency of the files before and after the migrating can be ensured.

Description

technical field [0001] The invention relates to the field of storage technology, in particular to a method and device for file migration. Background technique [0002] For distributed storage systems, it is difficult to have both data reliability and space utilization. When relatively high data reliability is guaranteed, space utilization will be low. DHT (Distributed Hash Table, Distributed Hash Table) is a distributed storage system with high space utilization. In order to ensure data reliability and fault tolerance, EC (Erasure Coding, erasure code) can also be used in DHT algorithm. [0003] Such as figure 1 As shown in , it is a schematic diagram of a network of a distributed storage system. When it is necessary to write file A, first obtain the writing location through the DHT algorithm, such as distributed sub-volume D1. Then, file A is written to each node of the distributed sub-volume D1 through the EC algorithm. For example, divide file A into 3 parts, get 3 p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/11G06F16/182
CPCG06F16/119G06F16/182
Inventor 江萍于相洋
Owner ZHEJIANG UNIVIEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap