Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for thermal migration based on file directory

A file directory, hot migration technology, applied in file systems, file system management, special data processing applications, etc., can solve problems such as affecting the performance of front-end IO, and achieve the effect of small impact

Active Publication Date: 2020-07-28
SANGFOR TECH INC
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to provide a method and device for hot migration based on a file directory, aiming to solve the problem that the existing hot migration technology is not isolated from the foreground IO, and thus continuously affects the performance of the foreground IO during the long process of data migration technical issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for thermal migration based on file directory
  • Method and device for thermal migration based on file directory
  • Method and device for thermal migration based on file directory

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0039] refer to figure 1 , figure 1 It is a schematic diagram of the logical relationship of an embodiment of the distributed file system in the file directory-based hot migration method of the present invention.

[0040] Such as figure 1 As shown, in this embodiment, a layer of transparent migration logic is added under the upper-layer distributed file system. The entire migration process is controlled by the server side and is transparent to the client. Therefore, the migration logic in this embodiment is the same as The client's migration logic does not interfere with each other.

[0041] MDS means metadata server, which is mainly responsible for monitoring the status of physical nodes and calculating the data layout according to the load situation and: 1. Collecting the load situation of each brick at regular i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a file directory-based thermal migration method, which is applied to a distributed file system. The method comprises the steps of creating a local copy of each file in a to-be-migrated file directory; migrating data by adopting asynchronous operation, migrating a first part of the data in the local copy to an immigration end from an emigration end, and isolating foreground IO in the data migration process; when the migration of the first part of the data is finished, blocking the foreground IO, migrating the data by adopting synchronous operation, and migrating a second part of the data in the local copy to the immigration end from the emigration end; and switching an access path of each file in the to-be-migrated file directory to the immigration end from the emigration end, wherein a total data quantity of the data migrated by the asynchronous operation is greater than that of the data migrated by the synchronous operation. The invention furthermore discloses a file directory-based thermal migration apparatus. According to the method and the apparatus, the effect of least influence on the foreground IO is achieved while thermal migration of a large amount of data is realized.

Description

technical field [0001] The invention relates to the field of distributed file systems, in particular to a file directory-based hot migration method and device. Background technique [0002] In the existing distributed storage system based on the file system, as the amount of reading and writing increases or the behavior of capacity expansion and contraction occurs, the distribution of files in the system will be unbalanced, so hot migration is required. [0003] However, in the existing hot migration technology based on the distributed file system, multiple copies of the files to be migrated need to be written synchronously at the same time, so it cannot be isolated from the foreground IO, resulting in continuous impact on the foreground IO during the long data migration process performance. Contents of the invention [0004] The main purpose of the present invention is to provide a method and device for hot migration based on a file directory, aiming at solving the probl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/11
CPCG06F16/119
Inventor 曾震
Owner SANGFOR TECH INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com