Supercharge Your Innovation With Domain-Expert AI Agents!

Data migration method and device for distributed storage system

A technology of distributed storage and partial data, which is applied in electronic digital data processing, structured data retrieval, special data processing applications, etc., and can solve the problems of cumbersome operation and inapplicability.

Pending Publication Date: 2021-10-01
ZHEJIANG DAHUA TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method requires manual intervention, the operation is cumbersome, and it is not suitable for scenarios where manual hard disk migration cannot be performed manually in the computer room

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data migration method and device for distributed storage system
  • Data migration method and device for distributed storage system
  • Data migration method and device for distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0101] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Apparently, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0102] Below, in order to facilitate the understanding of the embodiments of the present application, the technical terms involved in the present application are firstly introduced:

[0103] (1) SMR memory: It can also be called SMR hard disk. It is a large-capacity, cost-effective hard disk that has appeared in recent years. It improves storage density by means of fewer sector intervals. It can support continuous reading and writing o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data migration method and device for a distributed storage system. The data migration method and device are used for achieving load balancing among data nodes in a distributed storage cluster in a scene where manual intervention cannot be achieved. The method comprises the steps that when a metadata server determines that a part of data needs to be selected and migrated from a first data node to a second data node, a plurality of data blocks stored in a first storage area of a first SMR memory of the first data node serve as data to be migrated according to a first mapping table, wherein the first mapping table is used for representing a correspondence relationship among user files, SMR memories to which storage areas stored by the user files belong, and data nodes to which the SMR memories belong; the metadata server sends a migration instruction to the first data node, wherein the migration instruction is used for indicating the first storage area; the metadata server receives the plurality of data blocks stored in the first storage area and read by the first data node; and the metadata server writes the plurality of data blocks into the second data node.

Description

technical field [0001] The invention relates to the field of distributed storage, in particular to a data migration method and device for a distributed storage system. Background technique [0002] During the use of the existing distributed storage system, with the growth of business scale, the distributed storage system will inevitably encounter insufficient capacity. At this time, it is necessary to expand the capacity of the distributed storage system, add some new data nodes or Added some SMR memory. Since the metadata server of the distributed storage system is usually load-balanced based on the available capacity of the data nodes, the metadata server will preferentially write data to the data nodes newly added to the distributed storage system, resulting in the newly added data nodes A low resource and memory condition has occurred. [0003] The current method to solve this problem is to manually migrate the SMR memory in the data nodes, that is, manually plug and u...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06G06F16/27
CPCG06F3/064G06F16/27G06F3/0647
Inventor 罗心寇耀飞王志豪周明伟江文龙
Owner ZHEJIANG DAHUA TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com