Data recovery method and electronic equipment in distributed file system

A technology of distributed files and recovery methods, applied in the field of data processing, can solve problems such as the slowdown of data processing speed, and achieve the effect of reducing workload and improving IP processing capability

Active Publication Date: 2020-08-25
LENOVO (BEIJING) LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present invention provides a data recovery method and electronic equipment in a distributed file system to overcome the problem in the prior art that the data processing speed decreases due to the fact that the data recovery task and the IO read and write tasks are all in charge of the main PG.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data recovery method and electronic equipment in distributed file system
  • Data recovery method and electronic equipment in distributed file system
  • Data recovery method and electronic equipment in distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0066] The embodiment of the present invention provides a data recovery method in a distributed file system. The distributed file system may be CEPH, and the distributed file system may be applied to a cluster, such as figure 1 Shown is a structural diagram of a cluster provided by an embodiment of the present invention.

[0067] The cluster includes a cloud controller 11 and a plurality of servers 12, each server 12 includes a memory 121 a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for recovering data in a distributed file system and an electronic device. A main PG obtains a data recovery task; at least one first auxiliary PG having data recovery capability and a second auxiliary PG needing to recover data are determined from all auxiliary PGs corresponding to the main PG; a first target PG is determined from the main PG and the at least one first auxiliary PG; and the first target PG is controlled to recover a file copy corresponding to the second auxiliary PG. According to the invention, data recovery of the file copy can be carried out depending on the auxiliary PG, the file copy needing to be recovered can be recovered with no need of all depending on the main PG, and therefore the workload of the main PG is reduced, the IO processing speed of the main PG is not influenced, and the IP processing capability of the cluster is improved.

Description

Technical field [0001] The present invention relates to the technical field of data processing, and more specifically to a data recovery method and electronic equipment in a distributed file system. Background technique [0002] CEPH is an open source distributed file system used to provide block, file and object interface services. CEPH uses a multiple copy mechanism to ensure data security and high availability. Specifically, the multiple copy mechanism uses PG (Placement Group) as a unit, where PG is the smallest unit of data migration and change, and is used to maintain user data (Object) in CEPH. A PG includes a primary PG and multiple secondary PGs, which are respectively distributed on different data storage devices (Object-based Storage Device, OSD). The OSD is an independent data maintenance process and is a process prone to failure in the cluster. [0003] When the OSD fails, the user data maintained by the primary PG and the copy of the user data maintained by the seco...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/182G06F11/14
CPCG06F11/1458G06F16/184
Inventor 温利娟
Owner LENOVO (BEIJING) LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap