Large-scale distributed file system data recovery method and equipment

A technology of distributed files and system data, applied in the computer field, can solve the problems of limited data repair process repair ability and long repair time.

Active Publication Date: 2017-11-28
ALIBABA GRP HLDG LTD
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0042] An object of the present invention is to provide a large-scale distributed file system data repair method and equipment, which can solve the problems of limited repair ability and long repair time in the existing data repair process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale distributed file system data recovery method and equipment
  • Large-scale distributed file system data recovery method and equipment
  • Large-scale distributed file system data recovery method and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0107] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0108] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory.

[0109] Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and / or nonvolatile memory such as read only memory (ROM) or flash RAM. Memory is an example of computer readable media.

[0110] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static rando...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention aims to provide a large-scale distributed file system data recovery method and equipment. Actually corrupted data blocks and the largest recoverable length thereof can be determined accurately according to data blocks of the viewing angle of each data block management module and the largest recoverable length thereof and corrupted data blocks of the viewing angle of a file system namespace management module, further the actually corrupted data blocks and the largest recoverable length thereof in each corrupted file are determined accurately, and quick and effective data recovery of the corrupted files is realized according to the actually corrupted data blocks and the largest recoverable length thereof in each corrupted file during the process of data recovery for distributed file system cluster power failure reboot caused by power supply failure, RPO (recovery point objective) can be increased effectively while RTO (recovery time objective) can be shortened effectively, data recovery capability is improved, and time for data recovery is reduced.

Description

technical field [0001] The invention relates to the field of computers, in particular to a large-scale distributed file system data restoration method and equipment. Background technique [0002] In recent years, cloud computing technology has become increasingly popular, and cloud computing product lines have become increasingly rich, bringing huge social value. Cloud storage products are an important part of the cloud computing product line. Various cloud storage products usually use a large-scale distributed file system as the underlying support system to store user data. [0003] A typical distributed file system mainly includes three modules, which are deployed in three roles on a cluster composed of common commercial servers. The three modules of the distributed file system refer to: [0004] 1. Client: client library, providing users with various interfaces to access the distributed file system; [0005] 2. Chunkserver: data block (Chunk) management module, manage...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14G06F17/30
CPCG06F11/1435G06F16/182
Inventor 周泰石超刘善阳
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products