Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Large-scale distributed file system data restoration method and equipment

A distributed file and system data technology, applied in the computer field, can solve problems such as long repair time, limited repair ability of data repair process, etc.

Active Publication Date: 2021-01-29
ALIBABA GRP HLDG LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0042] An object of the present invention is to provide a large-scale distributed file system data repair method and equipment, which can solve the problems of limited repair ability and long repair time in the existing data repair process

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large-scale distributed file system data restoration method and equipment
  • Large-scale distributed file system data restoration method and equipment
  • Large-scale distributed file system data restoration method and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0107] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0108] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory.

[0109] Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and / or nonvolatile memory such as read only memory (ROM) or flash RAM. Memory is an example of computer readable media.

[0110] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static rando...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The purpose of the present invention is to provide a large-scale distributed file system data repair method and equipment, according to the damaged data block and its longest repairable length from the perspective of each data block management module, and the file system namespace management module The damaged data block from the perspective can accurately determine the actual damaged data block and its longest repairable length, and then accurately determine the actual damaged data block and its longest repairable length in each damaged file, and the distribution caused by power failure In the process of data recovery when the system cluster is powered off and restarted, based on the actual damaged data block and the longest repairable length of each damaged file, the damaged file can be quickly and effectively repaired, which can effectively increase the RPO, Shorten the RTO, that is, improve the data repair capability and reduce the time-consuming data repair.

Description

technical field [0001] The invention relates to the field of computers, in particular to a large-scale distributed file system data restoration method and equipment. Background technique [0002] In recent years, cloud computing technology has become increasingly popular, and cloud computing product lines have become increasingly rich, bringing huge social value. Cloud storage products are an important part of the cloud computing product line. Various cloud storage products usually use a large-scale distributed file system as the underlying support system to store user data. [0003] A typical distributed file system mainly includes three modules, which are deployed in three roles on a cluster composed of common commercial servers. The three modules of the distributed file system refer to: [0004] 1. Client: client library, providing users with various interfaces to access the distributed file system; [0005] 2. Chunkserver: data block (Chunk) management module, manage...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/14G06F16/182
CPCG06F11/1435G06F16/182
Inventor 周泰石超刘善阳
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products