Metadata backup and recovery method based on file storage system

A file storage and recovery method technology, which is applied to redundant data error detection, electrical digital data processing, response error generation and other directions in the operation, can solve the problems of no good repair effect, long repair time, etc. Reliable design principle, improve recovery speed, and reduce the effect of data loss

Active Publication Date: 2019-11-05
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] When the storage capacity of the file system is large, for example, if the metadata of a certain directory is damaged, it may take a long time to repair; when the free directory is damaged, mds cannot be started, and there is no good repair effect at present.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata backup and recovery method based on file storage system
  • Metadata backup and recovery method based on file storage system
  • Metadata backup and recovery method based on file storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] Such as Figure 1-4 As shown, the embodiment of the present invention provides a metadata backup and recovery method based on a file storage system, including the following steps:

[0045] Step 1: Design the import and export interfaces of omap objects; in this step, metadata objects: members in the metadata pool, non-omap objects: members in the metadata pool, stat It can be viewed, usually the object size is greater than 0; through listomapvals and getomapheader View object does not have (key, value) and header.

[0046] omap object: a member in the metadata pool, the length of the object is equal to 0, and can be passed through listomapvals and getomapvals View the object's (key, value) or header.

[0047] Export omap object command, used to export the binary of omap object key, value, header to a file.

[0048] The storage format of the metadata information exported to the file is as follows:

[0049]

[0050] headerlen, keylen, and valuele...

Embodiment 2

[0073] Embodiments of the present invention provide a metadata backup and recovery method based on a file storage system, comprising the following steps:

[0074] Step 1: Design the import and export interface of the omap object; in this embodiment, when the designed omap object imports and exports the interface, the header, key, and value of the omap object are directly exported in the form of hexadecimal to a local file, and the header , key, and value occupy one line each, and do not need headerlen, keylen, and valuelen. When importing, it is read by line, and the omap object can also be restored.

[0075] Step 2: Design a metadata backup script to call storage system commands or linux commands, and backup metadata objects in the file system at set intervals;

[0076] Step 3: Design a metadata recovery script. When metadata is damaged, restore a single metadata object or all backup metadata objects.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a metadata backup and recovery method based on a file storage system. The method includes: designing an import interface and an export interface of an omap object; designing a metadata backup script to call a storage system command or a linux command, and backing up metadata objects in the file system at set time intervals; and designing a metadata recovery script, and recovering a single metadata object or all backed-up metadata objects when metadata is damaged. By designing import and export interfaces of an omap object and using a script to call a storage system command or a linux command at the same time, metadata objects in a file system are backed up regularly, and when metadata is damaged, a single metadata object or all backed-up metadata objects can be recovered. Not only is recovery speed improved, but also data loss is reduced.

Description

technical field [0001] The invention relates to the technical field of file storage systems, in particular to a metadata backup and recovery method based on file storage systems. Background technique [0002] The directory of the file system is in the shape of a tree. According to the metadata of the root " / ", the location where the metadata of the subdirectory is stored can be found. It traverses layer by layer, and finally forms the association relationship of the entire file system tree. In addition, the metadata objects in the metadata pool can be indexed according to the inode of the directory. [0003] If the metadata in the file system is abnormal, the following problems will occur: (1) The MDS process cannot be started, and the system is unavailable and prompts damaged; (2) Although the MDS process is available, data loss will occur. [0004] Some existing metadata detection and repair tools in the file system, including icfsfs-data-scan, icfsfs-table-tool, icfsfs-...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14
CPCG06F11/1435G06F11/1448G06F11/1469
Inventor 张其万
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products