Data maintenance method and system for file system

A file system and data maintenance technology, the redundancy in the hardware is used for data error detection, transmission systems, electrical components, etc. It can solve problems such as high latency and low bandwidth, reduce processing delay, and reduce read operation load. , the effect of increasing the bandwidth of read operations

Active Publication Date: 2015-01-14
INST OF COMPUTING TECHNOLOGY - CHINESE ACAD OF SCI +1
View PDF5 Cites 70 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] However, most of the above-mentioned file systems are designed for the local network environment, and in the wide-area network environment, the design of the file system must consider other constraints: low bandwidth, high latency, heterogeneous storage platforms, and data The remote backup of the center and the realization of disaster recovery at the data center level are essential

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data maintenance method and system for file system
  • Data maintenance method and system for file system
  • Data maintenance method and system for file system

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0089] The following are embodiments of the present invention, and the specific implementation methods are as follows:

[0090] Based on the modification log, the update synchronization between the source and the copy data center server is realized. The modification between the source and the copy data center server is synchronized in an asynchronous manner. The specific synchronization content is: management metadata (mysql database update information), file data (including directory data) and file metadata (including directory metadata).

[0091] Management metadata update information synchronization, management metadata is a mapping table from id to path (referring to the path of the file in the system), and the mapping from id to path is stored in the mysql database, so the synchronization of management metadata update information is the update of the mysql database Synchronization of information, where the source data center server uses the method of recording logs and pe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data maintenance method and a data maintenance system for a file system. The invention relates to the technical field of a distributed file system. The method comprises the following steps: backing up source data of a source data center into a copy data center to be used as copy data of the source data; according to a state of the source data center, selecting to provide a read-write service by the source data center or provide the read-write service by the copy data center, and if the source data or the copy data is modified, acquiring a modification record of the source data or the copy data and generating a log file; according to the log file, updating the source data or the copy data so as to ensure consistency of the data of the source data center and the data of the copy data center. According to the invention, data reliability of the data centers can be effectively improved; a storage service is available; final coherence semantics are provided for the data.

Description

technical field [0001] The invention belongs to the technical field of a distributed file system, in particular to a data maintenance method and system of a file system. Background technique [0002] With the development of information technology, the global data is growing explosively. In 2011, the global created data reached 1.8ZB, and it is estimated that the global information data will increase by 50 times by 2020. Under the premise of such a large amount of data, combined with technologies related to big data (big data), it will be possible to discover the potential huge value. In order to perform large-scale calculations, it can provide big data storage. The shared distributed storage system is necessary. [0003] In computing clusters and computing grids, data copy technology is a very effective and feasible method to improve data access bandwidth and data reliability. The copy mechanism mainly focuses on four aspects: copy placement, copy selection, copy Consisten...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/16G06F11/34H04L29/08
Inventor 蔡杰明刘浏闫鹏飞刘国良马留英何文婷刘振军
Owner INST OF COMPUTING TECHNOLOGY - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap