Method and device for verifying and synchronizing data blocks in distributed file system

A technology for distributed files and synchronous data, applied in transmission systems, digital transmission systems, data exchange networks, etc., can solve problems such as metadata server consumes a lot of time and affects user response speed, so as to ensure system performance and response speed effect

Active Publication Date: 2009-11-18
ZTE CORP
View PDF0 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method and device for verifying and synchronizing data blocks in a distributed file system, aiming at solving the problem of the prior art that the metadata server in the distributed file system consumes a large amount of time when verifying and synchronizing data blocks. Time, which seriously affects the response speed of user operations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for verifying and synchronizing data blocks in distributed file system
  • Method and device for verifying and synchronizing data blocks in distributed file system
  • Method and device for verifying and synchronizing data blocks in distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0019] In the embodiment of the present invention, after the metadata server initiates the verification and synchronization of data blocks, the metadata server designates a data block server in the data block server group as the primary data block server, and the primary data server collects the data blocks in the group information and complete the checksum synchronization, and then report the result to the metadata server. In this way, the entire process of verifying and synchronizing data blocks takes only a very small amount of time on the metadata server, thus ensuring the response speed to use...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention is applicable to the field of data memory and provides a method and a system for verifying and synchronizing data blocks in a distributed file system. The distributed file system comprises a metadata server, a data block server and a memory media that are linked to each other; the metadata server designates one of the same group data block servers as the main data block servers and the other servers as auxiliary data block servers; the method comprises the following steps: the metadata server launches a data verification request to the main data block server; the main data block server verifies all data block information managed in the auxiliary data black servers in the group, carries out synchronization according to the verification results, and reports the verification and synchronization results to the metadata server; the metadata server updates the metadata information according to the reported verification and synchronization results; therefore, the metadata server uses extremely little time to complete the verification and synchronization to the database.

Description

technical field [0001] The invention belongs to the field of data storage, in particular to a method and device for checking and synchronizing data blocks in a distributed file system. Background technique [0002] With the rapid development of the multimedia industry, due to cost, reliability and other considerations, more and more manufacturers choose to deploy self-developed distributed storage systems in their products, and the distributed file system has also developed rapidly. . [0003] In the existing distributed file system architecture, files are generally divided into multiple data blocks for storage; in order to ensure system robustness and disaster recovery capabilities, data blocks generally have multiple backups stored in different physical Location. In this way, there is a problem of verifying and synchronizing these data blocks to ensure the consistency of these data blocks, that is, to ensure that the valid data stored in these data blocks are all the sam...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L12/26
CPCG06F17/30212G06F16/184
Inventor 彭杰夏舰波张波
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap