Method for adjusting data block counterpart number and metadata server node

A metadata server and adjustment method technology, applied in electrical components, store-and-forward switching systems, transmission systems, etc., can solve problems affecting system performance, unable to adjust data block access frequency or response time, etc., to improve aggregation bandwidth and ensure Availability and reliability, and the effect of improving utilization efficiency

Active Publication Date: 2009-07-01
CHINA MOBILE COMM GRP CO LTD
View PDF0 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The problem to be solved by the present invention is: using a distributed file system with a fixed number of copies, the number of copies cannot be adjusted according to the access frequency or response time of data blocks, thus affecting the improvement of system performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for adjusting data block counterpart number and metadata server node
  • Method for adjusting data block counterpart number and metadata server node
  • Method for adjusting data block counterpart number and metadata server node

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0022] This embodiment provides a method for adjusting the number of copies of a distributed file system data block, such as figure 2 shown, including:

[0023] Step 101, after receiving the copy adjustment information from the client, the metadata server node in the distributed file system saves the copy adjustment information in the metadata server node.

[0024] Wherein, the copy adjustment information includes a copy adjustment time for a data block copy and a copy adjustment number corresponding to the copy adjustment time. In addition, the copy adjustment information can also include other useful information as needed, such as file offset and so on.

[0025] Specifically, multiple copy adjustment times and copy adjustment numbers may be set for one data block copy in the copy adjustment information, where each copy adjustment number corresponds to a copy adjustment time. For example, as shown in Table 1, data block D1 is in T 1 Created at time 0, keep the number of c...

Embodiment 2

[0037] In the method described in the method embodiment 1, after the data block copy has been created in the data block node, the copy data is adjusted according to the configuration of the client, or according to the copy adjustment information pre-stored in the metadata server node. This embodiment provides a method for adjusting the number of copies in which the client sets copy adjustment information when creating a copy of a data block, such as image 3 shown, including:

[0038] Step 201, after receiving the data block creation instruction from the client, the metadata server node in the distributed file system saves the copy adjustment information therein.

[0039] Wherein, the data block creation instruction includes copy adjustment information for the data block copy to be created. The replica adjustment information includes a replica adjustment time and a replica adjustment number corresponding to the replica adjustment time.

[0040] In addition, the file offset c...

Embodiment 3

[0057] This embodiment provides another metadata server node on the basis of Embodiment 1 or 2 above, such as Figure 6 As shown, the metadata server node 10 includes a heartbeat monitoring module 14 in addition to a metadata processing module 11 , a replica management module 12 and an interface module 13 .

[0058] The heartbeat monitoring module 14 is used to perform heartbeat monitoring on the state of the data block node storing the copy of the data block when the number of copies is not adjusted. When a certain data block node is monitored to be unavailable, the The copy adjustment number in the copy adjustment information sends a copy adjustment instruction to the copy management module 12; the first management sub-module 121 of the copy management module 12 selects a corresponding number of data block copies according to the copy adjustment instruction from the heartbeat monitoring module 14. location, and save a copy of the data block to the corresponding data block no...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for regulating the number of duplicate data blocks and a meta-data server node. The method comprises the following steps: searching a duplicate regulation message of a duplicate data block by a meta-data server node; and regulating the number of duplicate data blocks stored in a data block node when a duplicate regulation time point set in the duplicate regulation message arrives at according to duplicate regulation number in the duplicate regulation message corresponding to the duplicate regulation time point. The meta-data server node comprises a meta-data processing module and a duplicate management module. The invention can set higher number of duplicate for the data block with long response time or high access frequency, so as to increase the aggregated bandwidth for a user accessing the data, thereby ensuring the availability and the reliability of the data block while improving the utilization efficiency of system resources.

Description

technical field [0001] The invention relates to a technology for adjusting the number of data block copies, in particular to a method for adjusting the number of data block copies in a distributed file system and a corresponding metadata server node. Background technique [0002] Distributed file system is a distributed storage system based on local storage of cheap computer nodes. It builds a directory tree by organizing shared folders on different servers together, so that users only need to access a shared root directory to access files or folders distributed on the network without knowing the actual location of these files. physical location. Compared with traditional disk arrays and storage area network (Storage Area Network, referred to as: SAN) storage systems, it has the advantages of high storage cost performance and strong scalability. [0003] The existing distributed file system can also be used by Internet service providers, such as Google, Yahoo, etc., as a d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/54H04L29/06
Inventor 罗治国徐萌周文辉周彬
Owner CHINA MOBILE COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap