High-speed object-based parallel storage system directory replication method

A storage system and object storage technology, which is applied in special data processing applications, instruments, electrical digital data processing, etc., can solve the problems that customer nodes become communication bottlenecks and time overhead, and avoid single point failures and communication bottlenecks , the effect of reducing the copying time

Inactive Publication Date: 2013-04-10
NAT UNIV OF DEFENSE TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is: the directory replication for the object parallel storage system is concentrated on the client node, the serialization process leads to a large time cost, and the data replication process needs to be transferred through the client node, causing the client node to become a communication bottleneck, etc. problem, propose a parallelized high-speed directory copy method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-speed object-based parallel storage system directory replication method
  • High-speed object-based parallel storage system directory replication method
  • High-speed object-based parallel storage system directory replication method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] figure 1 is a block diagram of an object-parallel storage system. The object parallel storage system is composed of a metadata server (referred to as MDS), multiple object storage servers (referred to as OST) and multiple client nodes (referred to as CN) through network interconnection. The metadata server and multiple object storage servers provide client nodes with file access services such as data reading and writing, and data storage.

[0042] figure 2 A block diagram of the directory replication system. The directory replication system consists of a directory replication task management module, a load distribution module, and a file replication execution module. The directory replication task management module and load distribution module are deployed on client nodes, and the file replication execution module is deployed on all object storage servers. The directory copy task management module parses the directory copy command, and issues a common directory copy...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a high-speed object-based parallel storage system directory replication method, which aims to solve the problems that the directory replication of an object-based parallel storage system is carried out on a client knot, time cost is large due to a serialization process, the client knot becomes a communication bottleneck because a data replication process needs to be transferred through the client knot in a data replication process, and the like. The technical scheme is as follows: a directory replication system is constructed, a directory replication task is divided into a plurality of replication tasks of a plurality of files, and then the replication tasks of the files are distributed to a plurality of object storage servers to be carried out in parallel, whereinthe files are directly replicated to a destination object storage server from a source object storage server without being transferred through the client knot. Due to the adoption of the invention, the replication time can be greatly reduced; transferring through the client knot is unnecessary, so that the phenomenon that the client knot becomes the communication bottleneck is avoided; and a source file and a target file can not be located on the same object storage server in a replication process, so that single point failure is avoided.

Description

technical field [0001] The invention relates to a performance optimization method of an object parallel storage system, especially a high-speed directory duplication method. Background technique [0002] Parallel storage system is an important part of massively parallel computer system, object parallel storage system is a kind of parallel storage structure. Such as figure 1 As shown, the object parallel storage system is composed of a metadata server (abbreviated as MDS), multiple object storage servers (abbreviated as OST) and multiple client nodes (abbreviated as CN) through network interconnection. The metadata server and multiple object storage servers provide client nodes with file access services such as data reading and writing, and data storage. The metadata server provides metadata services for client nodes, which is unique to object storage systems. Metadata describes information such as the owner of each file, creation time, modification time, file size, and fi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 陈海涛卢宇彤肖婧周恩强张伟张晓明宋飞田宝华
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap