Storage caching method of object-based distributed file system

A distributed file and cache technology, applied in transmission systems, electrical components, special data processing applications, etc., can solve the problems of high I/O performance, low performance, high device network transmission overhead, etc., and achieve the effect of improving read and write speed

Active Publication Date: 2012-06-27
HANGZHOU DIANZI UNIV
View PDF4 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problems of high-frequency access hotspots, object connection and transmission delay of devices with high network transmission overhead and low overall I/O performance in a heterogeneous storage environment based on the object-based di

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Storage caching method of object-based distributed file system
  • Storage caching method of object-based distributed file system
  • Storage caching method of object-based distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The technical solution will be further described below in conjunction with the accompanying drawings and the specific implementation and application process.

[0017] This technical solution is based on the architecture of the object distributed file system, and a proxy server with high device performance is added to the storage cluster. Its structure is as follows figure 1 shown. The overall architecture consists of clients, metadata servers and storage clusters. In a storage cluster, some storage devices with high performance are deployed as proxy servers to cache frequently accessed hotspot objects. When users operate on these hot objects, they will get a high transfer rate. Using this solution, when the client reads a data object from the storage cluster, it first checks whether the cache is hit. If it hits, it can obtain a higher transmission bandwidth by connecting to the proxy server, thereby reducing network delay overhead; if there is no hit, follow the The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a storage caching method of an object-based distributed file system. The traditional object-based distributed file system has the problems that the network cost is instable and the whole I/O (Input/Output) performance is low in a heterogeneous storage environment. The architecture of the object-based distributed file system changes the traditional data access mode thereof, establishes caching by arranging a proxy server in a storage cluster, and adopts the caching replacement strategy in the invention to perform caching process of hot object files which are accessed very frequently. By utilizing the method, the file access speed of the distributed file system can be increased, the network transmission cost can be reduced, and the I/O performance of the whole system can be increased.

Description

technical field [0001] The invention relates to a storage cache realization method of a distributed file system, in particular to a storage cache realization method of an object-based distributed file system in a heterogeneous storage environment. Background technique [0002] In today's information society, the storage capacity of more and more distributed storage file systems has risen to the PB level. Object-based storage systems have attracted more and more attention in the storage field because of their better performance in mass storage. It realizes the separate management of metadata and data content of data objects, and its system architecture is mainly composed of client, metadata server and object-based storage devices. The metadata server is responsible for the metadata management of data objects and other storage management, and the object-based storage device is responsible for the deployment and access of the actual blocks of the underlying data. It maintains t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F17/30
Inventor 万健周昶张纪林徐向华殷昱煜任永坚
Owner HANGZHOU DIANZI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap