Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Caching method for distributed storage system

A distributed storage and caching technology, applied in the transmission system, electrical components, etc., to achieve the effect of improving reading speed, solving consistency problems, and alleviating access pressure

Active Publication Date: 2014-02-19
EISOO SOFTWARE
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Unfortunately, few distributed storage systems in the file backup field use Memcache as distributed cache.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Caching method for distributed storage system
  • Caching method for distributed storage system
  • Caching method for distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] like figure 1 As shown, the caching method in the distributed storage system of the present invention includes the following steps:

[0040] Client 1 uploads files to server 2,

[0041] 101) First write the metadata and data blocks of the file into the distributed storage system 22;

[0042] 102) then write the metadata of the file in the distributed cache system Memcache21;

[0043] Client 1 reads the file from server 2,

[0044] 103) judge whether find metadata in Memcache21, if yes, return the metadata in Memcache21 to client 1, otherwise execute step 102);

[0045] 104) The distributed storage system 22 first rewrites the found metadata in the Memcache 21;

[0046] 105) The distributed storage system 22 returns the metadata and data blocks of the file to the client 1 after combining them.

[0047] The reason why it is written into Memcache but cannot be found is because Memcache is stored in memory, and the storage capacity of memory is at the GB level, while u...

Embodiment 2

[0066] Take the client backup and read a file named file under the directory named dir as an example, combined with image 3 and Figure 4 to elaborate.

[0067] (1) Writing process:

[0068] First split the file into metadata information (including sub-object index, object information, data block index) and data block information, construct the sub-object index of dir through the uuid of the automatically generated file and the uuid of the existing dir, and pass the file The uuid of the file and the file name and file attribute value of the read file are used to construct object information, and the data block index is constructed according to the uuid of the file and the size of the block, and then the information is first written into the distributed storage system and then written into Memcache , and finally the data block is directly written into the distributed storage system in binary form.

[0069] (2) Reading process:

[0070] Step 401. Search Memcache for all sub...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a caching method for a distributed storage system. The method includes the following steps: 1) a client side uploads a file to a server side, wherein 1a) at first, metadata and data blocks of the file are written in the distributed storage system; and 1b) then the metadata of the file are written in a Memcache of a distributed cache system; 2) the client side reads the file from the server side, wherein 2a) whether the metadata are found or not in the Memcache is judged, if the metadata are found in the Memcache, the metadata in the Memcache are sent back to the client side, and otherwise a step 2b) is executed; 2b) the found metadata are written in the Memcache again through the distributed storage system at first; and 2c) the metadata and data blocks of the file are combined through the distributed storage system to be sent to the client side. Compared with the prior art, the caching method has the advantages that the response time for browsing operation by the client side is quickened, the access pressure of the distributed systems is relieved, and consistency of access files is improved.

Description

technical field [0001] The invention relates to a caching method, in particular to a caching method in a distributed storage system. Background technique [0002] With the advent of the information age, the data generated by people is rapidly expanding and becoming larger, and the number of files is also increasing rapidly. In the traditional era, the use of a stand-alone system for file backup and recovery is prone to difficult capacity expansion, difficult data migration, and easy There are many problems such as single point of failure, so more and more multi-node distributed storage systems are used. [0003] At present, most of the distributed storage systems used for file backup and recovery do not have a cache system, and such system recovery operations will have great performance and consistency problems. Usually, distributed storage systems keep multiple copies. When the client backs up a file to a node in the distributed system, if the file is read on the node, the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08
Inventor 刘浪
Owner EISOO SOFTWARE
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com