Caching method and device of distributed storage system

A distributed storage and cache device technology, applied in the computer field, can solve the problems of high probability of cache device missing, optimization of memory + solid-state disk hybrid storage scenarios, and high time complexity

Active Publication Date: 2020-08-11
上海霄云信息科技有限公司
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing methods have a high probability of missing cache devices in the massive data scenario of the distributed storage system, a

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Caching method and device of distributed storage system
  • Caching method and device of distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0070] In a typical configuration of the present application, the terminal, the device serving the network and the trusted party all include one or more processors (CPUs), input / output interfaces, network interfaces and memory.

[0071] Memory may include non-permanent storage in computer-readable media, in the form of random access memory (RAM) and / or nonvolatile memory, such as read-only memory (ROM) or flash memory (flashRAM). Memory is an example of computer readable media.

[0072] Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention aims to provide a caching method and device for a distributed storage system, and the method comprises the steps: reading a to-be-read file from a caching device if the corresponding to-be-read file is stored in the caching device, and adjusting an LRU index heap; and if there is no corresponding to-be-read file in the cache device, reading the to-be-read file from the underlying storage system based on the guidance of the to-be-read file in the request, storing the to-be-read file in the cache device, and respectively adjusting the LRU index heap and the LFU index heap. According to the invention, the data structure of the LRU and LFU index heap is adopted; due to the fact that the index heap is a complete binary tree, for operations such as element adding, element deletingand list reconstructing, the time complexity is the O(logn) level, through the LRU index heap and the LFU index heap, the operation efficiency is improved, the hit rate of cache equipment can be increased, and therefore the data access performance is improved.

Description

technical field [0001] The invention relates to the field of computers, in particular to a caching method and equipment for a distributed storage system. Background technique [0002] The evaluation indicators of distributed storage systems mainly include capacity, performance, and cost. Its hardware devices are mainly based on disks, and the mechanical seek operations generated by disks will restrict data access performance. If high-speed access devices such as memory and solid-state disks on storage servers are used to form the cache device layer of the storage system, frequently accessed Store hot data in the cache device system as much as possible, which can reduce the performance constraints of the disk device on the distributed storage system, thereby greatly improving the data read and write performance. [0003] Existing caching device methods are mainly based on the time or frequency characteristics of data access, and there are also some methods that comprehensive...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F12/123
CPCG06F3/0607G06F3/0656G06F3/067G06F12/123Y02D10/00
Inventor 王飞平董昭通
Owner 上海霄云信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products