Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Distributed Storage Cache Reading and Writing Method

A distributed storage and distributed hash table technology, applied in the direction of input/output to record carrier, input/output process of data processing, instruments, etc., can solve the problems of reading performance impact, affecting reading performance, low system performance, etc. , achieve the effect of reducing cross-node access, low software complexity, and low maintenance cost

Active Publication Date: 2021-01-29
西安奥卡云数据科技有限公司
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 2) The cache system will not cache the data of other nodes. For reading hot data, cross-node access is required, and the read performance is greatly affected.
[0006] 3) The read cache and write cache of the cache system are independent, which increases the complexity of the software; when reading data, it is necessary to read and write the cache first, and then read the read cache if it is unsuccessful, and then read the SSD POOL if it is unsuccessful. The path for reading is complicated. Multiple steps affect read performance
[0007] 4) Using SSD WAL cache as a persistence guarantee, the entire write performance is limited by the performance of SSD, and the write performance of the system is greatly affected
[0008] 5) The general-purpose distributed storage cache system is different for storage media such as HDD and SSD, and a set of solutions cannot be uniformly used
[0009] Due to the existence of the above defects, the data access time in the existing distributed storage system is long and the system performance is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Distributed Storage Cache Reading and Writing Method
  • A Distributed Storage Cache Reading and Writing Method
  • A Distributed Storage Cache Reading and Writing Method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0038] The usual HDD cache processing flow and SDD cache processing flow in the prior art are summarized as follows:

[0039] General HDD storage write cache processing flow

[0040] Such as figure 1 As shown, it is the general HDD storage write cache processing flow. When the storage node receives the write IO operation of the business (Write IO in the figure), it will save a copy of the Write IO in the MemoryWrite Cache, and simultaneously record it in the form of a log to SSD WAL Cache and returns the successful completion of this write operation, this process is usually called the Write IO process.

[0041] Usually SSD Disk Cache is divided into two parts: SSD Write Cache and SSD Read Cache. The data in the MemoryWrite Cache will be sorted and reorganized and wait for the full score to be directly written to the SSD Write Cache in the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a distributed storage cache reading and writing method, which receives a data object to be written, allocates a cache space for each data object, and writes the data object into the corresponding cache space; For the corresponding data object fingerprint, the storage node is allocated for the data object fingerprint through the distributed hash table; when the storage node contains the current storage node, write the data object to the disk of the current storage node; when the storage node does not contain the current storage node , set a local cache identifier for the data object fingerprint, and send the data object to a remote storage node; by using the distributed cache method of the present invention, the read-write cache has a unified entry, the software complexity is low, and the access time of the distributed storage system is reduced. Improve system performance.

Description

【Technical field】 [0001] The invention belongs to the technical field of computer storage, and in particular relates to a method for reading and writing a distributed storage cache. 【Background technique】 [0002] The storage system is developing in the direction of large-scale, distributed, and virtualized. Distributed storage systems have emerged as the times require. In distributed storage systems, cache systems have been introduced. Cache is defined as the system to process future data faster The storage capacity of the data retained by the request. Data stored in the cache is stored there because it is frequently accessed, or is a duplicate copy of data stored in another location. Caching essentially makes future access faster. [0003] The cache system of the current distributed storage system is mostly an intra-node cache, and business data is sent to the node through DHT or other discrete algorithms, and the node performs corresponding process processing after rece...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0626G06F3/0656G06F3/067
Inventor 熊江于超
Owner 西安奥卡云数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products