Distributed storage cache management method and system, storage medium and equipment

A distributed storage and cache management technology, which is applied in the cache management of distributed storage, distributed storage, and server fields, to achieve the effects of improving the prefetch hit rate, saving cache space, and improving performance

Pending Publication Date: 2022-07-29
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF0 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing algorithms still have room for improvement and improvement

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage cache management method and system, storage medium and equipment
  • Distributed storage cache management method and system, storage medium and equipment
  • Distributed storage cache management method and system, storage medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to make the objectives, technical solutions and advantages of the present invention more clearly understood, the embodiments of the present invention will be further described in detail below with reference to the specific embodiments and the accompanying drawings.

[0048] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are for the purpose of distinguishing two non-identical entities or non-identical parameters with the same name. " is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention. Furthermore, the terms "comprising" and "having", and any variations thereof, are intended to cover non-exclusive inclusion, for example, other steps or units inherent in a process, method, system, product or apparatus comprising a series of steps or units.

[0049] Especially for a large-scale distributed storage file system, according to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed storage cache management method and system, a storage medium and equipment. The method comprises the following steps: selecting object granularity and stripe width in a distributed underlying storage cluster based on the rated size of a file; fragmenting data of the file into a plurality of object units based on the object granularity and the stripe width, and writing the object units into a distributed underlying storage cluster in a manner of taking the object as the granularity, wherein the writing in the manner of taking the object as the granularity meets a locality principle; in response to a received read request sent by a client, searching in the cache according to the read request; in response to the fact that the data corresponding to the read request does not exist in the cache, performing prefetching management on the distributed underlying storage cluster by taking the object as the granularity, constructing the cache, and searching in the cache again according to the read request; and in response to the data corresponding to the read request found in the cache, returning the corresponding data and cache hit from the cache. According to the method, the cache space is saved, the prefetching hit rate is increased, and the overall IO performance of storage is improved.

Description

technical field [0001] The present invention relates to the technical field of servers, in particular to the technical field of distributed storage, and in particular to the technical field of cache management of distributed storage. Background technique [0002] With cloud computing and digital transformation, the amount of data generated grows exponentially, so there are new technical requirements for massive data storage. Although traditional storage has the advantages of mature technology, good performance, and high availability, in the face of massive data, its shortcomings are becoming more and more obvious, such as poor scalability, high cost, single point of failure and performance bottlenecks. In order to overcome the above shortcomings and meet the storage requirements of massive data, a distributed storage technology has emerged under the current technical background. A distributed storage system usually includes a master server, a storage server, and multiple cl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/172G06F16/13
CPCG06F16/182G06F16/172G06F16/13
Inventor 臧林劼
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products