Method, device, device and readable storage medium for downloading metadata

A storage medium and metadata technology, applied in the storage field, can solve problems such as unstored metadata, failure to find common data, slow data access response speed, etc.

Active Publication Date: 2022-07-22
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In practical applications, when it is necessary to access ordinary data in the disk array, it will appear that the corresponding metadata has not been stored in the disk array, and without metadata, the ordinary data that needs to be accessed cannot be found
At this time, you need to wait for the metadata to be downloaded before you can access ordinary data, which will result in slow data access response speed or response timeout
The reason for this is often because the metadata download speed is too slow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device, device and readable storage medium for downloading metadata
  • Method, device, device and readable storage medium for downloading metadata
  • Method, device, device and readable storage medium for downloading metadata

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] Please refer to figure 1 , figure 1 It is a flowchart of a method for downloading metadata in an embodiment of the present invention, and the method can be applied to such as figure 2 in the storage controller shown. The arrows between the external server, the first storage controller, the second storage controller, and the disk array represent communication links, that is, the external server and the first storage controller / second storage controller can communicate, and the first storage controller The first storage controller and the second storage controller can communicate with the disk array (a set composed of hard disks and used for storing data). It should be noted that, in the embodiments of the present invention, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or that there is any such actual relationship or sequence betwe...

Embodiment 2

[0079] In order to facilitate those skilled in the art to better understand the metadata refreshing method provided by the embodiments of the present invention, the above metadata refreshing method is described below in combination with the software stack in the storage controller and the existing metadata refreshing method. Explain in detail.

[0080] The software layers of the software stack of the storage controller include: an upper layer software layer, a metadata layer, and a cache layer. The flow of data written by the external server to the disk array: upper software layer --> metadata layer --> cache layer.

[0081] Ordinary data brushing process flow: external server—>node metadata layer—>disk array; that is, the external server sends the common data to be written to the disk array to the metadata layer of the storage controller (select the first storage controller and any node in the second storage controller), the metadata layer directly sends ordinary data to the...

Embodiment 3

[0090] Corresponding to the above method embodiments, the embodiments of the present invention also provide a device for downloading metadata. The device for downloading metadata described below can be applied to a storage controller, which is the same as the device for downloading metadata described above. The brushing methods can refer to each other correspondingly.

[0091] see image 3 As shown, the device includes the following modules:

[0092] A metadata set acquisition module 101, configured to acquire the common data set to be downloaded, and determine the metadata set corresponding to the common data set;

[0093] a metadata set dividing module 102, configured to randomly divide the metadata set when the second storage controller works normally, to obtain the first metadata subset and the second metadata subset;

[0094] a metadata subset sending module 103, configured to send the second metadata subset to the second storage controller;

[0095] The metadata refre...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a metadata refreshing method, device, equipment and readable storage medium. In the technical solution, a first storage controller acquires a common data set to be refreshed, and determines a metadata set corresponding to the common data set; When the second storage controller is working normally, the metadata set is randomly divided to obtain the first metadata subset and the second metadata subset; the second metadata subset is sent to the second storage controller; in the second storage controller When the second metadata subset is flushed to the disk array, the second metadata subset is flushed to the disk array. In this technical solution, the metadata is refreshed by two storage controllers at the same time, which can greatly reduce the time-consuming of metadata refresh and improve the response speed of data access.

Description

technical field [0001] The present invention relates to the technical field of storage, and in particular, to a method and device for downloading metadata, a dual-control storage device and a readable storage medium. Background technique [0002] In the era of rapid development of cloud processing and big data, the performance of storage products has also been greatly improved. High-performance storage products have reached EB-level capacity and 100 million-level IOPS extreme performance. Among them, all-flash storage products have higher performance requirements. . [0003] Currently, common data is downloaded to a single node (storage controller) based on common volumes, and metadata is downloaded to a single node based on metadata volumes. In practical applications, when the common data in the disk array needs to be accessed, the corresponding metadata may not be stored in the disk array, and the common data to be accessed cannot be found without the metadata. At this t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0611G06F3/0655G06F3/067
Inventor 孔祥斐
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap