Data reading method, system and device based on distributed storage system

A distributed storage and data reading technology, applied in the direction of electrical digital data processing, input/output process of data processing, instruments, etc., can solve the problem of long delay in reading operations, decreased space utilization, and decreased read and write performance, etc. problems, to achieve the effect of improving data reading speed, highlighting substantive features, and improving read and write performance

Inactive Publication Date: 2018-12-07
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, since the existing processing logic is to use a fixed stripe size to create an erasure data pool, it is impossible to set different stripe sizes for different data, and it is also unable to adapt to different types of file storage, resulting in a decline in space utilization
The decline in space utilization will lead to read and write oper

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reading method, system and device based on distributed storage system
  • Data reading method, system and device based on distributed storage system
  • Data reading method, system and device based on distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0042] Example one:

[0043] Such as figure 1 The shown data reading method based on a distributed storage system includes the following steps:

[0044] Step 1: Receive the read operation request sent by the client.

[0045] Step 2: Count the popularity of the data to be read in the read operation request.

[0046] Step 3: Determine whether the current operation is a read operation, if yes, go to step 4; if not, go to step 1.

[0047] Step 4: Determine whether the object data requested by the read operation exists in pgcache, if it exists, go to step 6; if not, go to step 5.

[0048] Step 5: Use the OSD to process the read operation request, and go to step 4 after processing.

[0049] Step 6: Assemble the content of the data to be read.

[0050] Step 7: After reading is complete, return to the client.

[0051] A data reading method based on a distributed storage system proposed in this embodiment includes: receiving a read operation request sent by a client; counting the popularity of the d...

Example Embodiment

[0052] Embodiment two:

[0053] Such as figure 2 The shown data reading method based on a distributed storage system includes the following steps:

[0054] Step 1: Receive the read operation request sent by the client.

[0055] Step 2: Count the popularity of the data to be read in the read operation request.

[0056] Step 3: Determine whether the current operation is a read operation, if yes, go to step 4; if not, go to step 1.

[0057] Step 4: Determine whether the object data requested by the read operation exists in pgcache, if it exists, go to step 9; if it does not exist, go to step 5.

[0058] Step 5: Determine whether the object requested by the read operation exists in pgcache, if it exists, go to step 8; if it does not exist, go to step 6.

[0059] Step 6: Determine whether pgcache reaches the threshold, if yes, go to step 7; if not, go to step 8.

[0060] Step 7: Delete the least hot data in pgcache.

[0061] Step 8: Update the object data requested by the read operation in pgca...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data reading method based on a distributed storage system, which comprises the following steps: receiving a read operation request sent by a client; counting the heat of the data to be read in the read operation request; judging whether the current operation is a read operation or not, and if not, continuing to receive a read operation request sent by the client; if so, determining whether the object data requested by the read operation exists in the pgcache, and if so, assembling the contents of the data to be read; if not, processing the read operation request by theOSD, and after the processing is completed, assembling the contents of the data to be read. Therefore, the method can effectively reduce the read delay, improve the data read speed of the distributedstorage system, and further improve the read and write performance of the whole system by caching some hot data on the main pg and carrying out the data aging and hot data updating in the pgcache intime with the data reading

Description

Technical field [0001] The present invention relates to the field of data storage technology, and more specifically to a data reading method, system and device based on a distributed storage system. Background technique [0002] With the development of computer technology, servers store more and more data, and a single server cannot meet the requirements of storing data. Therefore, a distributed storage system has been developed. [0003] In the current commonly used distributed storage systems, considering the reliability of data storage, erasure coding technology is commonly used to make data redundant to increase the reliability of the system, and the stored data is divided into K data blocks. The coding algorithm calculates M parity blocks and stores them in the erasure data pool. The original data can be recovered by using any K data blocks among the K+M data blocks. Through the erasure correction rule setting of the erasure code, the storage space size can be controlled, whi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/0656G06F3/061G06F3/067
Inventor 毛贝贝
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap