Fine-grained cloud storage scheduling method based on erasure codes

A scheduling method and erasure coding technology, applied in the field of cloud storage, can solve problems such as the impact of data acquisition delay, and achieve the effects of reducing data acquisition delay, improving stability, and optimizing scheduling strategies

Inactive Publication Date: 2017-04-26
SHANGHAI JIAO TONG UNIV
View PDF5 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the thread scheduling strategy will affect the data acquisition delay. Therefore, the most critical question at present is how to optimize the thread scheduling to reduce the data acquisition delay?

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fine-grained cloud storage scheduling method based on erasure codes
  • Fine-grained cloud storage scheduling method based on erasure codes
  • Fine-grained cloud storage scheduling method based on erasure codes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0035] According to the erasure code-based fine-grained cloud storage scheduling method provided by the present invention, the method includes the following steps:

[0036] Step 1: Analyze the load information of a large number of storage nodes in the cloud storage system, and determine the performance indicators that affect the data download delay;

[0037] Step 2: According to the performance indicators and load information in step 1, formulate a cloud storage scheduling algorithm based on erasure cod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a fine-grained cloud storage scheduling method based on erasure codes. Based on a real cloud computing platform, through the analysis of the load information of a large number of storage nodes in a cloud storage system, the performance index which influences data download time delay is determined. Based on the load information, a new cloud storage scheduling algorithm is designed, through using the load information of the storage nodes, the thread scheduling of a proxy node is reversely guided to optimize an existing cloud storage system scheduling scheme. Through a variety of different erasure codes, massive files are subjected to encoding storage. By using an open source project OpenStack, a real cloud computing platform is established, the deployment and verification are carried out on the cloud platform according to real user request data, 15% average time delay can be reduced at most by the scheduling strategy provided by the invention, at the same time the fluctuation of data download time delay can be reduced, the stability of data obtainment is improved, and a better user experience is provided.

Description

technical field [0001] The present invention relates to the technical field of cloud storage, in particular to a fine-grained cloud storage scheduling method based on erasure codes. Background technique [0002] With the development of cloud computing technology, cloud storage services have also attracted the attention and use of more and more industries. Cloud storage is a data storage model. Data is stored in a logical storage pool, and the actual physical storage consists of multiple physical servers. Usually, these physical environments are managed by enterprises or companies. The cloud storage system has the characteristics of flexibility, easy maintenance, and scalability, and provides reliability assurance for data storage. Users can easily access cloud storage services through the network at any place to complete operations such as data storage and acquisition. Moreover, compared with traditional storage services, it has the advantages of low cost and good convenie...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08G06F11/07G06F11/10
CPCH04L67/06H04L67/108H04L67/1097G06F11/0727G06F11/1076H04L67/60
Inventor 薛广涛钱诗友李明禄廖辉
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products