Method, system and cloud platform for realizing distributed high-efficiency cloud disk

An implementation method and distributed technology, applied in the field of cloud storage, can solve the problems of increased cloud disk construction cost, high performance cloud disk price, and performance jitter, so as to improve data writing and access performance, high availability and high Reliability, the effect of reducing deployment and operation costs

Active Publication Date: 2019-01-25
WUXI CHINAC DATA TECH SERVICE
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The problems of the above two types of cloud disks are: the performance of the capacity cloud disk is too low, and the price of the performance cloud disk is too expensive and the capacity is relatively small
In order to solve the above problems, the industry has proposed a cloud disk whose performance is between the capacity cloud disk and the performance cloud disk, which is called a high-efficiency cloud disk. There are usually two methods: one solution is to use the above-mentioned performance Add QoS speed limit to cloud disks, reduce the performance of a single disk, and reduce user costs through scale effects, but this solution cannot provide the same large capacity as capacity cloud disks; another solution is to use solid-state media (SSD ) is added to the storage system as the back-end cache of the mechanical hard disk (HDD) and shared with the back-end cache, so that it can not only provide large capacity based on the mechanical hard disk (HDD), but also achieve higher speed through the acceleration of the solid-state hard disk (SSD). storage performance
However, the second solution above still has the following two technical flaws: 1) The storage device is connected to the front-end business system through the network, resulting in too long IO paths, which cannot maximize the performance of solid-state drives (SSDs) during read and write operations. Performance; 2) The solid-state drive (SSD) is shared by the storage system as a cache, which is likely to cause performance jitter problems. Therefore, in order to achieve performance improvement, it is often necessary to configure a larger solid-state drive (SSD) to increase the cache capacity, which leads to storage system and the significant increase in the construction cost of cloud disks based on this storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, system and cloud platform for realizing distributed high-efficiency cloud disk
  • Method, system and cloud platform for realizing distributed high-efficiency cloud disk
  • Method, system and cloud platform for realizing distributed high-efficiency cloud disk

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] A method for realizing distributed high-efficiency cloud disks includes the following steps.

[0056] For simplifying the explanation to the concrete technical line of the present invention and principle, refer to figure 1 As shown, three nodes (that is, Node-1, Node-2, and Node-3) are shown in each embodiment of this specification to illustrate the present invention.

[0057] These three nodes can be computing nodes, and can be specifically configured as disks or an independent physical server or computer device; of course, these three nodes can be control nodes, and can be specifically configured as an independent physical server or A computer-readable medium capable of providing Supporting Service, Base Service and Option Service. The number of computing nodes is N; wherein, N is a positive integer greater than or equal to 2, and in this embodiment, N is 3. At the same time, two or more second non-volatile storage media with the same specifications (that is, SSD_1˜...

Embodiment 2

[0122] This embodiment discloses a distributed high-efficiency cloud disk system, which is based on the realization method of a distributed high-efficiency cloud disk shown in Embodiment 1. The distributed high-efficiency cloud disk system includes: a capacity layer, which consists of at least one first non-volatile storage medium (i.e. Figure 1 to Figure 3 A Ceph storage cluster 10 formed by a plurality of SATAs shown in . As a low-speed storage device, the Ceph storage cluster 10 provides back-end mass storage for the entire distributed and efficient cloud disk system. The configuration warehouse is a distributed configuration cluster created by the distributed configuration sharing software, and the customized client 30 is used to pool the second non-volatile storage medium (i.e. image 3 SSD_1~SSD_1m, SSD_2~SSD_2n, and SSD_3~SSD_3i) shown in , are used as the distributed cache layer 20, and the distributed cache layer 20 and the configuration warehouse are jointly used a...

Embodiment 3

[0127] This embodiment discloses a cloud platform, which includes at least one distributed high-efficiency cloud disk system as described in the second embodiment above.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a method, system, and cloud platform for realizing a distributed high-efficiency cloud disk. The method for realizing a distributed high-efficiency cloud disk includes creating a network composed of at least one first non-volatile storage medium in each node. The Ceph storage cluster is used as the capacity layer, and at least one virtual machine is created in each node, and a distributed configuration cluster is created by using distributed configuration sharing software as a configuration warehouse. According to the configuration of the second non-volatile storage medium in each node, the Map the relationship and register it in the configuration warehouse, install a customized client in each node, pool the second non-volatile storage medium in all nodes as the distributed cache layer, and use the distributed cache layer and the configuration warehouse together as the A cache layer for high-efficiency cloud disks. Through the present invention, good support for key services is achieved, IO access paths are shortened, jitters in shared back-end caches are avoided, and reliability of a distributed high-efficiency cloud disk system is improved.

Description

technical field [0001] The invention relates to the technical field of cloud storage, in particular to a method and system for realizing a distributed high-efficiency cloud disk and a cloud platform thereof. Background technique [0002] In the early days of cloud computing, users usually choose to upload non-critical services (such as single pictures, texts, backup services, and archiving services) to cloud disks. In the formed virtual storage medium. Non-critical businesses do not have high requirements for cloud disk storage performance, so the disadvantages of traditional cloud disks are not prominent. [0003] With the popularization of cloud technology and the increasing recognition of cloud computing by users, users gradually migrate key services (such as Web sites, small and medium databases, ERP systems, or large and medium relational databases) to the cloud. This type of business usually has high storage performance requirements for cloud storage performance. In...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08H04L12/24G06F3/06
CPCH04L41/0826H04L67/1097G06F3/061G06F3/0631G06F3/0643G06F3/065G06F3/0656G06F3/0667H04L67/568
Inventor 许广彬郑军张银滨刘继江李忠文殳鑫鑫
Owner WUXI CHINAC DATA TECH SERVICE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products