Method and system for accessing distributed block storage system in user mode

A distributed and block storage technology, applied in transmission systems, database distribution/replication, special data processing applications, etc., can solve problems such as no automatic adjustment function, poor performance, no optimized design, etc., to improve service capabilities and response speed, reduce bandwidth overhead, and reduce cost of ownership

Pending Publication Date: 2020-12-08
SUNING CLOUD COMPUTING CO LTD
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] 1. A unified design is adopted for the application scenarios of physical servers and virtual machines, and the design is not optimized for their respective characteristics;
[0005] 2. Using the implementation of TGT, in the scenario where multiple initiators access the same Target, the performance is not good;
[0006] 3. TGT creates 16 IO threads for each LUN by default, and does not have the function of automatic adjustment according to pressure, which is a waste of resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for accessing distributed block storage system in user mode
  • Method and system for accessing distributed block storage system in user mode
  • Method and system for accessing distributed block storage system in user mode

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] As mentioned in the background technology, refer to figure 1 As shown, when implementing distributed block storage, the SCSI standard block interface is generally not directly provided, but an access interface is provided externally in the form of iSCSI. For example, physical servers are still accessed through iSCSI, but because the implementation of TGT itself limits its use in commercial environments, computing resources cannot be efficiently utilized. At the same time, the activity of the TGT open source community is not high, and there will be certain concerns when adopting TGT. In response to the above problems, in the physical server application scenario, for the convenience of implementation, many solutions usually choose TGT-based secondary development at the initial stage of design to realize iSCSI Target's support for distributed block storage. However, the existing methods in this application scenario have the following disadvantages:

[0058] 1. Using the ...

Embodiment 2

[0073] Figure 5 It is a flowchart of a method for accessing a distributed block storage system in user mode according to an exemplary embodiment, Figure 6 It is a flowchart of a method for accessing a distributed block storage system in user mode in a physical server application scenario according to an exemplary embodiment. Refer to Figure 5 and Figure 6 As shown, the method includes the following steps:

[0074] S101: After the LIO TCMU is connected to the iSCSI initiator, the access module receives a data read request sent by the iSCSI initiator from a data accessor.

[0075] Specifically, in a physical server application scenario, computing nodes include an iSCSI initiator (iSCSI initiator) and LIO TCMU, wherein LIO specifically refers to Linux-IO, and TCMU specifically refers to TCM in userspace. An access module is set in the LIO TCMU, which can implement functions such as caching, pre-reading, and write merging on the client side. After the data accessing party ...

Embodiment 3

[0092] In the embodiment of the present invention, a distributed block storage system corresponding to the second embodiment is also provided, the system includes a computing node and a distributed block storage cluster, the computing node includes an iSCSI initiator and a LIO TCMU, the An access module is arranged in the LIO TCMU, and the access module includes:

[0093] The data receiving module is used for receiving the data read request from the data accessor sent by the iSCSI initiator after the LIO TCMU is connected to the iSCSI initiator;

[0094] A data judging module, configured to judge whether there is target data corresponding to the data read request in the cache of the access module;

[0095] a data return module, configured to return the target data to the data access party;

[0096] The data request module is configured to generate corresponding threads in the thread pool pre-configured in the access module, so as to execute the thread to request the target da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and system for accessing a distributed block storage system in a user mode, an access module is arranged in an LIO TCMU of a computing node, and the method comprises the following steps: after the LIO TCMU is connected with an iSCSI initiator, receiving a data reading request from a data access party sent by the iSCSI initiator through the access module; determining whether target data corresponding to the data reading request exists in a cache of the access module or not; if so, returning the target data to the data access party; and otherwise, generating a corresponding thread in a pre-configured thread pool in the access module, so as to execute the thread to request target data corresponding to the data reading request from the distributed block storagecluster and return the target data to the data access party. The functions of caching, pre-reading, writing merging and the like are added to a client, so that tasks originally processed by the server are moved to the client, the service capacity and the response speed of the whole cluster are improved, and while the access performance is improved, the bandwidth overhead of the cluster is reduced, and services can be provided for more computing nodes.

Description

technical field [0001] The invention relates to the technical field of distributed storage, in particular to a method and system for accessing a distributed block storage system in a user state. Background technique [0002] Usually distributed block storage mainly provides cloud disk services for physical servers and virtual machines. In the existing technology, when implementing distributed block storage, the SCSI standard block interface is generally not provided directly, but the access interface is uniformly provided externally in the form of iSCSI, such as figure 1 shown. For the sake of convenience, many solutions will choose to carry out secondary development based on TGT in the initial stage of design to realize iSCSI Target's support for distributed block storage. [0003] But, there is following shortcoming in the way of prior art: [0004] 1. A unified design is adopted for the application scenarios of physical servers and virtual machines, and the design is n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/27H04L29/08
CPCG06F16/27H04L67/1097H04L67/568
Inventor 沈建
Owner SUNING CLOUD COMPUTING CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products