Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A data reading and writing method and system for a shared volume of distributed block storage

A technology of data reading and writing and block storage, which is applied in transmission system, electrical digital data processing, input/output process of data processing, etc., can solve problems such as storage data errors, and achieve the effect of simplifying processing logic

Inactive Publication Date: 2019-04-26
WUHAN FIBERHOME INFORMATION INTEGRATION TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] Although the above method solves the problem of data consistency of shared volumes, it puts relatively high requirements on the application program
The application program using the shared volume in the upper layer must ensure that the simultaneous reading and writing of the volume does not occur in VM1 and VM2. Once the application program cannot guarantee this, such as split-brain problems, it will cause the consequences of stored data errors.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data reading and writing method and system for a shared volume of distributed block storage
  • A data reading and writing method and system for a shared volume of distributed block storage
  • A data reading and writing method and system for a shared volume of distributed block storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0043] see image 3 As shown in the figure, when a virtual machine uses distributed block storage, it needs to access it through the client program provided by the storage. The virtual machine runs on the physical machine and is embodied as an independent process. In the virtual machine process, a private client of distributed storage is run. When the virtual machine reads and writes volumes, it needs to access the stored data through the client. The data itself is stored in on the backend storage server.

[0044] When the distributed block storage reads and writes data, the client usually first slices the data of the volume. The length of the slice is fixed, such as 4MB. The address and length can be mapped to one or more specific data fragments, and then each data fragment is sent to the back-end storage server according to certain rules, and the storage server saves the fragmented data.

[0045] The embodiment of the present invention provides a method for reading and wri...

Embodiment 2

[0063] An embodiment of the present invention provides a data reading and writing system for a shared volume of distributed block storage, including:

[0064] The data sharding module is used for: performing data sharding on the shared volume of the distributed block storage, adding a version number in each piece of data; adding a 64-bit version number at the head of each data piece.

[0065] The storage client is used for: when reading the fragmented data from the storage server, read the version number of the fragmented data at the same time; when processing the read fragmented data, add 1 to the version number of the fragmented data, and Send the data to be written and the version number after adding 1 to the storage server at the same time;

[0066] The storage server is used for: verifying the version number, if it is detected that the version number of the data written by the client is equal to or smaller than the version number in the storage server, the writing is refu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data reading and writing method and system for a shared volume of distributed block storage, and relates to the field of distributed storage and cloud computing. The method comprises the following steps: carrying out data fragmentation on a shared volume stored in a distributed block, and adding a version number before each piece of fragmented data; When the storage client writes data into the storage server, reading the version number of the fragmented data, adding 1 to the version number of the fragmented data, and sending the data to be written and the version number added with 1 to the storage server at the same time; The storage server verifies the version number, and if it is detected that the version number of the client writing data is equal to or smallerthan the version number in the storage server, writing is refused; Otherwise, the check is passed, the data is allowed to be written in, the problem of data errors caused by concurrent reading and writing is avoided, the correctness of the data is ensured when a plurality of clients read and write the data at the same time, and an application program does not need to be additionally protected.

Description

technical field [0001] The invention relates to the field of distributed storage and cloud computing, in particular to a data reading and writing method and system for a shared volume of distributed block storage. Background technique [0002] Distributed block storage has been widely used in cloud computing environments, such as common openstack and ceph. Openstack provides virtualization capabilities as a cloud computing platform, ceph provides storage resources for virtual machines on openstack, and storage devices can also be other distributed storage or centralized storage. [0003] Shared volumes are a way of using storage volumes in a cloud computing environment. Generally, after creating a volume on the storage device through the cloud platform, and then mounting the volume to the virtual machine, the virtual machine can write data to the volume normally, and each volume is mounted to a virtual machine for use. However, some application software itself is a cluster...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06G06F9/455H04L29/08
CPCG06F3/0614G06F3/0665G06F3/067G06F9/45558G06F2009/45583H04L67/1097
Inventor 王振宇孙梦迪邓沛沛
Owner WUHAN FIBERHOME INFORMATION INTEGRATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com