Unlock instant, AI-driven research and patent intelligence for your innovation.

Design method and system of row snapshot based on distributed block storage

A design method and system design technology, applied in calculation, response error generation, data processing input/output process, etc., can solve the problem of limited number of snapshots, affecting data volume I/O performance, limited cloning level, etc. question

Active Publication Date: 2022-08-09
北京大道云行科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are still various defects in ROW snapshots in the industry. After some snapshots are taken, the read performance is affected, the number of some snapshots is severely limited, and some clone levels are severely limited. will seriously affect the I / O performance of the data volume

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Design method and system of row snapshot based on distributed block storage
  • Design method and system of row snapshot based on distributed block storage
  • Design method and system of row snapshot based on distributed block storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] This embodiment provides a ROW snapshot design method based on distributed block storage. This embodiment adopts a virtual container volume, and records snapshot tree information under the virtual container volume. In this way, only the immutable virtual container volume needs to be provided to the outside world, and the snapshot operation and snapshot tree update will not be reflected to the external application, thus satisfying the function of online snapshot.

[0046] In this embodiment, the data is indexed by using the second-level bitmap, and the snapshot operation only needs to copy the first-level bitmap. The burden of snapshot operations is greatly reduced, and millisecond-level snapshots are achieved.

[0047] In this embodiment, the clone operation only needs to copy the first-level bitmap. While reducing the burden of the clone operation, the data between the clone volume and the source volume is also located through the L1 and L2 bitmap indexes, which reduce...

Embodiment 2

[0052] At the specific implementation level, this embodiment provides a snapshot organization method of a Row volume, refer to figure 1 As shown, the design of the Row volume in this embodiment adopts the method of adding a virtual container to a snapshot tree, as shown in the organization structure of the snapshot tree of the Row container volume (each node in the snapshot tree is a snapshot, corresponding to a unique snapshot id).

[0053] In this embodiment, when a Row volume is created, a volume container id (vol-1) is created in the system, and a header id of the snapshot tree is generated. The container ID records the IDs of all nodes in the snapshot tree.

[0054] In this embodiment, when the user creates a snapshot, a new id is generated based on the header id of the current snapshot tree as the new header id. And change the old header id to the snapshot id. When a snapshot rollback operation occurs, a new header ID is generated based on the specified snapshot ID of ...

Embodiment 3

[0057] In terms of specific implementation, this embodiment provides a basic snapshot operation of a Row volume. This embodiment creates a snapshot, generates a new header id based on the current header id, and copies the L1 chunk of the current header id to the new header id. The old header id becomes the snapshot id. Create snapshot operations such as figure 2 shown.

[0058] refer to image 3 As shown, delete the snapshot, mark the snapshot as deleted in the snapshot tree, and hide the snapshot. Then compare the L2 bitmap based on the L2 bitmap in the background task and recover the unique data of the snapshot, and move the data inherited by the child to the child snapshot. After all the data is moved, the snapshot node information is actually deleted from the snapshot tree.

[0059] refer to Figure 4 As shown, to roll back the snapshot, generate a new header id based on the snapshot id to be rolled back, copy the L1chunk information of the snapshot id to the new hea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of storage snapshots, in particular to a method and system for designing ROW snapshots based on distributed block storage. The invention adopts virtual containers and snapshot trees for the snapshot organization of Row volumes. In the snapshot tree setting, each node is a Snapshot, and corresponds to the unique snapshot id, used for Row volume creation or when users create snapshots and access snapshots; the method uses two-level bitmap indexes to manage the data of the Row volume at the same time, wherein the method performs the Row volume data. Basic snapshot operations include creating snapshots, deleting snapshots, rolling back snapshots, and cloning volumes. The online snapshot of the present invention does not need to interrupt the business when taking a snapshot, and the reading performance is almost lossless by taking a snapshot. At the same time, it supports tens of thousands of snapshots, one snapshot supports tens of thousands of clone volumes, and supports cascaded snapshots. Theoretical cascade level Unrestricted, snapshot operation performance and I / O performance of cloned volumes are not affected by the cascade level, and snapshots can be deleted in milliseconds.

Description

technical field [0001] The invention relates to the technical field of storage snapshots, in particular to a ROW snapshot design method and system based on distributed block storage. Background technique [0002] With the development of the Internet, the arrival of the era of big data, and the promotion of technologies such as artificial intelligence, AIoT, and cloud computing, the amount of global data is growing at an unlimited speed. In November 2018, the IDC white paper "DataAge2025" pointed out that the total global data volume will increase from 33ZB in 2018 to 175ZB in 2025, and information data is showing a rapid growth trend. With such a huge amount of data, data security is particularly important. [0003] Data backup, multi-copy mechanism, erasure coding and other technologies are all to ensure the security of data. While these solutions ensure data security, redundant information is generated, which greatly occupies storage space, affects system performance, or...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/14G06F3/06
CPCG06F11/1448G06F3/0611G06F3/064G06F3/067
Inventor 刘爱贵介玄克阮薛平
Owner 北京大道云行科技有限公司