Check patentability & draft patents in minutes with Patsnap Eureka AI!

ROW snapshot design method and system based on distributed block storage

A design method and technology for designing systems, which are applied in the directions of calculation, generation of response errors, and input/output processes of data processing, etc., and can solve the problems affecting the I/O performance of data volumes, the impact of read performance, and the limited number of snapshots.

Active Publication Date: 2022-03-01
北京大道云行科技有限公司
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are still various defects in ROW snapshots in the industry. After some snapshots are taken, the read performance is affected, the number of some snapshots is severely limited, and some clone levels are severely limited. will seriously affect the I / O performance of the data volume

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • ROW snapshot design method and system based on distributed block storage
  • ROW snapshot design method and system based on distributed block storage
  • ROW snapshot design method and system based on distributed block storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] This embodiment provides a ROW snapshot design method based on distributed block storage. This embodiment adopts a virtual container volume, and snapshot tree information is recorded under the virtual container volume. In this way, only the constant virtual container volume needs to be provided to the outside, and the snapshot operation and the update of the snapshot tree will not be reflected in the external application, thus satisfying the function of online snapshot.

[0046] In this embodiment, data is indexed in the form of a second-level bitmap, and the snapshot operation only needs to copy the first-level bitmap. The burden of snapshot operations is greatly reduced, and millisecond-level snapshots are realized.

[0047] In this embodiment, the cloning operation only needs to copy the first-level bitmap. While reducing the burden of the cloning operation, the data between the cloned volume and the source volume is also located through the L1, L2 bitmap index, whic...

Embodiment 2

[0052] At the specific implementation level, this embodiment provides a Row volume snapshot organization method, refer to figure 1 As shown, the design of the Row volume in this embodiment adopts the method of virtual container plus snapshot tree, as shown in the organizational structure of the Row container volume snapshot tree (each node in the snapshot tree is a snapshot, corresponding to a unique snapshot id).

[0053] In this embodiment, when a Row volume is created, a volume container id (vol-1) will be created in the system, and the head id of the snapshot tree will be generated. The ids of all nodes in the snapshot tree will be recorded under the container id.

[0054] In this embodiment, when a user creates a snapshot, a new id is generated based on the head id of the current snapshot tree as the new head id. And change the old header id to snapshot id. When a snapshot rollback operation occurs, a new head id is generated based on the rollback specified snapshot id,...

Embodiment 3

[0057] In terms of specific implementation, this embodiment provides a basic snapshot operation of the Row volume. This embodiment creates a snapshot, generates a new head id based on the current head id, and copies the L1 chunk of the current head id to the new head id. The old header id becomes the snapshot id. Create a snapshot operation such as figure 2 shown.

[0058] refer to image 3 As shown, delete the snapshot, mark the snapshot as deleted in the snapshot tree, and hide the snapshot. Then in the background task, compare the L2 bitmap based on the L2 bitmap and reclaim the unique data of the snapshot, and move the data inherited by the child to the child snapshot. After all the data is moved, the snapshot node information is actually deleted from the snapshot tree.

[0059] refer to Figure 4 As shown, to roll back the snapshot, generate a new header id based on the snapshot id to be rolled back, copy the L1chunk information of the snapshot id to the new header ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of snapshot storage, in particular to an ROW snapshot design method and system based on distributed block storage, a virtual container is adopted for a snapshot organization of a Row volume to accelerate a snapshot tree, each node in snapshot tree setting is a snapshot and corresponds to a unique snapshot id, and the snapshot tree is set to be a snapshot. The method is used for creating Row volumes or creating snapshots and accessing the snapshots by users. According to the method, two-stage bitmap indexes are adopted for managing data of the Row volume at the same time, and the basic snapshot operation of the Row volume in the method comprises the steps of creating a snapshot, deleting the snapshot, rolling back the snapshot and cloning the volume. According to the method, online snapshot and snapshot shooting do not need to interrupt a service, snapshot shooting almost has no damage to read performance, meanwhile, the number of snapshots of tens of thousands of levels is supported, one snapshot supports the number of clone volumes of tens of thousands of levels, cascade snapshot is supported, the theoretical cascade level is not limited, the snapshot operation performance and the I / O performance of the clone volumes are not affected by the cascade level, and the method is suitable for large-scale popularization and application. And the snapshots can be deleted in milliseconds.

Description

technical field [0001] The invention relates to the technical field of storage snapshots, in particular to a ROW snapshot design method and system based on distributed block storage. Background technique [0002] With the development of the Internet, the advent of the era of big data, and the advancement of technologies such as artificial intelligence, AIoT, and cloud computing, the amount of global data is growing at an unlimited rate. In November 2018, the IDC white paper "DataAge2025" pointed out that the total amount of global data will increase from 33ZB in 2018 to 175ZB in 2025, and information data is growing rapidly. With such a huge amount of data demanded, data security is particularly important. [0003] Data backup, multi-copy mechanism, erasure code and other technologies are all to ensure data security. While these solutions ensure data security, they all generate redundant information, occupy a large amount of storage space, and have an impact on system perf...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F11/14G06F3/06
CPCG06F11/1448G06F3/0611G06F3/064G06F3/067
Inventor 刘爱贵介玄克阮薛平
Owner 北京大道云行科技有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com