Permanent incremental backup method based on S3 bucket-level virtual snapshot

By employing a permanent incremental backup method based on S3 bucket-level virtual snapshots and IncDSI optimization algorithm, the problems of storage redundancy and low recovery efficiency in traditional backup technologies are solved, achieving efficient and accurate data backup and recovery, and suitable for large-scale file systems.

CN120407285APending Publication Date: 2025-08-01NANJING UNARY INFORMATION TECH
0 Cites 8 Cited by

Patent Information

Application Number
CN202510486285.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-17
Publication Date
2025-08-01

AI Technical Summary

Technical Problem

Traditional incremental backup methods are inefficient when dealing with large-scale data, making it difficult to guarantee data integrity and recovery speed. They also suffer from severe storage redundancy and lack effective storage optimization mechanisms.

Method used

A permanent incremental backup method based on S3 bucket-level virtual snapshots and IncDSI optimization algorithm is adopted. File changes are identified by hash comparison and modification time comparison. The mapping relationship between file path and snapshot identifier is managed by B+ tree index and inverted index. Incremental storage and deduplication storage mechanisms are used to perform backup chain integration and data recovery.

Benefits of technology

It significantly improves storage efficiency during the backup process, reduces data redundancy, enhances data recovery speed and accuracy, optimizes storage space utilization, and ensures efficient management and rapid recovery of backup data in large-scale file systems.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a permanent incremental backup method based on an S3 bucket-level virtual snapshot, and relates to the technical field of data storage and backup, the method comprises the following steps: initializing a backup system and starting a backup agent program, an index management service and an S3 object storage service; complete backup is executed, and a VID and S3 bucket-level virtual snapshoot are generated; efficiently managing a mapping relation between a file path and a snapshot identifier through a B + tree and an inverted index by utilizing a MongoDB index service; incremental backup is executed, and file changes are accurately recognized through Hash comparison and modification time comparison; a storage position is optimized by adopting an incremental storage and deduplication storage mechanism and an IncDSI optimization algorithm; executing backup chain integration and cleaning; and performing data recovery based on the VID of the file and the directory. According to the method, the backup efficiency is remarkably improved, the storage overhead is reduced, the data recovery process is optimized, and the method is suitable for data backup and management of a large-scale file system and has important application value and prospect.
Need to check novelty before this filing date? Find Prior Art