Hybrid Backup Method for Database Transaction Snapshots

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The surge in data volumes in database systems, particularly in OLAP and big data analysis, poses a challenge to backup efficiency, as existing methods struggle to effectively manage and store full state data, including current, transitional, and historical states, leading to increased data volume and reduced backup efficiency.

Innovation Solution

A hybrid physical backup method is introduced, which involves obtaining snapshot differences between historical and regular transaction snapshots to selectively back up current, transitional, and historical state data, allowing for efficient backup of full state data by separating and backing up each state type, thereby reducing the overall backup data volume and improving efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If full state data including all version data is backed up, then data security is ensured, but backup data volume increases and backup efficiency decreases

Engineering Contradiction:
Improvedata securityVSAvoidbackup efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts and separates version data based on visibility criteria. Only visible version data that can be accessed by transactions is extracted for backup, while invisible version data is excluded. This selective extraction reduces backup data volume while maintaining data security for recoverable data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of backing up all version data (excessive action), the patent implements partial backup by selectively including only visible version data. This partial action approach achieves sufficient data security for restoration purposes without the overhead of complete version data backup.

Inventive Principle:
Principle #16Partial or excessive action

2Adaptability or versatility

If all version data is stored for tracking historical states, then data tracking capability is improved, but data volume increases

Engineering Contradiction:
Improvedata tracking capabilityVSAvoiddata volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent applies local quality by differentiating between visible and invisible version data. Visible version data is maintained with full accessibility for historical tracking, while invisible version data is managed differently to reduce storage requirements. This local differentiation optimizes both tracking capability and storage efficiency.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12001297B2Data backup method and apparatus, server, and computer-readable storage medium
Publication Date: 2024.06.04 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12001297B2 patent drawing
  • US12001297B2 patent drawing
  • US12001297B2 patent drawing

AI summary

Aspects of this disclosure provide a data backup method and apparatus, a server, and a non-transitory computer-readable storage medium, belonging to the field of data database technologies. The method can include receiving a backup task that is used for backing up a data item of a target data table. The method can further include obtaining a first snapshot difference between a first historical transaction snapshot and a second historical transaction snapshot when a backup time of the backup task is a historical time period. The first historical transaction snapshot and the second historical transaction snapshot can be transaction snapshots respectively located at a start moment and an end moment of the historical time period. Additionally, the method can include performing the backup task based on the first snapshot difference to obtain backup data including at least a visible version of the data item in the target data table.