Defragmenting Source Storage for Multiphase Deduplication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing backup methods, particularly image backup, face redundancy issues when backing up multiple similar source storages, leading to increased storage size and bandwidth overhead due to duplicate blocks, and inefficiencies in data restoration caused by fragmentation between source and deduplication vault storages.

Innovation Solution

A method of defragmenting the source storage by analyzing and reordering duplicate blocks to match the order in the deduplication vault storage before creating a backup, reducing fragmentation and the time required for data restoration by minimizing seeking during the backup and restore processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If image backup is used to back up multiple similar source storages, then backup speed is improved by reducing seeking, but storage size increases due to redundant duplicate blocks

Engineering Contradiction:
Improvebackup speedVSAvoidstorage size
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent extracts duplicate blocks from the backup image and identifies them as redundant. By taking out these duplicate blocks and storing only unique blocks in the deduplication vault, the system reduces storage size while maintaining backup speed benefits through sequential reading operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent discards redundant duplicate blocks during the backup process by using deduplication technology. Instead of storing all blocks from multiple source storages, it discards duplicates and recovers only unique blocks, thereby reducing storage size while preserving data integrity.

Inventive Principle:
Principle #34Discarding and recovering

2Adaptability or versatility

If blocks are stored in different orders in source storage and deduplication vault storage, then data can be backed up flexibly, but restoration time increases due to extensive seeking

Engineering Contradiction:
Improvebackup flexibilityVSAvoidrestoration time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent performs preliminary ordering of blocks during the backup phase, organizing blocks in the source storage to match the order in the deduplication vault before restoration is needed. This preliminary action eliminates the need for extensive seeking during restoration, reducing restoration time while maintaining backup flexibility.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent establishes continuous sequential access patterns for block reading during both backup and restoration operations. By ensuring blocks are ordered consistently between source and vault storages, the system maintains continuous useful action during restoration without interruption from seeking operations.

Inventive Principle:
Principle #20Continuity of useful action

3Reliability

If file backup is used to back up individual files, then data integrity is improved by tracking file system metadata, but bandwidth overhead increases due to tracking and storing file location information

Engineering Contradiction:
Improvedata integrityVSAvoidbandwidth overhead
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent uses image backup to create a complete copy of allocated blocks from the source storage, including file system metadata blocks. This copying approach ensures data integrity by preserving the complete storage image while avoiding the bandwidth overhead of tracking and storing separate file location information, as all data is copied sequentially in one operation.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS8682870B1Defragmentation during multiphase deduplication
Publication Date: 2014.03.25 STORAGECRAFT LLC
  • US8682870B1 patent drawing
  • US8682870B1 patent drawing
  • US8682870B1 patent drawing

AI summary

Defragmentation during multiphase deduplication. In one example embodiment, a method of defragmentation during multiphase deduplication includes an analysis phase that includes analyzing each allocated block stored in a source storage at a point in time to determine if the block is duplicated in a vault storage, a defragmentation phase that includes reordering the duplicate blocks stored in the source storage to match the order of the duplicate blocks as stored in the vault storage, and a backup phase that is performed after completion of the defragmentation phase and that includes storing, in the vault storage, each unique nonduplicate block from the source storage.