Two-Level Segment Labeling for Backup Data Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Deduplication techniques in storage systems cause data segments from a backup data set to become scattered, leading to inefficient storage and rehydration performance due to the need for an artificially large number of storage containers and non-sequential storage of data.
Innovation Solution
A two-level segment labeling mechanism and localized multiple read threads are employed to ensure that unique data segments are stored contiguously within storage containers, maintaining spatial locality and improving rehydration performance by storing segments sequentially based on session and source identification information during compaction operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If deduplication techniques are used to reduce storage capacity, then storage efficiency is improved, but data segments become scattered requiring more storage containers
Solution Approach 1:
The patent segments data into distinct backup sets organized by source computer and backup session, then stores each segment in dedicated storage containers. This segmentation prevents scattering by ensuring all segments from a particular backup set remain in the same container, resolving the contradiction between deduplication efficiency and storage container management complexity
Solution Approach 2:
The patent implements local quality by maintaining spatial locality of backup data segments within specific storage containers. Each container is dedicated to a specific backup set, ensuring that data segments from the same source and session are stored contiguously rather than scattered across multiple containers, thus improving rehydration performance while maintaining deduplication benefits
2Adaptability or versatility
If data segments are stored non-sequentially due to scattering, then storage flexibility is improved, but rehydration performance deteriorates
Solution Approach 1:
The patent performs preliminary organization of data segments during the backup process, sorting and storing segments in sequential order within each storage container before they are needed for rehydration. This preliminary action ensures that when rehydration is required, data can be retrieved efficiently in sequence without needing to search through scattered segments across multiple containers
Solution Approach 2:
The patent introduces an organizational dimension by creating a hierarchical structure of storage containers mapped to backup sets, sources, and sessions. This dimensional organization allows the system to maintain storage flexibility while enabling sequential retrieval through the structured container hierarchy, directly improving rehydration performance
Data Source
AI summary
Systems and methods for providing efficient storage and retrieval of data are disclosed. A two-level segment labeling mechanism may be employed to ensure that unique data segments from particular backup data sets are stored together in a storage container. The two-level segment labeling may facilitate preservation of the relative positions of segments within the backup stream during compaction operations. Also, backup data restoration performance may be improved by use of multiple read threads that are localized to particular storage containers.