Backup File Redundancy Reduction via Segmented Overhead and Data Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing backup storage systems inefficiently use memory by storing multiple identical copies of software and data, leading to substantial storage requirements and costs due to redundancy.
Innovation Solution
A method that creates backup files with reduced redundancy by separating data and overhead segments into distinct streams, using pointers to identify data segments, and deleting redundant data segments, allowing multiple overhead streams to point to the same data segment, thereby optimizing storage space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If identical software and data are stored separately on the backup server for each server backup, then data redundancy and security are provided, but storage space is inefficiently used and substantial memory is consumed
Solution Approach 1:
The backup file is divided into two distinct segments: an overhead segment containing metadata and pointers, and a data segment containing the actual backup data. This segmentation allows the system to store identical data only once while maintaining references from multiple overhead segments, thereby reducing storage space while preserving data redundancy and security.
Solution Approach 2:
Instead of physically copying identical data files for each server backup, the system creates overhead segments that contain pointers referencing the shared data segment. This virtual copying approach maintains the appearance of multiple copies for redundancy purposes while actually storing the data only once, significantly reducing storage requirements.
2Productivity
If multiple copies of identical software are stored on the backup server, then each server backup is complete and independent, but additional storage must be added at substantial cost
Solution Approach 1:
Multiple backup operations are merged by sharing common data segments across different overhead segments. The system combines the metadata management of individual backups with the data storage efficiency of deduplication, allowing each backup to remain independent and complete while sharing underlying storage resources.
Solution Approach 2:
The overhead segment acts as an intermediary between the backup control system and the actual data storage. It contains pointers and metadata that enable the system to manage multiple backups independently while physically storing data efficiently through shared references to common data segments.
3Reliability
If redundant data segments are stored for each server backup, then data security and recovery options are maintained, but memory space is substantially consumed
Solution Approach 1:
The system implements virtual copying where overhead segments contain pointers referencing shared data segments. This approach maintains the ability to recover data from any server backup while avoiding the physical storage of redundant data copies, thereby preserving data security without the associated memory space consumption.
Data Source
AI summary
A method of creating backup files having less redundancy. The method creates a backup file by creating an overhead segment for each file that is to be backed up and creating a data segment containing the data that is to be backed up for each file. After creating the overhead segment and the data segment, the overhead segment is placed into an overhead stream data segment is stored in memory. The overhead segment is also positioned in the overhead stream with a pointer that identifies the data segment within the memory. For backups of subsequent servers or the same server at a later time, the backup software will create a separate overhead stream. However, a plurality of overhead streams may contain pointers to the same data segments such that redundant data segments do not need to be stored in a backup server.