Backup Data Indexing via Version Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Large backup data sets are challenging to search and index due to their size and compression formats, making it difficult to efficiently browse or restore subsets of the data.
Innovation Solution
A system and method for indexing multiple time-based versions of data backups, creating indices representative of difference data between backups, and combining these indices to provide search capabilities that factor in multiple versions of data backups, allowing for efficient searching and browsing of large dataset backups.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If backup data sets are compressed and stored in compact formats, then storage space efficiency is improved, but search and browsing capabilities deteriorate
Solution Approach 1:
The patent divides the backup data set into multiple time-based versions (snapshots) and creates separate indices for each version. This segmentation allows the system to maintain compressed storage while enabling efficient searching by querying specific time-based indices rather than scanning the entire compressed data set.
Solution Approach 2:
The patent introduces indices as intermediary structures that bridge the compressed backup data and search queries. These indices store metadata and change information about the data at different time points, allowing the system to efficiently retrieve and reconstruct specific versions without decompressing the entire backup data set.
2Ease of operation
If multiple time-based versions of backups are indexed, then search capability is improved, but indexing complexity and storage requirements worsen
Solution Approach 1:
The patent merges the indexing of multiple time-based versions into a unified structure where indices for different backup versions are combined and managed together. This allows the system to handle multiple versions efficiently by processing them as an integrated set rather than separate complex structures.
Solution Approach 2:
The patent performs preliminary indexing of change data between backup versions during the backup process itself, rather than creating comprehensive indices after all data is collected. This preliminary action reduces the complexity of subsequent indexing operations and enables faster search operations.
3Measurement precision
If comprehensive indices are created for all backup data, then search accuracy is improved, but indexing time and processing resources worsen
Solution Approach 1:
The patent extracts only the necessary change information and metadata from the full backup data sets to create indices. Instead of indexing all data comprehensively, the system extracts and indices only the changes between versions, which provides sufficient search accuracy while significantly reducing indexing time and processing resources.
Solution Approach 2:
The patent applies partial indexing by creating indices based on change data rather than complete data sets. This partial action is sufficient for search purposes since the indices capture the essential information needed to locate and retrieve specific versions, avoiding the excessive processing required for comprehensive indexing.
4Quantity of substance
If backup data is stored in compact formats, then storage efficiency is improved, but the ability to restore subsets of data worsens
Solution Approach 1:
The patent segments backup data into time-based versions with associated indices, enabling selective restoration of specific versions or subsets of data. Users can query the indices to identify and restore only the necessary portions rather than recovering entire compressed data sets.
Solution Approach 2:
The patent creates index copies that contain metadata and change information about backup versions without copying the actual compressed backup data. This allows the system to provide restoration capabilities by referencing and reconstructing only the necessary data portions based on index information.
Data Source
AI summary
Systems and methods of providing search capabilities for data backups by indexing multiple time-based versions of the data backups such that the multiple time-based versions of each of the data backups are factored into a search result. First data associated with a first backup of a data set is received, the first data including a list of changes associated with the data set between a first backup and a second backup. For each of the first backup, second backup and one or more intermediary backups an index representative of difference data is created. Second data associated with a search request is received. A version of the file is retrieved based on the search request, thereby providing search capabilities for data backups by indexing data backups at a plurality of backup times such that multiple versions of each of the data backups are factored into a search result.