Batch Cold Data Block Restoration via Storage Time Grouping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data management systems face inefficiencies and increased costs when restoring backup data from multiple storage tiers, particularly due to restrictions and delays imposed by cold-tier storage, which can lead to unsatisfactory user experiences.
Innovation Solution
A data management server processes restoration requests by distinguishing between warm-tier and cold-tier data blocks, retrieving warm blocks immediately and batching cold blocks for retrieval from cold-tier storage, thereby reducing the number of requests and optimizing the restoration process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data blocks are retrieved individually from cold-tier storage, then complete data restoration is achieved, but the number of retrieval requests increases and restoration time increases
Solution Approach 1:
The patent combines multiple individual data retrieval requests into a single batch request. The data management server identifies multiple cold data blocks that need to be restored and packages them together in one retrieval operation to cold-tier storage, reducing the total number of requests and minimizing restoration time while ensuring all required data blocks are retrieved.
2Reliability
If data blocks are retrieved individually from cold-tier storage, then complete data restoration is achieved, but the burden on cold-tier storage increases
Solution Approach 1:
The patent merges multiple retrieval operations into a single batch request to cold-tier storage. By grouping multiple cold data blocks into one retrieval request, the system reduces the total number of interactions with cold-tier storage, thereby decreasing the operational burden and complexity on the cold-tier storage system while still ensuring all necessary data is restored.
3Loss of energy
If all data blocks are treated as cold-tier data, then storage cost is optimized, but restoration efficiency decreases
Solution Approach 1:
The patent segments data blocks into different categories based on their storage tier (warm-tier or cold-tier). By identifying and separating warm data blocks that can be retrieved quickly from cold data blocks that require batch processing, the system optimizes storage cost by keeping less frequently accessed data in cold-tier while maintaining high restoration efficiency for frequently accessed warm-tier data.
Solution Approach 2:
The patent applies different retrieval strategies to different data blocks based on their local characteristics. Warm data blocks are retrieved individually and immediately, while cold data blocks are grouped into batches. This localized approach ensures that each data block is handled according to its specific storage tier properties, optimizing both storage cost and restoration efficiency.
Data Source
AI summary
A data restoration system including a data management server. The data management server receives one or more data restoration requests for restoring a plurality of data blocks. The data management server determines, based on metadata associated with the data blocks, a first subset of warm data blocks corresponding to warm-tier data and a second subset of cold data blocks corresponding to cold-tier data. The data management server retrieves the warm data blocks in the first subset and restores the warm data blocks in the first subset. The data management server groups the cold data blocks based in part on storage times of the cold data blocks to generate a plurality of cold-tier data retrieval requests. The data management server retrieves the cold data blocks by batches, each batch corresponding to one of the cold-tier data retrieval requests. The data management server restores the cold data blocks in the second subset.