Deduplication File Restore Using Multi-Stream Read-Ahead Caches

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Restoring files from large-scale deduplicated filesystems is time-consuming due to the need to fetch data from storage, which can be inefficient and slow, especially when dealing with redundant data.

Innovation Solution

Implementing a read-ahead cache mechanism that prefetches data from the storage layer and stores it in memory, allowing subsequent read requests to be serviced directly from the cache, thereby reducing the time required for file restoration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If data is fetched directly from the storage layer for file restoration, then data can be retrieved from the original storage location, but the restoration process becomes time-consuming and inefficient

Engineering Contradiction:

Improvefile restoration timeVSAvoidrestoration efficiency

Core Design Contradiction:

Loss of timeVSProductivity

Solution Approach 1:

The system performs preliminary actions by prefetching data from the storage layer into read-ahead caches before actual restoration requests are processed. Multiple read-ahead streams proactively load data segments into cache memory in advance, so that when restoration is needed, data is already available or nearly available, significantly reducing restoration time and improving efficiency.

Inventive Principle:

Principle #10Preliminary action

2Productivity

If multiple read-ahead streams are used to populate caches, then data prefetching capability is improved, but system complexity increases

Engineering Contradiction:

Improvedata prefetching speedVSAvoidcache management complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system segments the file restoration process into multiple independent read-ahead streams, each responsible for prefetching specific data segments into caches. This segmentation allows parallel processing of different file portions, improving prefetching speed while maintaining manageable complexity through modular stream management.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The read-ahead caches serve multiple functions: they act as prefetch buffers for upcoming data, as restoration buffers for active file recovery, and as caching layers that reduce storage layer access frequency. This multi-functionality improves productivity without proportionally increasing complexity, as the same infrastructure supports multiple operational modes.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS20260030117A1Servicing file restorations in a deduplication filesystem using multiple read-ahead caches having locally fetched data

Publication Date: 2026.01.29 DELL PROD LP

AI summary

Access object (AOB) and deduplication object (DOB) services of a deduplication filesystem are provisioned across a cluster. A client-side library receives a request to restore a file, the file being divided into chunks, the chunks being assigned to similarity groups, and the DOBs owning subsets of the similarity groups. Offset ranges of the file are assigned to the AOBs such that each offset range assigned to an AOB hosted on a node corresponds to chunks of a similarity group owned by a DOB that is also hosted on the node. Prefetches are issued to the AOBs. Multiple internal read-ahead streams are opened from the AOBs to the DOBs. The streams prefetch chunks read by the DOBs to populate read-ahead caches maintained at the AOBs. The request is serviced using the read-ahead caches.