Storage System Inline Deduplication Load Adaptation

The patent dynamically adjusts the deduplication strategy based on system load conditions. When load is high, it switches to deferred deduplication mode to avoid performance degradation; when load is low, it performs inline deduplication to maximize data reduction. This dynamic adaptation resolves the contradiction by making the system flexible rather than fixed in its approach.

The patent implements partial deduplication by recording mapping entries in logs for high-load scenarios instead of performing full inline deduplication. This partial action reduces resource overhead while still maintaining the ability to perform deduplication later, accepting that not all deduplication occurs immediately but achieving the goal under constrained conditions.

The patent uses periodic batch processing to perform deduplication on data blocks that were deferred during high-load periods. Instead of continuous inline deduplication, it periodically processes accumulated data blocks in batches when system load decreases, reducing instantaneous resource consumption while achieving storage optimization over time.

The patent extracts the deduplication operation from the immediate write path during high-load conditions, separating it into a deferred batch processing stage. This extraction removes the resource-intensive fingerprint querying from the critical write path, reducing resource consumption during peak periods while still achieving deduplication in the extracted batch processing phase.