Storage Optimization Selection Between Deduplication and Compression

Solution Overview

Problem

Conventional data storage systems inefficiently handle situations where deep data compression is preferable over unaligned deduplication, leading to higher read latency due to unsuccessful deduplication attempts.

Innovation Solution

Specialized circuitry selects between unaligned deduplication and deep compression based on compressibility estimates, allowing for optimized storage operations with minimal impact on latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If unaligned deduplication is performed on candidate data, then storage space efficiency is improved, but read latency increases

Engineering Contradiction:

Improvestorage space efficiencyVSAvoidread latency

Core Design Contradiction:

Quantity of substanceVSLoss of time

Solution Approach 1:

The system dynamically selects between unaligned deduplication and deep compression based on real-time evaluation of candidate data characteristics. The specialized circuitry assesses compressibility estimates and application requirements to adaptively choose the optimal storage optimization technique, allowing the system to switch between deduplication (for storage efficiency) and compression (for read latency) as needed.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the storage optimization parameter from fixed (always unaligned deduplication) to variable (conditional selection between deduplication and compression). By evaluating compressibility estimates and comparing them against thresholds, the system adjusts the storage optimization approach based on data characteristics and performance requirements.

Inventive Principle:

Principle #35Parameter changes

2Loss of time

If deep compression is performed on candidate data, then read latency is reduced, but storage space efficiency decreases

Engineering Contradiction:

Improveread latencyVSAvoidstorage space efficiency

Core Design Contradiction:

Loss of timeVSQuantity of substance

Solution Approach 1:

The system dynamically selects between unaligned deduplication and deep compression based on real-time evaluation of candidate data characteristics. The specialized circuitry assesses compressibility estimates and application requirements to adaptively choose the optimal storage optimization technique, allowing the system to switch between deduplication (for storage efficiency) and compression (for read latency) as needed.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the storage optimization parameter from fixed (always unaligned deduplication) to variable (conditional selection between deduplication and compression). By evaluating compressibility estimates and comparing them against thresholds, the system adjusts the storage optimization approach based on data characteristics and performance requirements.

Inventive Principle:

Principle #35Parameter changes

3Quantity of substance

If conventional data storage systems always perform unaligned deduplication, then storage space utilization is optimized, but read operations become slower

Engineering Contradiction:

Improvestorage space utilizationVSAvoidread operation speed

Core Design Contradiction:

Quantity of substanceVSSpeed

Solution Approach 1:

The system dynamically selects between unaligned deduplication and deep compression based on real-time evaluation of candidate data characteristics. The specialized circuitry assesses compressibility estimates and application requirements to adaptively choose the optimal storage optimization technique, allowing the system to switch between deduplication (for storage efficiency) and compression (for read latency).

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the storage optimization parameter from fixed (always unaligned deduplication) to variable (conditional selection between deduplication and compression). By evaluating compressibility estimates and comparing them against thresholds, the system adjusts the storage optimization approach based on data characteristics and performance requirements.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS12632176B2Choosing among storage optimizations when storing candidate data

Publication Date: 2026.05.19 DELL PROD LP

AI summary

A data storage technique involves detecting that candidate data is deduplicatable within a storage array. The technique further involves, in response to detecting that the candidate data is deduplicatable within the storage array, evaluating whether to perform a compression operation on the candidate data in place of performing a deduplication operation on the candidate data and providing an optimization decision indicating whether to perform the deduplication operation on the candidate data in place of performing the deduplication operation on the candidate data. The technique further involves performing, within the storage array, a storage optimization operation on the candidate data based on the optimization decision, the storage optimization operation including one of the deduplication operation to deduplicate the candidate data and the compression operation to compress the candidate data.