Compression Forecasting for Deduplicated Storage Capacity Planning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Deduplicating storage systems face efficiency degradation issues, leading to unplanned storage inefficiencies, which can prevent users from efficiently storing new data and fail to meet user needs.

Innovation Solution

A system for compression forecasting in deduplicating storage systems, utilizing a processor to receive and analyze storage information, predict potential failure points, and implement strategies such as adding storage units, purging older files, or migrating data to other storage tiers to maintain efficiency and prevent failures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a deduplicating storage system is used to store data efficiently, then storage efficiency is improved, but storage efficiency may degrade over time due to unplanned capacity issues

Engineering Contradiction:
Improvestorage efficiencyVSAvoidstorage efficiency stability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary actions by forecasting compression ratios and predicting capacity issues before they occur. The compression forecasting module analyzes historical data and trends to identify potential capacity problems in advance, allowing administrators to take preventive measures such as adding storage units or migrating data before efficiency degradation impacts operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements continuous feedback mechanisms by monitoring storage system performance metrics and comparing actual compression ratios against forecasted values. The notification module provides feedback to administrators when predicted compression ratios indicate potential capacity issues, enabling timely corrective actions to maintain storage efficiency stability.

Inventive Principle:
Principle #23Feedback

2Reliability

If storage capacity is increased to prevent future failures, then reliability is improved, but cost and energy consumption increase

Engineering Contradiction:
Improvecapacity failure preventionVSAvoidstorage capacity
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system uses compression forecasting to perform preliminary analysis of capacity needs, predicting future compression ratios and identifying when capacity expansion will be necessary. This allows for planned, incremental storage additions based on actual projected needs rather than premature or excessive capacity provisioning, optimizing the balance between reliability and resource utilization.

Inventive Principle:
Principle #10Preliminary action

3Ease of manufacture

If storage units are added incrementally based on forecasts, then cost-effectiveness is improved, but system complexity increases

Engineering Contradiction:
Improvecost-effectivenessVSAvoidstorage system management
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The compression forecasting module operates autonomously, automatically collecting performance data, analyzing trends, and generating predictions without requiring manual intervention. The notification module automatically alerts administrators to potential capacity issues, enabling self-service capacity management that reduces operational complexity while maintaining cost-effectiveness through informed, timely decisions.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS8595198B1Compression forecasting for a deduplicating storage system
Publication Date: 2013.11.26 EMC IP HLDG CO LLC
  • US8595198B1 patent drawing
  • US8595198B1 patent drawing
  • US8595198B1 patent drawing

AI summary

A system for managing a storage system comprises a processor and a memory. The processor is configured to receive storage system information from a deduplicating storage system. The processor is further configured to determine a compression forecast based at least in part on the storage system information. The processor is further configured to provide a capacity forecast. The memory is coupled to the processor and configured to provide the processor with instructions.