Software Data Compression for Storage Replication Throughput

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional storage systems require additional hardware adapters for data compression, leading to incompatible configurations and decreased system throughput when replicating large amounts of data across networks due to high latency and packet loss.

Innovation Solution

Implementing software components to perform data compression between storage systems, negotiating compression parameters for communication sessions, and using compression modules within the storage operating system to reduce packet size and improve throughput without additional hardware.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If additional hardware adapters are used for data compression, then data compression capability is improved, but device complexity and cost increase

Engineering Contradiction:

Improvedata compression capabilityVSAvoidhardware configuration complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces hardware-based compression adapters with software-based compression modules integrated into the storage operating system. This substitution eliminates the need for additional physical hardware components while maintaining data compression functionality, thereby reducing device complexity and incompatibility issues associated with hardware adapters.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The storage operating system is enhanced to include built-in compression capabilities that work across different storage systems and network configurations. This universal software-based approach allows the same compression functionality to be deployed without requiring system-specific hardware adapters, improving compatibility and reducing complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If additional hardware adapters are used for data compression, then data compression capability is improved, but manufacturing cost increases

Engineering Contradiction:

Improvedata compression capabilityVSAvoidsystem deployment cost

Core Design Contradiction:

Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

By replacing expensive hardware adapters with software-based compression modules, the patent significantly reduces manufacturing and deployment costs. The software solution can be distributed and installed without requiring additional physical components, eliminating hardware procurement, installation, and configuration costs.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The compression capability is implemented as software that can be copied and deployed across multiple storage systems without additional hardware costs. This allows the compression functionality to be replicated through software distribution rather than requiring physical hardware multiplication.

Inventive Principle:

Principle #26Copying

3Reliability

If data is transmitted over network with high latency, then data replication is achieved, but system throughput decreases

Engineering Contradiction:

Improvedata replication reliabilityVSAvoidsystem throughput

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent applies data compression before transmission to reduce the amount of data that needs to be sent over the network. This preliminary compression action decreases transmission time and reduces the impact of network latency, allowing more data to be replicated within the same time window and improving overall system throughput.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent changes the data parameter by compressing it before transmission, transforming large volumes of raw data into smaller compressed representations. This parameter change reduces network transmission requirements and allows the system to achieve better throughput despite high latency conditions.

Inventive Principle:

Principle #35Parameter changes

4Reliability

If data packets are lost during transmission, then retransmission is required, but link utilization decreases

Engineering Contradiction:

Improvedata transmission reliabilityVSAvoidlink utilization

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

By compressing data before transmission, the patent creates smaller data packets that consume less network bandwidth. When packet loss occurs and retransmission is necessary, the compressed packet size means less bandwidth is consumed during retransmission, thereby improving overall link utilization despite the need for retransmission.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS9112888B2Data replication network traffic compression

Publication Date: 2015.08.18 NETAPP INC

AI summary

An apparatus and method improving effective system throughput for replication of data over a network in a storage computing environment by using software components to perform data compression is disclosed. Software compression support is determined between applications in a data storage computing environment. If supported, compression parameters are negotiated for a communication session between storage systems over a network. Effective system throughput is improved since the size of a compressed lost data packet is less than the size of an uncompressed data packet when a lost packet needs to be retransmitted in a transmission window.