RAID Enclosure Compression Offloading for Write Latency Relief
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Content-based storage solutions face challenges in efficiently managing duplicate data blocks and improving performance, particularly in handling write operations and compression processing within storage systems.
Innovation Solution
A storage system architecture that offloads RAID processing and compression tasks from the storage controller to processing devices within storage enclosures, utilizing RAID arrays and NVMeOF protocols to enhance processing resources and reduce bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If compression processing is performed by the storage controller, then data can be compressed before storage, but the storage controller resources are consumed and latency increases
Solution Approach 1:
The patent extracts the compression processing function from the storage controller and relocates it to the host system. The storage controller sends compression instructions to the host, which then performs the actual compression of data blocks before transmission back to storage. This extraction resolves the contradiction by eliminating compression-related latency from the storage controller's critical path while still achieving compression for improved storage capacity efficiency.
Solution Approach 2:
The patent introduces an intermediary communication mechanism between the storage controller and host system. The storage controller acts as a mediator that generates compression instructions and sends them to the host, which executes the compression. This intermediary approach allows the storage controller to orchestrate compression without performing the computationally intensive operation itself, thereby reducing latency while maintaining compression benefits.
2Ease of operation
If the storage controller handles all RAID processing and compression tasks, then centralized control is maintained, but the storage controller becomes a bottleneck reducing system throughput
Solution Approach 1:
The patent segments the storage processing workload by separating RAID processing and compression tasks from the storage controller. The storage controller retains centralized control for coordination and management, while the host system handles the computationally intensive RAID and compression operations. This segmentation resolves the bottleneck issue by distributing the workload, thereby improving system throughput while maintaining centralized operational control.
Solution Approach 2:
The patent introduces dynamic task distribution where the storage controller dynamically sends compression instructions to the host based on incoming write operations. The host dynamically executes these instructions and returns compressed data blocks. This dynamic approach allows the system to adaptively balance the workload between the storage controller and host, improving throughput while maintaining flexible centralized coordination.
3Ease of manufacture
If duplicate data blocks are stored, then write operations are simple, but storage capacity efficiency decreases
Solution Approach 1:
The patent applies preliminary compression action to data blocks before they are stored. The host system compresses incoming data blocks according to instructions from the storage controller, creating a compressed version of the data. This preliminary compression prevents duplicate data from occupying unnecessary storage space, thereby improving storage capacity efficiency while maintaining relatively simple write operations through automated compression processing.
Data Source
AI summary
A storage system comprises a plurality of enclosures and a storage controller. Each enclosure comprises at least one processing device and a plurality of drives configured in accordance with a redundant array of independent disks (RAID) arrangement. The storage controller obtains data pages associated with an input-output request, provides the data pages to a processing device of a given enclosure, and issues a command to the processing device to perform at least one operation based at least in part on the data pages. The processing device of the given enclosure receives the data pages from the storage controller, generates compressed data pages based at least in part on the received data pages, stores one or more of the compressed data pages on the plurality of drives according to the RAID arrangement and returns information associated with the storage of the compressed data pages to the storage controller.