Compressed Data Block Padding for Deduplication Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional storage systems face inefficiencies in data management and storage operations, particularly in handling flash drives without integrated storage controllers, leading to unnecessary write operations and reduced reliability.
Innovation Solution
A direct-mapped flash storage system where the operating system initiates and controls processes, such as data rewriting and erasure, without address translation by storage controllers, using flash drives with separate addressable fast-write storage and non-volatile RAM for buffering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If traditional storage controllers perform address translation and control flash drives, then data management is automated, but redundant write operations increase and reliability decreases
Solution Approach 1:
The patent extracts the storage controller from the flash drive, creating a direct-attached storage architecture where the flash drive connects directly to the host system without an intermediate controller. This eliminates the controller's address translation functions that caused redundant writes, while the host system assumes control responsibilities. The flash drive becomes a simpler device focused solely on data storage, improving reliability by removing the problematic controller component.
2Ease of operation
If storage controllers manage data rewriting and erasure, then storage operations are controlled, but write operations become redundant and efficiency decreases
Solution Approach 1:
The patent implements a self-service architecture where the host system directly manages flash drive operations including data rewriting and erasure. The flash drive exposes its raw storage capabilities to the host, which performs address mapping and operation management itself. This eliminates the controller's intermediary role that caused redundant writes, allowing the host to optimize write operations directly and improve storage efficiency while maintaining full operational control.
Data Source
AI summary
Preparing data for deduplication including in response to receiving a request to transfer data from a source storage system to a target storage system, accessing, by the source storage system, a compressed data block; generating, by the source storage system, a padded compressed data block by padding the compressed data block to conform to a fixed block size, wherein the fixed block size is greater than a size of the compressed data block; and sending, by the source storage system, the padded compressed data block to the target storage system.