Dummy File Exploiting In-Storage Transparent Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage hierarchies do not support direct information passing from storage devices to hosts about in-storage transparent compression efficiency and available storage capacity, preventing hosts from utilizing the extra storage capacity created by in-storage transparent compression.
Innovation Solution
A storage infrastructure and method that includes a storage device with transparent compression and a logical block address-to-physical block address mapping table, along with a host memory management system that allocates logical block address storage, creates a dummy file, and adjusts its size based on usage information to leverage the extra storage capacity without modifying existing storage hierarchies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If in-storage transparent compression is implemented, then storage capacity efficiency is improved, but the host cannot utilize the extra storage capacity due to lack of information passing mechanisms
Solution Approach 1:
The patent introduces a dummy file as an intermediary mechanism that indirectly communicates compression efficiency information from the storage device to the host. The dummy file's size and location serve as a mediator to convey available storage capacity information without requiring direct information passing protocols between the host and storage device.
Solution Approach 2:
The system implements a feedback mechanism where the host monitors the dummy file's characteristics (size, location) to infer compression efficiency and available storage capacity. This feedback loop allows the host to dynamically adjust its storage utilization based on the actual compression performance achieved by the in-storage compression system.
2Productivity
If storage hierarchy is modified to support information passing, then host can utilize extra storage capacity, but system complexity and difficulty of implementation increase
Solution Approach 1:
Instead of modifying the storage hierarchy to create new information passing channels, the patent creates a copy or representation of storage capacity information through the dummy file. The dummy file serves as a simplified representation that the host can interpret to understand available storage capacity, avoiding the need for complex protocol modifications.
Solution Approach 2:
The dummy file serves multiple functions simultaneously: it acts as a placeholder to reserve logical block addresses, a communication mechanism to convey compression efficiency information, and a dynamic indicator of available storage capacity. This multi-functionality eliminates the need for separate dedicated information passing infrastructure.
3Quantity of substance
If dummy file size is increased to reserve more LBA storage, then more storage capacity becomes available to host, but risk of exceeding PBA storage capacity increases
Solution Approach 1:
The dummy file's size and location are made dynamic rather than static. The system continuously monitors the dummy file's characteristics and adjusts them based on actual compression performance and available PBA capacity. This dynamic adjustment ensures that the host is presented with accurate available storage information without risking over-allocation.
Solution Approach 2:
The system implements continuous feedback monitoring of the dummy file's size and location relative to actual PBA usage. When compression efficiency changes or PBA capacity is consumed, the feedback mechanism detects these changes and adjusts the dummy file accordingly, maintaining reliable storage capacity management while maximizing host access to available capacity.
Data Source
AI summary
A system, method and program product for exploiting in-storage transparent compression. A storage infrastructure is disclosed that includes: a storage device having physical block address (PBA) storage of a defined capacity, a transparent compression system that compresses data written to the PBA storage, and a logical block address-to-physical block address mapping table; and a host having a memory management system that includes: an initialization system that allocates an amount of logical block address (LBA) storage for the host having a capacity greater than the defined capacity of the PBA storage, and that creates a dummy file that consumes LBA storage without consuming any PBA storage; a system that gathers current PBA and LBA usage information. The dummy file manager may adjust the size of the dummy file by truncating or appending sectors to the dummy file using a filesystem on the host, or using an allocation or deallocation function that does not incur any input/output (I/O) operations within the storage device. Dummy storage file sectors of the LBA storage may be mapped to dummy PBA storage that does not consume any physical storage in response to detecting a predefined content pattern indicative of dummy file sectors. The memory management system may device the LBA storage into partitions, with each partition receiving a dummy file.