Data Compression Virtual Storage Units
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern data storage systems face challenges in increasing capacity, reliability, and performance due to the need to store and retrieve variable-sized data units resulting from compression, which requires significant changes to data storage and retrieval mechanisms.
Innovation Solution
The implementation of mechanisms that compress fixed-sized host data into variable-sized virtual storage units, including error correction and metadata, allowing for efficient storage and retrieval by creating fixed-size containers that can be managed within existing data storage systems, and using hardware or firmware modules for compression and formatting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is compressed to increase storage capacity, then storage efficiency improves, but data retrieval complexity increases due to variable-sized units
Solution Approach 1:
The patent segments compressed data into fixed-size virtual storage units (VSUs) that contain variable-sized compressed data units. Each VSU is divided into multiple data units with standardized formatting, allowing the storage system to maintain fixed-size boundaries while accommodating variable compression outcomes. This segmentation resolves the contradiction by enabling compression benefits while preserving retrieval simplicity through standardized unit boundaries.
Solution Approach 2:
The patent introduces virtual storage units as an intermediary layer between the compression process and the physical storage medium. These VSUs act as containers that absorb the variability of compression output, providing a standardized interface for both storage and retrieval operations. The intermediary VSU structure allows compressed data to be stored efficiently while maintaining simple fixed-size access patterns.
2Quantity of substance
If variable-sized data units are stored directly to maximize space utilization, then storage efficiency improves, but system compatibility deteriorates
Solution Approach 1:
The patent applies local quality by creating fixed-size virtual storage units that contain variable-sized compressed data units within standardized boundaries. The local structure of each VSU maintains consistency (fixed size, standardized formatting) while the content within can vary in size based on compression results. This allows the system to maintain compatibility through standardized interfaces while achieving high space utilization through variable compression.
Solution Approach 2:
The patent changes the parameter of data unit size from variable (in compression output) to fixed (in virtual storage units). By transforming the size parameter through the VSU abstraction layer, the system achieves both high space utilization from compression and system compatibility through standardized fixed-size interfaces that existing systems can handle without modification.
3Quantity of substance
If compression is implemented to reduce storage requirements, then capacity increases, but processing time increases due to compression and decompression operations
Solution Approach 1:
The patent performs compression as a preliminary action during the data writing process, before data is stored in the virtual storage units. By completing compression upfront during ingestion rather than during retrieval operations, the system minimizes the time impact on read operations. The preliminary compression allows fast retrieval of already-compressed data while accepting the time cost during the write phase.
Data Source
AI summary
Embodiments of compression and formatting of data for data storage systems are disclosed. In some embodiments, a data storage system can compress fixed sized data before storing it on a media and format obtained variable sized compressed data for storing on the media that typically has fixed size storage granularity. One or more modules compress the incoming host data and create an output stream of fixed sized storage units that contain compressed data. The storage units are stored on the media. Capacity, reliability, and performance are thereby increased.