File System Compression Groups for Client-Transparent Storage Savings
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage systems face high costs due to the expense of magnetic disk drives and require client-side modifications for data compression, limiting compatibility with various client applications.
Innovation Solution
A system and method for transparently compressing file system data using compression groups, where data is compressed beyond a predefined threshold to reduce the number of physical blocks required, with a compression group descriptor indicating compressed data and magic values used as headers and footers to manage block pointers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data compression is implemented at the client side, then disk space utilization is improved, but client application compatibility deteriorates due to requiring client-side modifications
Solution Approach 1:
The patent introduces a file system-level compression intermediary layer between the client applications and the storage system. This intermediary handles compression and decomposition transparently without requiring modifications to client applications, thereby maintaining compatibility while achieving disk space savings through compression.
Solution Approach 2:
The storage system performs compression and decomposition operations autonomously at the file system level without external client intervention. The system automatically identifies compressible data, performs compression when beneficial, and handles decomposition transparently, enabling self-service compression that maintains client compatibility.
2Reliability
If magnetic disk drives are used for storage, then data persistence is improved, but system cost increases due to the expense of magnetic disk drives
Solution Approach 1:
The patent changes the parameter of data representation by applying compression algorithms to reduce the volume of data stored on expensive magnetic disk drives. By transforming data into a more compact form, the system reduces the quantity of expensive storage media required while maintaining data persistence through proper compression and decomposition mechanisms.
3Quantity of substance
If compression is applied to reduce disk space, then storage cost is improved, but system complexity increases due to compression management overhead
Solution Approach 1:
The patent segments the storage system into distinct compression groups of fixed-size blocks (e.g., 8 blocks per group). This segmentation allows the system to manage compression at a granular level, applying compression to specific groups independently. The segmentation simplifies management overhead by creating uniform, manageable units rather than requiring complex whole-file or variable-size compression management.
Solution Approach 2:
The patent changes the management approach by using fixed-size compression groups with predetermined block counts rather than variable-size compression units. This parameter change simplifies the complexity of compression management by establishing uniform group sizes, making it easier to track, allocate, and manage compressed data without requiring complex variable-size management structures.
Data Source
AI summary
A system and method for transparently compressing file system data using compression group descriptors is provided. When data contained within a compression group be compressed beyond a predefined threshold value, a compression group descriptor is included in the compression group that signifies that the data for the group of level 0 blocks is compressed into a lesser number of physical data blocks. When performing a read operation, the file system first determines the appropriate compression group that contains the desired data and determines whether the compression group has been compressed. If so, the file system decompresses the data in the compression group before returning the decompressed data. If the magic value is not the first pointer position, then the data within the compression group was previously stored in an uncompressed format, and the data may be returned without performing a decompression operation.