Compressed File System Block Mapping for Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In tiered file storage systems, accessing a portion of an archived file for read or write requests requires decompressing and recompressing entire files, which is resource-intensive and increases response time due to the need to retrieve and process all compressed blocks.
Innovation Solution
A network traffic management apparatus generates and stores a mapping of compressed blocks to object data, allowing only the necessary blocks to be retrieved and decompressed for read requests and modified for write requests, reducing the need for unnecessary decompression and recompression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If entire files are decompressed to locate requested portions, then data can be accessed, but time and resources are significantly increased
Solution Approach 1:
The patent divides the file into compressed blocks and maintains a mapping between block identifiers and their corresponding data locations. When a data access request is received, the system retrieves only the specific compressed blocks containing the requested data portions rather than decompressing the entire file, thereby reducing time and resource consumption while maintaining accurate data access.
2Reliability
If entire files are recompressed after write requests, then data integrity is maintained, but resources are wasted when only portions are modified
Solution Approach 1:
The patent segments the file into compressed blocks and tracks modifications at the block level. When a write request modifies only certain portions of the file, the system recompresses only the affected blocks rather than the entire file, maintaining data integrity for modified sections while avoiding unnecessary processing resources for unchanged sections.
3Loss of information
If all compressed blocks are retrieved for read requests, then complete data is available, but resource utilization is reduced
Solution Approach 1:
The patent extracts only the necessary compressed blocks containing the requested data portions from the storage system. By using the mapping between block identifiers and data locations, the system retrieves minimal required data rather than all compressed blocks, thereby reducing resource utilization for data retrieval while ensuring complete data availability for the requested portions.
Data Source
AI summary
A method, computer readable medium, and network traffic management apparatus that accesses data in a compressed file system includes obtaining an original write request from a client computing device including at least object data. The object data is compressed into a plurality of compressed blocks. A mapping of each compressed block to a portion of the object data compressed therein is generated, wherein the portion of the object data compressed therein is represented in the mapping by a unique object identifier, a start offset, and a length. The compressed blocks and the mapping are stored in at least one data storage device. At least one data access request for at least a portion of the object data is serviced based on the mapping.