Write-Time Data Grouping for Compression and Partial Read Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In information processing systems, overall compression of multiple blocks improves the compression ratio but increases the likelihood of partial read-outs, leading to decreased read access performance due to the need for decompressing entire blocks during partial read requests.
Innovation Solution
An information processing device that records write access times and groups data with similar write access times for overall compression, reducing the likelihood of partial read-outs by compressing data blocks written at close times together, thereby improving compression ratios without compromising access performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If overall compression of multiple blocks is performed, then compression ratio is improved, but read access performance deteriorates due to partial read-out requirements
Solution Approach 1:
The patent segments the overall compressed data into multiple independent compression units, each corresponding to a specific time window of write accesses. This allows the storage system to compress data across multiple blocks (improving compression ratio) while maintaining the ability to independently access and decompress only the relevant time-window segment during partial read operations (maintaining read access performance).
Solution Approach 2:
The patent performs preliminary grouping of data by time window during the write phase, organizing data into distinct compression units before compression occurs. This preliminary organization enables efficient partial read-out later, as the system can directly identify and decompress only the specific time-window segment corresponding to the requested data, without needing to decompress the entire compressed data set.
2Loss of substance
If the number of blocks compressed by overall compression is increased, then compression ratio increases, but the frequency of partial read-out occurrences increases
Solution Approach 1:
The patent divides the compressed data into multiple time-window-based segments, where each segment contains compressed data from a specific time period. This segmentation allows the system to increase the total number of blocks compressed (improving compression ratio) while maintaining low frequency of partial read-outs, as each segment is independently accessible and corresponds to a logical time unit that matches typical access patterns.
Solution Approach 2:
The patent dynamically adjusts the grouping of data into compression units based on write access patterns and time windows. This dynamic approach allows the system to optimize the balance between compression ratio and partial read-out frequency, adapting to changing workloads while maintaining both high compression efficiency and access performance.
Data Source
AI summary
An information processing device includes: a memory configured to store data concerning a write access; and a processor coupled to the memory, the processor being configured to: record, for each data, time of a write access of the data to management information, when writing out data from the memory to a storage, determine a plurality of data as a group of overall compression based on the management information, the plurality of data having a difference of time of write accesses being equal to or less than a threshold value, and compress the plurality of data corresponding to the determined group by an overall compression, and write compressed data obtained through the overall compression to the storage.