Zoned Storage Grouping of Similar Data for Better Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional storage systems inefficiently compress data due to dissimilar types of data within data segments, reducing redundancy identification and compression efficiency.
Innovation Solution
Storing data with similar properties in the same data segment to enhance redundancy identification and compression efficiency, minimizing computing overhead by reading only a portion of the data to determine properties.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If data is stored in data segments without filtering by properties, then storage simplicity is maintained, but compression efficiency deteriorates due to dissimilar data types
Solution Approach 1:
The system performs preliminary classification of data blocks by determining their properties (language, type, etc.) before storing them in data segments. This advance sorting ensures that similar data types are grouped together, enabling efficient compression without requiring complex filtering during the storage process itself
Solution Approach 2:
Different data segments are assigned different data types based on their designated properties. Each segment specializes in storing specific types of data (e.g., English text segments, code segments, binary segments), creating local homogeneity that dramatically improves compression efficiency while maintaining overall storage organization
2Productivity
If a portion of data is read to determine properties, then computing overhead is reduced, but measurement precision may deteriorate
Solution Approach 1:
Instead of analyzing the entire data block to determine its properties, the system reads only a representative portion (such as headers, metadata, or sample segments) to identify the data type and language. This partial analysis significantly reduces computing overhead while maintaining sufficient accuracy for effective data classification and compression
Data Source
AI summary
A method of storing data is provided. The method includes receiving a plurality of data blocks provided to a hyperscaler system. The method also includes determining a corresponding property for each data block of the plurality of data blocks. The method further includes identifying a set of data blocks from the plurality of data blocks. Each data block of the set of data blocks is associated with a first property. The method further includes storing the set of data blocks in a first zone of a zoned storage system, based on the first property.


