Tabular Cell Compression Using Base Values and Delta Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage systems for tabular databases are inefficient in compressing cells, leading to suboptimal use of storage space.
Innovation Solution
The proposed solution involves selecting a set of base values for each group of cells in a tabular database, representing cell values as delta values relative to these base values, which reduces storage space requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If existing data storage systems store cell values directly, then the storage process is simple, but storage space efficiency is poor
Solution Approach 1:
The patent transforms cell values by representing them as delta values relative to base values rather than storing original values directly. This parameter transformation enables more efficient storage by exploiting the statistical property that delta values typically have smaller magnitudes and narrower ranges than original values, allowing for compact encoding schemes.
Solution Approach 2:
The patent introduces base values as intermediary elements that serve as reference points for encoding cell values. Instead of storing raw cell values, the system uses base values as mediators to represent cell data through deltas, enabling more space-efficient storage while maintaining data reconstructibility.
2Quantity of substance
If cell values are compressed using delta encoding, then storage space is reduced, but query processing complexity increases
Solution Approach 1:
The patent performs preliminary organization of data into groups with shared base values during the storage phase. By pre-computing and storing base values for groups of cells, the system prepares the data structure in advance to enable efficient query processing. This preliminary action reduces the computational burden during query operations by avoiding redundant base value computations.
Solution Approach 2:
The patent divides the tabular database into groups of cells, where each group shares a common set of base values. This segmentation allows query processing to be optimized by operating on groups rather than individual cells, reducing overall processing complexity while maintaining storage efficiency benefits.
Data Source
AI summary
A method for compression of cells of a tabular database (TD), the method may include (i) receiving data elements, by a storage system; (ii) calculating a compressed representation (CR) of the data elements by applying a compression process that includes (ii.a) defining sets based on data element values, (ii.b) associating a set value per set; and (ii.c) generating the CR of the data elements based on differences between the data elements and corresponding set values; (iii) generating compression metadata related to the CR of the data elements, wherein the compression metadata comprises the set values and a mapping between the CR of the data elements and the set values; and (iv) storing, in the TD, the CR of the data elements.