Lossless Tabular Numeric Compression with Base-14 Row Rewriting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data compression systems, such as DEFLATE, ZIP, and RAR, are inadequate for efficiently compressing tabular numeric data, resulting in insufficient compression ratios and increased costs for storage and transmission.
Innovation Solution
A system and method for lossless compression of tabular numeric data that converts tables of integers into base-14 strings, rewrites rows based on differences between values, and concatenates these strings into a byte array for efficient storage, utilizing data compression and decompression servers connected via a communication network.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If existing compression systems (DEFLATE, ZIP, RAR) are used on tabular numeric data, then data can be compressed, but the compression ratio is insufficient
Solution Approach 1:
The patent applies parameter changes by converting numeric data from standard base-10 representation to base-14 representation. This changes the numerical parameter system, allowing more efficient encoding where each base-14 digit can represent values 0-13 using only 4 bits instead of the typical 8 bits per byte, thereby achieving superior compression ratios for tabular numeric data
Solution Approach 2:
The patent segments the tabular numeric data into individual numeric values that can be independently converted to base-14 representation. Each numeric value is processed separately, converted to its base-14 equivalent, and then stored in a compact format, allowing efficient compression while maintaining the ability to reconstruct the original data structure
2Stability of the object's composition
If data is stored in tabular format, then data organization is maintained, but compression efficiency is reduced
Solution Approach 1:
The patent performs preliminary actions by converting all numeric values to base-14 representation before storage. This pre-processing step transforms the data into a more compressible format while preserving the tabular structure, enabling both efficient compression and easy decompression to the original format when needed
3Quantity of substance
If compression is applied to reduce storage costs, then storage efficiency improves, but data integrity may be compromised
Solution Approach 1:
The patent uses a lossless copying mechanism where the original numeric data is transformed into base-14 representation that can be perfectly reversed. The compression process creates an exact mathematical equivalent in a more compact form, ensuring that decompression reproduces the original data bit-for-bit, thereby maintaining complete data integrity while reducing storage requirements
Data Source
AI summary
Systems and methods for lossless compression of tabular numeric data are provided. The system can include one or more data compression servers executing data compression system code to compress the tabular numeric data, a storage database to store the compressed tabular numeric data, and one or more data decompression servers to decompress the tabular numeric data for use. The one or more data compression servers, the storage database, and the one or more data decompression servers can communicate via a communication network. The system can receive the uncompressed tabular numeric data from one or more data generation systems, processes the uncompressed tabular numeric data with the data compression system code, and generate a compressed table of numeric information, which can be stored in the database, or later decompressed by the one or more data decompression servers.