Data Compression Segmentation for Length-Limited File Output
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data compression methods fail to handle data that exceeds length limits in applications like email and database systems, leading to transmission errors due to the inability to process data beyond predetermined size constraints.
Innovation Solution
A data compression method that segments compressed data into multiple files, each within the length limit, by predicting and managing data block lengths, and performing merging and compression to ensure compliance with length restrictions, thereby allowing data to be processed by applications with size constraints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If a compression algorithm is used to compress all to-be-compressed data, then the data size is reduced, but the length of compressed data becomes unknown before compression and may exceed application length limits
Solution Approach 1:
The patent divides the compression process into multiple passes. In the first pass, it compresses data until the compressed size approaches the length limit. In the second pass, it continues compressing the remaining data. This segmentation ensures that each compressed segment meets the length limit requirement while achieving overall compression of the original data.
Solution Approach 2:
The patent performs a preliminary compression pass to determine the compressed data length before finalizing the compression. By predicting and measuring the compressed size in advance, it can adjust the compression strategy to ensure the final output meets the length limit constraint.
2Ease of operation
If the compressed data length is predicted before compression, then the length limit can be ensured, but the compression efficiency is reduced due to multiple compression operations
Solution Approach 1:
The patent uses the compression algorithm itself to serve dual purposes: it both compresses the data and provides length prediction information. By analyzing the compression progress and intermediate results during the compression process, the system can predict the final compressed length without requiring separate prediction operations, thus maintaining compression efficiency while ensuring length limit compliance.
Data Source
AI summary
Embodiments of this disclosure provide for a data compression method and a related data compression apparatus. In the method, to-be-compressed data and a length limit value for data compression are obtained. When the length of the data obtained by compressing the to-be-compressed data is greater than the length limit value, the to-be-compressed data is segmented based on the length limit value during compression. After the to-be-compressed data is segmented, the to-be-compressed data includes at least two compressed files after compression and a length of each compressed file is less than the length limit value.