Compressed Data Segmentation Under Application Length Limits
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data compression methods fail to account for length limits set by applications, leading to transmission errors when compressed data exceeds these limits, as seen in email and database applications.
Innovation Solution
A data compression method that segments compressed data based on length limits during compression, predicting compressed lengths to ensure each segment is within the limit, and employs rollback and merging to optimize efficiency and reduce redundant compression.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If one compression algorithm is used to compress all to-be-compressed data, then compression is simplified, but the compressed data length cannot be controlled and may exceed application length limits
Solution Approach 1:
The patent divides the compression process into multiple passes. The first pass compresses data without length constraints, and the second pass segments the compressed data into chunks that meet application length limits. This segmentation approach resolves the contradiction by maintaining simple compression logic while achieving precise length control through structured division of the compression workflow.
Solution Approach 2:
The patent performs a preliminary compression pass to generate compressed data, then uses this result to plan the segmentation strategy for the second pass. By performing the compression action first and then organizing the output, the system achieves both efficient compression and length control without requiring complex real-time constraints during the compression process.
2Adaptability or versatility
If compressed data is segmented to meet length limits, then application compatibility is improved, but compression efficiency decreases due to multiple compression operations
Solution Approach 1:
The patent segments the compressed data into multiple chunks in a second pass, where each chunk is independently compressed to meet length limits. While this requires multiple compression operations, the segmentation allows parallel processing of different chunks and ensures application compatibility without requiring excessive re-compression of the entire data set.
Solution Approach 2:
The patent applies compression partially in two separate passes rather than attempting to compress the entire data set in one operation. The first pass handles the bulk compression, and the second pass handles only the segmentation and final adjustment, avoiding the excessive action of repeatedly compressing the entire data set while still achieving length compliance.
3Device complexity
If the length of compressed data is unknown before compression, then the compression process is simpler, but applications with length limits cannot process the data
Solution Approach 1:
The patent performs a preliminary compression pass to determine the actual compressed data length before organizing it into application-compatible chunks. This preliminary action provides the length information needed for planning the segmentation strategy, enabling applications to prepare appropriate processing buffers without requiring complex real-time length prediction during compression.
Solution Approach 2:
The patent uses feedback from the first compression pass to inform the second pass segmentation strategy. The actual compressed data length obtained in the first pass feeds into the planning of how to divide and re-compress the data into chunks that meet application length limits, creating a closed-loop process that adapts to the actual compression results.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
This application provides a data compression method, including: To-be-compressed data and a length limit value for data compression is obtained. When a length of data obtained by compressing the to-be-compressed data is greater than the length limit value, the to-be-compressed data is segmented based on the length limit value in a process of compressing the to-be-compressed data, so that the to-be-compressed data includes at least two compressed files after compression, and a length of each compressed file is less than the length limit value. In this way, application requirements are met.