Sampled Data Compression Decisions Based on Redundancy Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Real-time data compression methods often prioritize speed over effectiveness, resulting in compressed data sizes that are larger than the original, due to insufficient determination of data redundancy.
Innovation Solution
A data compression method based on sampling and estimation, where data regions are extracted and analyzed for redundancy ratios, with compression only performed when the ratio exceeds a threshold and specific conditions are met, allowing for optimized compression speed and rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If a compression algorithm with poor compression capability but high compression speed is used, then compression speed is improved, but compression rate deteriorates
Solution Approach 1:
The patent applies partial action by performing sampling on only a portion of the data (N data regions extracted from M data regions) rather than analyzing the entire dataset. This allows the system to quickly estimate data redundancy characteristics and make compression decisions without the overhead of complete data analysis, thereby maintaining high compression speed while improving compression rate through informed algorithm selection
Solution Approach 2:
The patent implements preliminary action by conducting data sampling and redundancy estimation before committing to a compression operation. The system pre-evaluates whether the data contains sufficient redundancy by analyzing extracted regions, and only proceeds with compression when the estimated redundancy ratio exceeds the threshold. This preliminary assessment prevents wasteful compression operations on non-redundant data, improving overall compression effectiveness
2Speed
If compression is performed without determining data redundancy, then compression speed is improved, but compression effectiveness deteriorates
Solution Approach 1:
The patent extracts N representative data regions from the M data regions of the input data. By taking out and analyzing only these extracted samples, the system can quickly determine data redundancy characteristics without processing the entire dataset. This extraction approach enables reliable compression effectiveness assessment while maintaining high processing speed
Solution Approach 2:
The patent replaces the mechanical approach of compressing all data without evaluation with an estimation-based system. Instead of blindly applying compression algorithms, the system uses sampling and redundancy ratio estimation to intelligently determine whether compression is worthwhile. This substitution of mechanical compression with estimation-based decision-making improves compression effectiveness while preserving speed
Data Source
AI summary
A data compression method based on sampling and estimation is provided. The method includes: receiving a piece of data; extracting N data regions from M data regions of the piece of data; examining a data redundancy ratio in the N data regions; and determining, according to a value of the data redundancy ratio, whether to compress the piece of data.


