Parallel Data Segmentation for Run-Length Encoding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current run-length coding methods are inefficient in compressing data, particularly when data segments have varying repetition frequencies, leading to potential data expansion and slower processing speeds due to sequential processing.
Innovation Solution
A data processing method that segments original data into multiple segments to enable parallel processing, and determines suitability for run-length encoding on each segment, applying it only when beneficial to optimize compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If run-length encoding is applied to data segments with low repetition frequency, then the encoding process is simplified, but the data volume increases due to addition of count elements
Solution Approach 1:
The patent applies different encoding strategies to different data segments based on their local characteristics. Run-length encoding is selectively applied only to segments where it achieves compression (when repetition frequency exceeds a threshold), while other segments are handled differently. This local differentiation resolves the contradiction by ensuring encoding simplicity is only pursued where it doesn't harm data volume.
2Adaptability or versatility
If run-length encoding is applied to all data segments, then uniform processing is achieved, but data expansion occurs in segments with low repetition frequency
Solution Approach 1:
The patent introduces dynamic adaptability by evaluating each data segment's repetition characteristics and selectively applying run-length encoding only when beneficial. The system transitions from a static uniform approach to a dynamic selective approach, where the encoding method adapts to the actual data characteristics of each segment, preventing data expansion while maintaining processing consistency.
3Device complexity
If sequential processing is used for run-length encoding, then the implementation is simple, but the processing speed is slow
Solution Approach 1:
The patent divides the original data into multiple segments that can be processed independently and concurrently. By segmenting the data processing task, the system enables parallel execution of run-length encoding operations across different segments, significantly improving processing speed while maintaining implementation simplicity through modular design.
Solution Approach 2:
The patent transitions from one-dimensional sequential processing to multi-dimensional parallel processing by utilizing multiple processing threads or cores simultaneously working on different data segments. This dimensional change in processing architecture resolves the contradiction by maintaining implementation simplicity while achieving substantial speedup through concurrent execution.
4Device complexity
If run-length encoding is applied to mixed-frequency data, then single-method processing is maintained, but compression efficiency deteriorates due to data expansion in low-repetition segments
Solution Approach 1:
The patent segments the data processing into evaluation and execution phases, where each data segment is first evaluated for its repetition characteristics, then processed accordingly. This segmentation allows the system to maintain overall processing uniformity while applying differentiated encoding strategies to different segments, thereby improving compression efficiency without significantly increasing system complexity.
Solution Approach 2:
The patent applies local quality assessment to each data segment by evaluating its repetition frequency characteristics independently. Based on this local assessment, run-length encoding is selectively applied only where appropriate, preventing data expansion in low-repetition segments while maintaining compression efficiency in high-repetition segments, thus resolving the contradiction between method uniformity and compression efficiency.
Data Source
AI summary
The present invention proposes a data processing method, a data processing apparatus, an electronic device, and a computer-readable storage medium. The method includes: in response to a data processing instruction, segmenting an original data to obtain multiple data segments of the original data to enable parallel processing of the multiple data segments, wherein the multiple data segments includes a first data segment; determining whether the first data segment is suitable for using a preset run-length encoding; and when the first data segment is suitable for using the run-length encoding, using the run-length encoding to perform a run-length encoding processing on the first data segment. According to some embodiments, the original data is initially segmented into multiple data segments, and each data segment can be processed independently and concurrently, thereby enhancing the speed of data compression processing.