Dynamic Dictionary Selection for Data Compression Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing storage devices face inefficiencies in data compression and storage, leading to reduced lifespan due to frequent data writing and reading, and existing methods do not effectively utilize data type and size to optimize dictionary selection for compression.
Innovation Solution
A data processing device with a dictionary storage unit and compression unit that determines a selected dictionary based on data type and size, using a common dictionary for initial compression and switching to a specific dictionary for further compression, while also updating dictionaries with additional patterns to enhance efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If data is compressed using a single fixed dictionary, then the device complexity is reduced, but the compression efficiency deteriorates because it cannot adapt to different data types and sizes
Solution Approach 1:
The patent implements dynamic dictionary selection by maintaining multiple dictionaries in a dictionary storage unit and selecting the appropriate dictionary based on data type and size characteristics. The compression unit dynamically switches between dictionaries (e.g., first dictionary for small text data, second dictionary for large binary data) to optimize compression efficiency for different data scenarios, resolving the contradiction between device complexity and compression efficiency.
2Productivity
If multiple dictionaries are maintained for different data types, then the compression efficiency is improved, but the device complexity increases due to dictionary selection and management overhead
Solution Approach 1:
The patent changes the parameter of dictionary selection based on data characteristics (data type and size). The compression unit determines which dictionary to use by analyzing parameters of the input data, such as data type (text, binary, image) and size thresholds, and selects the appropriate dictionary accordingly. This parameter-based selection strategy improves compression efficiency while keeping the selection logic manageable.
3Device complexity
If data is not compressed, then the device complexity is reduced, but the storage space increases and the lifespan of the storage device decreases due to frequent read/write operations
Solution Approach 1:
The patent applies preliminary compression action to data before storing it in the storage device. By compressing data in advance using appropriate dictionaries selected based on data type and size, the system reduces the volume of data to be stored, thereby reducing the frequency of read/write operations and extending the lifespan of the storage device while maintaining manageable complexity through automated compression processes.
4Ease of operation
If a single dictionary is used for all data, then the ease of operation is improved, but the loss of information increases because the compression cannot capture data-specific patterns
Solution Approach 1:
The patent segments the compression process by dividing data into different categories (text data, binary data, images, videos) and assigning specific dictionaries to each category. This segmentation allows each dictionary to be optimized for its specific data type, capturing data-specific patterns more effectively and reducing information loss, while the automated segmentation logic maintains ease of operation.
Data Source
AI summary
A data processing device for a storage device can include a dictionary storage unit that is configured to store a plurality of dictionaries and a compression unit that is configured to determine a selected dictionary from the plurality of dictionaries based on received data, and compress the received data using the selected dictionary to provide compressed data. Each of the plurality of dictionaries can include a plurality of pattern-symbol correspondence relations defining a one-to-one correspondence between respective ones of a plurality of patterns and respective ones of a plurality of symbols.