Compressed Data Search Using an Evaluated Compression Dictionary
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing storage control systems that compress data for reduced storage capacity do not provide high search performance, as they lack efficient methods for evaluating search conditions within compressed data.
Innovation Solution
A storage control apparatus generates an evaluated compression dictionary from a compression dictionary, performing condition evaluation during data generation and not during search, allowing for high search performance by matching compression codes with search conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is compressed and stored using conventional methods, then storage capacity is reduced, but search performance deteriorates
Solution Approach 1:
The invention performs condition evaluation in advance during the generation of the evaluated compression dictionary, before actual search operations. By pre-evaluating which compression codes satisfy search conditions and storing these evaluations in the dictionary structure, the system eliminates the need for runtime condition evaluation during searches, thus maintaining high search performance while using compressed data
Solution Approach 2:
The invention introduces an evaluated compression dictionary as an intermediary data structure between the compressed data and search operations. This dictionary contains pre-evaluated compression codes that match search conditions, acting as a mediator that enables efficient search without requiring decompression or runtime evaluation of compressed data
2Measurement precision
If condition evaluation is performed during search operations on compressed data, then search accuracy is maintained, but search speed deteriorates
Solution Approach 1:
Condition evaluation is performed in advance during dictionary generation rather than during search operations. The evaluated compression dictionary stores pre-computed results indicating which compression codes satisfy given search conditions, allowing searches to simply lookup pre-evaluated results without performing condition evaluation at runtime
3Productivity
If an evaluated compression dictionary is generated with pre-evaluated compression codes, then search efficiency is improved, but dictionary generation complexity increases
Solution Approach 1:
The complexity of condition evaluation is shifted to the dictionary generation phase, which is performed once offline. The generation process iterates through compression codes and evaluates conditions, storing results in the evaluated dictionary. This one-time preprocessing complexity is acceptable because it enables highly efficient online search operations without runtime evaluation overhead
Data Source
AI summary
A storage control apparatus generates an evaluated compression dictionary from a compression dictionary. The compression dictionary includes, for each of different values included in original data of compressed data, a value and a compression code. The evaluated compression dictionary includes, for each value in the compression dictionary, a value and a compression code. The compressed data includes a compression code for each value in the original data. The storage control apparatus performs, in generation or update of the evaluated compression dictionary, condition evaluation of the value. A compression code of a value determined to correspond to the search condition in the condition evaluation is a condition satisfied code. The storage control apparatus is configured to, in the search, for a compression code in the search range of the compressed data: output, when there is an evaluation dictionary record including a condition satisfied code matching the compression code, a value in the evaluation dictionary record; and output, when there is no evaluation dictionary record including a condition satisfied code matching the compression code, a value that means inconsistency.