Pattern-Matched String Storage for Redundancy Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage systems face inefficiencies in managing large volumes of string data, particularly due to repeated storage of similar sub-string parts and lack of support for random access, leading to increased storage space requirements and access delays.
Innovation Solution
A data storage method and apparatus that utilizes pattern matching to identify common string data patterns, storing these patterns separately and extracting dedicated string data for efficient storage, forming an index relationship between the two, thereby optimizing storage space and access efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If string data is stored as complete original data, then data integrity is maintained, but storage space is wasted due to repeated sub-string parts
Solution Approach 1:
The patent segments string data into common sub-string parts and dedicated string data. The common sub-string parts that appear repeatedly across multiple string data are extracted and stored separately, while only the unique dedicated portions are stored individually. This segmentation reduces redundant storage while maintaining complete data integrity through index relationships that reconstruct the original string data.
Solution Approach 2:
The patent creates index relationships that act as references or copies pointing to the stored common sub-string parts. Instead of storing duplicate copies of common substrings throughout the data set, the system uses indexes to reference the single stored copy, significantly reducing storage space while preserving the ability to retrieve complete original data.
2Ease of operation
If data is stored in a centralized manner, then data management is simplified, but access speed decreases for large data volumes
Solution Approach 1:
The patent divides the centralized storage into multiple segments: a first storage area for common sub-string parts and a second storage area for dedicated string data. This segmentation allows the system to maintain centralized management benefits while improving access speed by enabling selective retrieval of only the necessary data portions rather than scanning through complete string data.
Solution Approach 2:
The patent extracts the commonly accessed sub-string parts and places them in a dedicated first storage area, separating them from the unique dedicated string data. This extraction optimizes access speed for frequent patterns while maintaining the simplicity of centralized management through a unified storage structure with organized regions.
3Loss of substance
If pattern matching is performed on all string data, then storage efficiency is improved, but processing time increases
Solution Approach 1:
The patent performs pattern matching and identifies common sub-string parts in advance during the data storage phase. By conducting this analysis beforehand and organizing data into common and dedicated portions, the system eliminates the need for repeated pattern matching during subsequent storage operations, reducing processing time while achieving storage efficiency.
Data Source
AI summary
A data storage method for string data includes: performing pattern matching on each piece of string data in a to-be-stored string data set by using a pattern data set, to determine whether the string data includes matched pattern data in the pattern data set; in response to that the string data includes the matched pattern data, extracting dedicated string data other than the matched pattern data from the string data, and storing the extracted dedicated string data in a dedicated data storage area of the data storage system, wherein an index relationship is formed between the stored dedicated string data and corresponding pattern data stored in the pattern data storage area; and in response to that the string data does not include the matched pattern data, storing original data of the string data in the dedicated data storage area as a whole.