Storage Pattern Matching Space Savings Reporting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face challenges in accurately reporting space savings due to pattern matching, as existing methods often report a lower bound of space savings that may not reflect the actual reduction, due to difficulties in separating pattern matching savings from snap savings.
Innovation Solution
The method involves setting pattern flags and incrementing counters for matching patterns, generating snapshots, and determining a range of data reduction attributed to pattern matching using these counters, allowing for the reporting of both lower and upper bounds or an average value of space savings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If pattern matching is used to improve storage efficiency, then storage space is reduced, but accurate reporting of space savings becomes difficult
Solution Approach 1:
The patent segments the space savings measurement into distinct components by maintaining separate counters: one for pattern matching savings and another for snapshot-related savings. This segmentation allows accurate attribution of space savings to pattern matching specifically, resolving the measurement accuracy problem while preserving storage efficiency benefits
Solution Approach 2:
The patent introduces an intermediary mechanism (separate counters and tracking structures) that mediates between pattern matching operations and space savings reporting. This intermediary layer enables precise measurement and reporting of pattern matching contributions to space savings without interfering with the actual compression process
2Quantity of substance
If pattern matching processing is performed on all data, then data reduction is maximized, but processing complexity increases
Solution Approach 1:
The patent applies preliminary action by performing pattern matching during the initial data write operation rather than as a separate processing step. This allows data reduction to occur inline as data is first stored, maximizing data reduction while minimizing additional processing complexity
Data Source
AI summary
Techniques are provided for reporting space savings due to pattern matching in storage systems. For example, in one embodiment, an exemplary method comprises, when a given allocation unit in a storage system matches one or more predefined patterns, (i) setting a corresponding pattern flag for the given allocation unit, and (ii) incrementing at least one pattern counter; generating at least one snapshot of at least a portion of a file comprising the given allocation unit; and determining a range of data reduction attributed to pattern matching based on said at least one pattern counter, wherein one extreme of said range of data reduction attributed to pattern matching excludes said one or more predefined patterns in said at least one snapshot.