Database Deduplication Optimizer for Storage Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional deduplication methods in database management systems introduce inefficiencies and overhead by requiring unnecessary data transfers and hash value calculations when updating records, especially when dealing with redundant data across storage tiers, leading to performance degradation.
Innovation Solution
A database-deduplication optimizer that identifies redundant logical blocks within the same storage tier and associates them with a single physical block, eliminating the need for redundant storage and reducing overhead by leveraging existing database components to streamline the deduplication process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If conventional deduplication methods are used to eliminate redundant blocks, then storage efficiency is improved, but system performance degrades due to unnecessary data transfers and hash calculations
Solution Approach 1:
The system performs preliminary identification of redundant logical blocks before executing full deduplication operations. By using database components to pre-identify candidates, the system avoids unnecessary hash calculations and data transfers, resolving the contradiction between storage efficiency and system performance
Solution Approach 2:
The invention extracts and eliminates unnecessary deduplication operations by identifying when blocks are already optimized. The system takes out redundant processing steps from the conventional deduplication workflow, retaining only essential operations that truly improve storage efficiency without compromising performance
2Measurement precision
If hash value calculations are performed for all logical blocks, then deduplication accuracy is improved, but processing time increases
Solution Approach 1:
Instead of performing complete hash calculations on all logical blocks, the system applies partial action by using database components to pre-identify potential redundancies. This selective approach maintains sufficient accuracy for deduplication while significantly reducing processing time through avoided unnecessary computations
3Quantity of substance
If data transfers are performed during deduplication, then storage consolidation is improved, but I/O overhead increases
Solution Approach 1:
The database components perform self-service by identifying and managing redundant blocks internally without requiring external data transfers. The system uses its own processing capabilities to consolidate storage metadata, eliminating unnecessary I/O operations while maintaining effective storage consolidation
Data Source
AI summary
A method and associated systems for a deduplication module of a database-management system. The database-management system, upon receiving a request to perform a transaction that will revise a stored database record, uses memory-resident logs and previously generated database-maintenance tables to: i) identify a first logical block that identifies an updated value, stored in a physical block of storage, to be used to update the database record; and ii) further identify a second logical block that stores in the database a corresponding existing value of the same record. After determining that the first and second logical blocks reside on physical storage devices within the same storage tier, the system directs the deduplication module to associate both logical blocks with the first physical block.