Block Storage Device with Parallel Deduplication Pathways
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing block storage devices lack compatibility between optimization schemes for data storage and retrieval processes, particularly for deduplication and block relocation, leading to inefficient handling of both normal and deduplicated files along a single processing path.
Innovation Solution
Implementing a method that uses parallel processing paths with a deduplication data structure and a block indirection data structure, allowing on-the-fly discrimination between normal and deduplicated files, and incorporating a reference counter for efficient block relocation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single processing path is used for both normal and deduplicated files, then device complexity is reduced, but storage efficiency and performance deteriorate due to inability to apply optimized schemes
Solution Approach 1:
The patent divides the processing path into two separate parallel pathways: a first processing path for normal files using block indirection data structures, and a second processing path for deduplicated files using deduplication data structures. This segmentation allows each path to be optimized independently, resolving the contradiction between simplicity and efficiency.
Solution Approach 2:
The system provides a universal file processing capability that handles both normal and deduplicated files through a unified interface, while internally routing them through specialized processing paths. This multi-functionality approach maintains ease of use while achieving optimization for different file types.
2Quantity of substance
If deduplication processing is applied to all files, then storage efficiency improves, but processing time and computational resources increase
Solution Approach 1:
The system dynamically selects the appropriate processing path based on file characteristics and deduplication requirements. Not all files are subjected to deduplication processing; only those that benefit from it are routed through the second processing path, while normal files use the first path, optimizing both storage efficiency and processing speed.
Solution Approach 2:
Different processing approaches are applied to different files based on their local characteristics. The system identifies which files require deduplication and applies the appropriate data structure and processing method locally, rather than uniformly to all files, thus reducing unnecessary computational overhead.
3Productivity
If block relocation is implemented for deduplicated files, then storage optimization improves, but hardware complexity and processing overhead increase
Solution Approach 1:
The patent replaces complex mechanical block relocation hardware with software-based management using deduplication data structures stored in memory or on separate storage devices. The block indirection and deduplication pathways use data structure manipulation rather than physical block movement, reducing hardware complexity while maintaining storage optimization capabilities.
Data Source
AI summary
A method for using a block storage device for storing and reproducing electronic files is disclosed. The block storage device includes blocks, each one possessing a logical block address (LBA) unique to that block. The method includes providing a deduplication pathway, including a deduplication data structure (DDS), and a block indirection pathway, including a block indirection data structure (BIDS). When receiving an electronic file, if deduplication is desired for the electronic file, then processing the electronic file only through the deduplication pathway, and, otherwise, processing the electronic file only through the block indirection pathway.