Hybrid Storage System Segmentation for Speed and Capacity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Segment deduplication storage systems are inefficient in terms of speed for storing and retrieving data due to the need to search for and reconstruct previously stored segments, which slows down the process.
Innovation Solution
A hybrid storage system that includes a performance storage unit for rapid data access and a segment storage system for efficient deduplication, where data is automatically transferred between the two based on usage and storage capacity optimization, using techniques like deduplication, compression, and snapshotting to improve performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If segment deduplication is used to optimize storage capacity, then storage efficiency is improved, but storage and retrieval speed deteriorates due to searching and reconstructing segments
Solution Approach 1:
The patent divides the storage system into two distinct segments: a performance storage unit for high-speed operations and a segment storage system for capacity optimization. This segmentation allows each part to specialize - the performance unit handles rapid data access while the segment system provides deduplication efficiency, resolving the speed-capacity tradeoff by spatial separation of functions
Solution Approach 2:
The patent introduces an intermediary mechanism (performance segment storage unit) that bridges the performance storage unit and the segment storage system. This intermediary receives data from the performance unit, performs deduplication operations, and stores segments in the segment system, thereby enabling capacity optimization without burdening the high-speed performance path with complex deduplication processing
2Speed
If all data is stored in performance storage for high-speed access, then retrieval speed is improved, but storage capacity efficiency deteriorates due to lack of deduplication
Solution Approach 1:
The patent applies local quality by making different parts of the storage system have different characteristics - the performance storage unit is optimized for speed with high-performance storage media, while the segment storage system is optimized for capacity efficiency with deduplication and compression. Each location in the storage hierarchy has qualities matched to its specific function
Solution Approach 2:
The patent implements dynamic data movement between storage units based on usage patterns and performance requirements. Data can be automatically transferred from the segment storage system back to the performance storage unit when access patterns indicate high-speed needs, creating a dynamic system that adapts to changing requirements rather than being static
3Productivity
If data is automatically transferred between storage units, then performance is improved, but system complexity increases
Solution Approach 1:
The patent implements self-service through automatic data transfer mechanisms that monitor performance storage capacity and usage patterns, then autonomously move data between units without manual intervention. The system self-regulates by transferring data when performance storage reaches capacity thresholds or when segment storage has available space, reducing operational complexity despite architectural additions
Data Source
AI summary
A system for storing data includes a performance storage unit, a performance storage transfer manager, a segment storage system, and a performance segment storage unit. The performance storage unit is for storing a data stream or a data block in. The data stream or the data block includes one or more data items. The performance storage transfer manager manages a transfer of the one or more data items to be automatically stored in the segment storage system over a network. The segment storage system is for storing a stored data item of the one or more data items as a set of segments. The performance segment storage unit is for storing the set of segments in the event that the stored data item has been stored using the segment storage system.