Storage Virtualization Layer for Low Latency I/O
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing network architectures for data storage struggle with efficient integration of features like data compression, deduplication, and copy-on-modify operations, particularly in large storage arrays.
Innovation Solution
The implementation of a storage virtualization layer between user storage and physical storage devices, utilizing mapping tables stored in solid-state memory for efficient I/O redirection, deduplication, and bulk array tasks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data compression, deduplication, and copy-on-modify operations are integrated into large storage arrays, then storage efficiency is improved, but device complexity increases
Solution Approach 1:
The patent introduces a storage virtualization layer as an intermediary between user storage and physical storage devices. This layer contains mapping tables stored in solid-state memory that manage data locations, enabling compression, deduplication, and copy-on-modify operations without requiring these complex features to be built into the physical storage hardware itself. The virtualization layer handles the complexity while presenting a simplified interface to users.
Solution Approach 2:
The storage system is segmented into distinct functional layers: the user storage interface, the virtualization layer with mapping tables in solid-state memory, and the physical storage devices. This segmentation allows the complex features (compression, deduplication) to be implemented in the virtualization layer independently from the physical storage hardware, reducing overall device complexity while maintaining storage efficiency.
2Speed
If mapping tables are stored in solid-state memory for efficient I/O redirection, then I/O performance is improved, but device complexity increases
Solution Approach 1:
Solid-state memory is introduced as an intermediary storage medium specifically for holding mapping tables. This provides fast I/O redirection performance without requiring the physical storage devices themselves to be complex high-speed systems. The solid-state memory acts as a buffer layer that speeds up access to mapping information while keeping the physical storage architecture relatively simple.
3Productivity
If fine-grained mapping and direct map manipulation are implemented, then storage array efficiency is improved, but ease of operation decreases
Solution Approach 1:
The mapping tables in the virtualization layer enable self-service operations for fine-grained mapping and direct map manipulation. The system automatically manages data locations, deduplication mappings, and compression references without requiring manual intervention. This maintains high storage array efficiency through precise control while keeping operations simple for users.
Data Source
AI summary
Methods, computer systems, and computer readable medium are described for low latency reads using cached deduplicated data, including: receiving a request to read data from a storage system; query, using a generated hash value associated with the request to read data, one or more deduplication tables that corresponds to the hash value; and responsive to determining that the one or more deduplication tables includes an entry that corresponds to the hash value, using a mapping contained in the entry to perform the requested to read data, wherein the mapping includes a pointer to a physical location where at least a portion of the data is stored.