Offloading Storage Operations to Hardware via Third-Party Server
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current enterprise storage systems cannot perform storage operations like cloning, snapshotting, mirroring, and replication on a per-file basis due to limitations in how disk arrays manage logical data storage units, requiring software-based solutions that are vendor-specific and resource-intensive.
Innovation Solution
The introduction of primitives that enable offloading storage operations to storage hardware on a per-file basis, using third-party servers and out-of-band paths to bypass the file system, allowing for instructions like zeroing, cloning, and deleting file blocks, which support higher-level applications such as instant provisioning and thin provisioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If storage operations are performed using software techniques through traditional standard file system calls, then storage operations can be carried out on data storage units, but the operations are resource-intensive and require vendor-specific customization
Solution Approach 1:
The patent introduces a switch as an intermediary device between the host computer and storage devices. The switch receives storage operations from the host, obtains location information from the file system, generates configuration information, and supplies it to the storage system via out-of-band paths. This intermediary approach enables hardware-based storage operations without requiring file system customization for different vendors.
Solution Approach 2:
The patent segments the storage operation process into distinct components: the host computer initiates operations, the file system provides location information, the switch acts as an intermediary to coordinate operations, and the storage system executes operations. This segmentation allows each component to perform its specific function without requiring complex integration or vendor-specific customization.
2Productivity
If storage operations are performed using software techniques, then storage operations can be carried out, but the computational burden on the host system is high
Solution Approach 1:
The patent enables storage devices to perform operations autonomously through hardware-based execution. The switch supplies configuration information to the storage system, which then executes storage operations (such as cloning, snapshotting, mirroring, and replication) independently without requiring continuous host system intervention. This self-service approach significantly reduces the computational burden on the host system while improving storage operation efficiency.
3Adaptability or versatility
If disk arrays are provided by different vendors with varying storage metadata, then each vendor can optimize their products, but the file system would need to be customized for each vendor
Solution Approach 1:
The switch serves as a vendor-neutral intermediary that interfaces between the host computer and storage devices from different vendors. It obtains location information from the file system in a standardized manner and generates configuration information that can be supplied to various storage systems regardless of vendor-specific metadata formats. This approach maintains file system compatibility while allowing each vendor to optimize their storage products independently.
Solution Approach 2:
The switch is designed as a universal device that can interface with storage devices from multiple vendors without requiring vendor-specific customization of the file system. It performs multiple functions including receiving storage operations, obtaining location information, generating configuration information, and supplying it to diverse storage systems, thereby achieving multi-vendor compatibility through a single standardized interface.
Data Source
AI summary
In a computer system with a disk array that has physical storage devices arranged as logical storage units and is capable of carrying out hardware storage operations on a per logical storage unit basis, a third party server is provided to offload storage operations from a file system to storage hardware. The third party server transfers configuration information associated with composite storage operations to the physical storage devices through an out-of-band path to enable composite storage operations to be executed without involving the file system.