RDMA Manager Bypasses OSD Interface for Direct Memory Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Object-based storage systems face inefficiencies in object retrieval due to the processing overhead incurred by the host system when transferring objects from an Object-based Storage Device (OSD) across the network and into local memory, which becomes burdensome with multiple concurrent requests.
Innovation Solution
Implementing Remote Direct Memory Access (RDMA) in OSD targets to directly transfer objects from the OSD to the host system's memory, bypassing the OSD interface and reducing the processing burden on the host system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the host system transfers objects from the OSD across the network and into local memory using traditional object-based storage interfaces, then the storage system maintains abstraction and flexibility, but the host system incurs significant processing overhead that reduces efficiency
Solution Approach 1:
The patent introduces an RDMA interface as an intermediary mechanism between the OSD and host system memory. This intermediary enables direct memory access bypassing the traditional OSD interface processing path, thereby reducing host system processing overhead while maintaining the object-based storage abstraction layer. The RDMA interface acts as a mediator that handles data transfer independently of the host CPU.
Solution Approach 2:
The patent extracts the data transfer function from the host system's OSD interface processing path and relocates it to a dedicated RDMA interface. By separating the object retrieval and transfer operations from the host system's main processing path, the invention removes the processing overhead burden from the host system while preserving the abstraction benefits of object-based storage.
2Reliability
If multiple concurrent object requests are handled through the traditional OSD interface, then the system maintains protocol compliance and abstraction, but the processing overhead becomes burdensome and reduces throughput
Solution Approach 1:
The patent segments the object storage system into two distinct operational paths: a control path that handles OSD interface commands and protocol compliance, and a data path that handles actual object transfers through RDMA. This segmentation allows multiple concurrent data transfers to occur independently of control plane processing, thereby increasing throughput while maintaining protocol compliance through the separate control path.
Solution Approach 2:
The RDMA interface serves as an intermediary that handles high-volume data transfers independently from the OSD interface that manages protocol compliance. This intermediary architecture allows the system to maintain reliable protocol-based control while enabling high-speed concurrent data transfers without the processing overhead burden.
3Ease of operation
If the host system processes object transfers through the OSD interface, then the system maintains proper abstraction layers, but the host system's processing resources are consumed reducing overall system efficiency
Solution Approach 1:
The patent enables the RDMA interface to perform data transfer operations independently without requiring host system processing resources. The RDMA interface autonomously handles object retrieval and memory placement operations, allowing the host system to maintain abstraction layer integrity while the actual data transfer work is performed by the self-sufficient RDMA subsystem, thereby eliminating the processing overhead loss.
Data Source
AI summary
Embodiments describe Object-based Storage Device (OSD) targets that utilize Remote Direct Memory Access (RDMA) to allow the OSD target to directly transfer objects requested by a host system to the memory of host system, thereby bypassing an OSD interface of the host system. One embodiment comprises an OSD target that includes an OSD manager, an RDMA manager, and a non-volatile storage device that stores an object. The OSD manager communicatively couples with an OSD interface of a first host system. The RDMA manager communicatively couples with at least one of a first RDMA interface of the first host system and a second RDMA interface of a second host system. The OSD manager receives an OSD command to retrieve the object from the OSD interface, locates the object at the non-volatile storage device, and provides the object to the RDMA manager. The RDMA manager provides the object to at least one of the first RDMA interface of the first host system and the second RDMA interface of the second host system.