SmartNIC Splitter Architecture for Bottleneck-Free Data Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data replication systems face challenges in implementing splitters across various environments due to installation complexity, vendor collaboration requirements, and limitations in virtualized and non-virtualized setups, leading to inefficiencies and single points of failure.
Innovation Solution
Integrating data protection operations, including replication and splitting, into smart network interface cards (smartNICs) that offload processing and are aware of storage entities, allowing operation in disaggregated and distributed environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a splitter is implemented at a host server (application layer or operating system layer), then data replication can be achieved, but installation and maintenance become tedious and complex
Solution Approach 1:
The splitter functionality is extracted from the host server's operating system or application layer and relocated to a dedicated network interface card. This extraction eliminates the need for complex software installation and maintenance at the host level, while preserving the data replication capability. The NIC becomes a self-contained replication appliance.
Solution Approach 2:
A dedicated network interface card serves as an intermediary component between the host server and the storage system. This intermediary handles the splitter functions independently, reducing the complexity burden on the host server while ensuring reliable data replication through specialized hardware.
2Reliability
If a splitter is implemented at a hypervisor layer in a virtual environment, then data replication can be achieved, but the solution becomes limited to virtualized environments and cannot operate in non-virtualized environments
Solution Approach 1:
The network interface card is designed with universal functionality that enables it to operate as a splitter in multiple environments - both virtualized and non-virtualized (bare metal). The NIC can function independently without requiring a hypervisor, making the solution adaptable to diverse deployment scenarios while maintaining replication reliability.
3Reliability
If a splitter is implemented at the network switch level, then data replication can be achieved, but tight collaboration with vendors is required and integration becomes extremely complicated
Solution Approach 1:
The splitter functionality is extracted from the network switch and relocated to a standalone network interface card. This extraction eliminates the need for complex integration with network switch vendors and their proprietary systems. The NIC operates independently as a self-contained replication device, reducing integration complexity while maintaining replication reliability.
4Reliability
If a splitter is implemented at the storage device level, then data replication can be achieved, but collaboration with storage vendors is required and the splitter becomes storage specific
Solution Approach 1:
The network interface card serves as an intermediary positioned between the host server and storage system. This intermediary has visibility into data structures through the host interface while communicating with various storage systems through standard protocols. The NIC maintains storage-agnostic functionality, enabling compatibility with diverse storage vendors and systems while ensuring reliable replication.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
One example method includes a splitter for data protection operations including replication operations. The splitter is located on or integrated into a smart network interface card and operates in two modes. The splitter is controlled by a replication controller. In one mode, the control path and the data path both go to the replication controller. In another mode, the data path is directly from the splitter to one or more targets without passing through the replication controller.