NDMP Redirector for NAS Load Balancing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional network-attached storage (NAS) systems face hardware resource constraints due to overutilization of Fibre-channel nodes during network data management protocol (NDMP) sessions, while non-Fibre-channel nodes are unable to handle these sessions, leading to inefficient load balancing and resource utilization.

Innovation Solution

A network data management protocol (NDMP) redirector system that analyzes load data across NAS nodes and redirects NDMP sessions to less loaded nodes with available resources, ensuring better load balancing and resource utilization across the cluster.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If NDMP sessions are handled by Fibre-channel nodes, then data backup and restore operations can be performed, but hardware resource constraints occur due to overutilization

Engineering Contradiction:
ImproveNDMP session handling capabilityVSAvoidhardware resource availability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system segments NDMP session handling across different node types (Fibre-channel nodes and non-Fibre-channel nodes) rather than concentrating all sessions on Fibre-channel nodes. The redirector divides the workload by redirecting sessions from overloaded Fibre-channel nodes to available non-Fibre-channel nodes, preventing hardware resource constraints while maintaining backup and restore operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The redirector acts as an intermediary component that receives NDMP session requests from data management applications and mediates their distribution to appropriate NAS nodes. It analyzes load factors and redirects sessions to nodes with available resources, preventing direct overload of Fibre-channel hardware while ensuring session completion.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If all NAS nodes can handle NDMP sessions, then load balancing improves, but hardware resource constraints on Fibre-channel nodes increase

Engineering Contradiction:
Improveload balancing efficiencyVSAvoidhardware resource utilization
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The system applies different capabilities to different node types: Fibre-channel nodes handle sessions requiring direct hardware access, while non-Fibre-channel nodes handle sessions that can be redirected. The redirector uses local quality by directing sessions to the most appropriate node type based on available resources and session requirements, improving load balancing without excessive hardware utilization.

Inventive Principle:
Principle #3Local quality

3Productivity

If NDMP sessions are redirected to less loaded nodes, then resource utilization optimizes, but session redirection overhead increases

Engineering Contradiction:
Improveresource utilization efficiencyVSAvoidsession redirection mechanism
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The redirector implements self-service by automatically analyzing load factors and redirecting sessions without manual intervention. The system monitors its own state and autonomously distributes sessions to optimize resource utilization, reducing the need for complex external management while maintaining efficient resource allocation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10942651B1Network data management protocol redirector
Publication Date: 2021.03.09 EMC IP HLDG CO LLC
  • US10942651B1 patent drawing
  • US10942651B1 patent drawing
  • US10942651B1 patent drawing

AI summary

A network attached storage (NAS) cluster can run with a set of heterogeneous hardware nodes, where not all nodes in the cluster have access to the same target connectivities. In one aspect, network data management protocol (NDMP) sessions can be redirected from a first node of the NAS cluster to a second node of the NAS cluster to balance NDMP load across the NAS cluster and improve resource utilization across cluster. Further, the NDMP load can be actively monitored to balance it continuously to increase resource utilization efficiency.