Dynamic NFS Stream Connection Threshold Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional storage systems face challenges in managing stream connections, particularly in virtualized environments where a large number of requests overwhelm a small number of TCP connections, leading to suspension of NFS services due to a fixed, static threshold value that cannot be dynamically adjusted, resulting in inefficient request processing and potential denial of service errors.

Innovation Solution

The method involves dynamically and adaptively changing the threshold value for stream connections based on evaluated criteria such as the number of NFS connections, pending replies, and client types, allowing the threshold to increase or decrease to optimize performance in varying use cases, thereby improving memory and storage utilization, I/O performance, and response times.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a fixed static threshold value is used for stream connections, then system simplicity is maintained, but service suspension occurs under high request loads

Engineering Contradiction:
Improvethreshold management complexityVSAvoidNFS service availability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent implements dynamic threshold adjustment for stream connections by introducing a mechanism that automatically modifies the threshold value based on real-time system conditions. The system monitors the number of pending replies and active connections, then adaptively increases or decreases the threshold to prevent service suspension while managing resource utilization effectively.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent employs feedback mechanisms where the system continuously monitors stream connection status, pending reply counts, and resource utilization metrics. Based on this feedback, the threshold value is automatically adjusted - increasing when pending replies indicate capacity headroom, and decreasing when resource utilization approaches limits, thereby maintaining reliable NFS service under varying load conditions.

Inventive Principle:
Principle #23Feedback

2Productivity

If the threshold value is increased to handle more requests, then request processing capacity improves, but memory and storage utilization increases

Engineering Contradiction:
Improverequest processing capacityVSAvoidmemory and storage utilization
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The system dynamically adjusts the threshold value based on real-time monitoring of pending replies and resource utilization. When the number of pending replies is below a certain threshold, the system increases the stream connection threshold to improve request processing capacity. When resource utilization approaches limits, the threshold is decreased to conserve memory and storage resources, achieving optimal balance between productivity and resource consumption.

Inventive Principle:
Principle #15Dynamics

3Quantity of substance

If the threshold value is decreased to reduce resource usage, then memory and storage utilization decreases, but request processing capacity is reduced

Engineering Contradiction:
Improvememory and storage utilizationVSAvoidrequest processing capacity
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The system uses feedback from resource utilization monitoring to intelligently adjust the threshold. When memory and storage resources are underutilized, the feedback mechanism triggers an increase in the stream connection threshold to enhance request processing capacity. When resources are heavily utilized, the threshold is decreased to preserve system resources, creating a self-regulating mechanism that balances resource conservation with productivity requirements.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9898482B1Managing stream connections in storage systems
Publication Date: 2018.02.20 EMC IP HLDG CO LLC
  • US9898482B1 patent drawing
  • US9898482B1 patent drawing
  • US9898482B1 patent drawing

AI summary

A method is used in managing stream connections in storage systems. A set of criteria is evaluated for managing flow control characteristics of a stream connection in a storage system. The flow control characteristics indicates the rate at which requests are processed by the stream connection. Based on the evaluation, management of the flow control characteristics is affected.