Smart NIC Session Tuning for Storage Memory Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In storage systems utilizing smart NICs, the memory consumption becomes excessive when a large number of hosts are coupled due to the need for increased connections and communication buffers, leading to performance degradation.
Innovation Solution
A storage system with a controller that determines communication control parameters based on performance requirements and configuration, optimizing the number of connections and communication buffer sizes for each host-server session using smart NICs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the number of connections is increased to improve IO parallelism and host performance, then communication performance is improved, but memory consumption of the network interface device increases
Solution Approach 1:
The patent dynamically adjusts communication parameters including the number of connections and buffer sizes based on host performance requirements and system configuration. This allows the system to optimize IO parallelism while controlling memory consumption by adapting parameters to actual needs rather than using fixed maximum values.
2Productivity
If communication buffer size is increased to reduce the number of communication times, then communication efficiency is improved, but memory consumption of the network interface device increases
Solution Approach 1:
The patent implements dynamic adjustment of buffer sizes as part of communication parameters based on actual system needs. This allows the system to increase buffer sizes only when necessary to reduce communication frequency, while avoiding excessive memory allocation by adapting to real-time performance requirements.
Solution Approach 2:
The system transitions from static buffer allocation to dynamic buffer size adjustment. Communication parameters including buffer sizes are adapted based on host performance requirements and system configuration, allowing the system to optimize communication efficiency while controlling memory consumption through continuous adaptation.
3Ease of operation
If the number of connections is increased to enable parallel processing by all CPU cores, then load distribution is improved, but memory consumption becomes excessive when coupling to a large number of hosts
Solution Approach 1:
The patent dynamically adjusts the number of connections based on host performance requirements and system configuration. This allows the system to allocate connections optimally for load distribution across CPU cores while preventing excessive memory consumption by adapting the connection count to actual performance needs rather than maximizing connections for all hosts.
Data Source
AI summary
A storage system includes a controller, in which the controller includes a front-end interface that communicates with a host via a network and management information, the management information includes information indicating communication performance of the front-end interface with the host, and a communication control parameter in a session between the host and the front-end interface is determined based on the communication performance.