Data Quantity Restriction for Network and Storage Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Servers with both application and storage control functions face challenges in managing data transmission and storage due to bottlenecks in network interfaces, particularly when using SSDs, where the high data transfer rates lead to saturation of network bandwidth, making it difficult to effectively limit data quantities for both transmission and storage operations without impacting performance.
Innovation Solution
Implementing a system where each entity sets upper limits for send and write quantities, with the limitation control function adjusting these limits based on allocation policies to prevent bottlenecks and optimize data transfer, ensuring that network send and receive quantities, as well as storage write and read quantities, are balanced and efficiently managed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the data quantity of NW transmission is limited using traditional NW limitation control, then network bandwidth saturation is prevented, but the data quantity of volume write cannot be effectively controlled and may cause storage bottlenecks
Solution Approach 1:
The patent introduces a limitation control function that acts as an intermediary between applications and the storage system. This function monitors and controls both NW transmission quantity and volume write quantity, adjusting them based on allocation policies. The intermediary coordinate system maps NW transmission limits to corresponding volume write limits, ensuring balanced control of both data paths without directly constraining either one independently.
Solution Approach 2:
The patent dynamically adjusts limitation parameters (upper limits of data quantity) based on the type of storage device detected. When an SSD is detected, different limitation values are applied compared to when an HDD is detected. The system changes parameters such as the upper limit of NW transmission quantity and upper limit of volume write quantity according to the storage device characteristics and current system state, optimizing performance for each scenario.
2Quantity of substance
If the data quantity of volume write is limited to prevent storage bottlenecks, then write throughput is maintained, but NW transmission capability is unnecessarily restricted
Solution Approach 1:
The limitation control function serves as a mediator that coordinates both volume write limitation and NW transmission limitation. Instead of independently controlling either parameter, the function uses an intermediary coordinate system to adjust both parameters together based on allocation policies. This ensures that when volume write is limited, NW transmission limits are also appropriately adjusted to maintain overall system productivity.
Solution Approach 2:
The patent merges the control of volume write quantity and NW transmission quantity into a single limitation control function. Rather than having separate control mechanisms that might conflict, the function combines both control responsibilities and adjusts them in coordination based on a unified allocation policy, ensuring that limitations on one do not unnecessarily restrict the other.
3Productivity
If SSD is used as storage device to increase data transfer speed, then write performance is improved, but network bandwidth saturation occurs more frequently
Solution Approach 1:
The system detects the type of storage device (SSD or HDD) and dynamically changes limitation parameters accordingly. When an SSD is detected, the system applies specific upper limit values for NW transmission quantity and volume write quantity that are appropriate for high-speed storage. These parameter adjustments prevent network bandwidth saturation while充分利用 the high data transfer capabilities of SSDs.
Solution Approach 2:
The limitation control function continuously monitors the actual data transfer rates and adjusts limitation values based on feedback from the system state. When SSDs are in use and high transfer speeds are achieved, the function receives feedback about the increasing data flow and adjusts the upper limits to prevent network bandwidth saturation, maintaining optimal performance dynamically.
4Ease of manufacture
If traditional NW limitation control is used without considering storage device type, then implementation is simple, but performance optimization is insufficient for SSD-based systems
Solution Approach 1:
The limitation control function automatically detects the type of storage device connected to the system and self-adjusts the limitation parameters without requiring manual configuration. The system serves itself by identifying whether SSDs or HDDs are present and automatically applying the appropriate limitation values, simplifying implementation while optimizing performance for the specific hardware configuration.
Solution Approach 2:
The system transitions from static limitation values to dynamic adjustment based on storage device type. The limitation parameters are not fixed but are dynamically changed according to the detected storage device characteristics. This dynamic approach maintains simplicity of implementation while achieving performance optimization adapted to the specific hardware environment.
Data Source
AI summary
With respect to each of one or more entities, a computer sets a sum of an upper-limit NW send quantity and an upper-limit write quantity to a level equal to or lower than an allocation send quantity that is a send quantity allocated for the entity concerned. With respect to each of the one or more entities, the upper-limit NW send quantity is an upper-limit value of the NW send quantity that is the quantity of data to be sent per unit time via an NW I/F of the computer. With respect to each of the one or more entities, an upper-limit write quantity is an upper-limit value of a write quantity that is the quantity of data to be written per unit time to a logical volume recognized by the entity concerned.