Multi-Tier ADC Cache Redirection via Port Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In ISP environments, the large volume of network traffic poses challenges for the performance and operation of application delivery controllers (ADCs) in managing cache redirection, leading to inefficiencies in traffic management.
Innovation Solution
Implementing a system and method for load balancing multiple ADCs across multiple tiers, where an upper layer of ADCs balances lower-tier ADCs by splitting the transport layer port range, allowing transparent cache redirection by identifying and forwarding requests between cache servers and origin servers while maintaining client IPs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a single ADC handles all cache redirection traffic, then the system structure is simple, but the performance and operation become challenging under large traffic volumes
Solution Approach 1:
The patent divides the ADC system into multiple tiers (first tier and second tier ADCs) with distinct roles. First tier ADCs handle load balancing and client IP management, while second tier ADCs handle cache redirection. This segmentation allows each component to specialize, improving overall traffic management capability without overwhelming any single ADC.
Solution Approach 2:
The patent introduces a hierarchical dimension to the ADC architecture by creating multiple tiers. Traffic flows through different dimensional levels: client requests go to first tier ADCs, which then direct to second tier ADCs for cache redirection. This dimensional organization enables scalable traffic management that handles large volumes efficiently.
2Productivity
If multiple ADCs are used for load balancing, then traffic management performance improves, but the complexity of managing client IPs and ports increases
Solution Approach 1:
The patent segments the port range into different ranges assigned to different second tier ADCs. Each second tier ADC is configured with a specific port range, which simplifies IP management by creating clear boundaries. First tier ADCs forward requests based on destination port to the appropriate second tier ADC, reducing the management complexity of client IPs across multiple ADCs.
Solution Approach 2:
First tier ADCs act as intermediaries between clients and second tier ADCs. They receive client requests, determine the appropriate second tier ADC based on destination port, and forward the requests. This intermediary role simplifies the overall system by centralizing the decision-making logic at the first tier level.
3Reliability
If cache redirection is implemented, then load on origin servers is reduced, but the complexity of coordinating between multiple ADC tiers increases
Solution Approach 1:
The patent segments cache redirection functionality from load balancing functionality into separate tiers. Second tier ADCs specialize in cache redirection operations, while first tier ADCs handle load balancing and client communication. This segmentation simplifies coordination by clearly defining responsibilities at each tier.
Solution Approach 2:
The patent uses destination port as a key parameter for forwarding decisions at the first tier ADCs. By configuring second tier ADCs with specific port ranges, the system creates simple parameter-based forwarding rules that reduce coordination complexity while maintaining effective cache redirection.
Data Source
AI summary
The present disclosure describes systems and methods for load balancing multiple application delivery controllers (ADCs) in multiple tiers. An upper layer of the tier comprises ADCs that load balance the plurality of ADCs of a lower layer of the tier. In order to appropriately share and maintain client IPs for transparent cache redirection scenarios, the transport layer (Transport Control Protocol (TCP)) port range is split among the ADCs of the lower tier. The lower tier ADCs would then create a connection only using a source port assigned to them. The response from the origin will then be sent to the upper level ADC which looks at the destination port and forward the packet to the correct lower tier ADC. Hence, the ADCs at two levels will work in conjunction to provide transparent cache direction.