Hot Flow Cache Offloading via Service Priority Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current packet traffic management systems face inefficiencies in optimizing the use of high-speed flow caches by failing to effectively differentiate between hot and non-genuine connection flows, leading to suboptimal performance and resource utilization.
Innovation Solution
Implementing a packet traffic management device with a data flow segment and control segment that utilize service priorities and resource usage metrics to identify and prioritize hot connection flows for offloading to a high-speed flow cache, ensuring efficient use of cache resources by maximizing hot flows and minimizing malicious or inoperative connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If all connection flows are offloaded to the high-speed flow cache, then processing speed for all flows increases, but cache resources are wasted on non-genuine flows and hot flow identification accuracy decreases
Solution Approach 1:
The system segments connection flows into different categories (genuine hot flows, non-genuine flows, and regular flows) and applies different handling strategies to each segment. The control segment identifies and classifies flows, then selectively offloads only genuine hot flows to the data flow segment's cache, preventing contamination of the cache with non-genuine flows.
Solution Approach 2:
The control segment acts as an intermediary between the network input and the data flow segment cache. It analyzes incoming connection flows, determines their authenticity and hotness, and selectively forwards only suitable flows to the cache, thereby protecting the cache from non-genuine flows while maintaining high processing speed for genuine hot flows.
2Productivity
If selective offloading based on flow analysis is implemented, then cache resource utilization improves, but system complexity increases due to additional control mechanisms
Solution Approach 1:
The packet traffic management device is divided into two functional segments: a control segment responsible for flow analysis and classification, and a data flow segment responsible for caching and high-speed processing. This segmentation allows each segment to specialize in specific tasks, improving overall efficiency while keeping individual segment complexity manageable.
Solution Approach 2:
The control segment autonomously analyzes incoming flows, identifies hot genuine flows, and makes offloading decisions without external intervention. The data flow segment independently manages the cache and processes offloaded flows, reducing the need for complex coordination mechanisms and simplifying the overall system architecture.
Data Source
AI summary
Embodiments are directed towards improving the performance of network traffic management devices by optimizing the management of hot connection flows. A packet traffic management device (“PTMD”) employs a data flow segment (“DFS”) and control segment (“CS”). The CS performs high-level control functions and per-flow policy enforcement for connection flows maintained at the DFS, while the DFS performs statistics gathering, and per-packet policy enforcement, on connection flows maintained at the DFS. The DFS may include high-speed flow caches and other high-speed components. Making efficient use of the high speed flow cache capacity may be improved by maximizing the number of hot connection flows based on unique service and network traffic characteristics through adaptive feedback pattern learning together with administrator configurable service preferences that may have flow control data for most bandwidth hungry and desired hot services offloaded to the high-speed flow cache, at appropriate time.