Constituent Service Traffic Routing via Hidden Processing Agents
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for managing network traffic between constituent services in distributed applications require significant low-level networking configuration and resource allocation, leading to inefficiencies and increased administrative burden, especially when services are deployed across isolated networks.
Innovation Solution
A traffic management service (TMS) employs a fleet of hidden traffic processing agents (TPAs) to manage network traffic between constituent services, eliminating the need for clients to perform low-level configuration and resource allocation by acting as intermediaries, performing tasks such as load balancing, tracing, and authentication.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traffic management policies are applied at the individual service level, then fine-grained control and optimization are achieved, but system complexity and management overhead increase significantly
Solution Approach 1:
The patent combines multiple individual service traffic management functions into a single unified traffic management plane. The network device consolidates policy enforcement for multiple services (e.g., voice, data, video) into one centralized mechanism, reducing management overhead while maintaining fine-grained control capabilities through the unified plane's ability to handle service-specific parameters.
Solution Approach 2:
The unified traffic management plane is designed to handle multiple service types and traffic patterns through a single multi-functional system. It can enforce different traffic management policies (priority queuing, bandwidth allocation, rate limiting) across various services without requiring separate management mechanisms for each service type.
2Reliability
If separate traffic management systems are used for each service, then service-specific optimization is achieved, but resource utilization efficiency decreases due to redundant mechanisms
Solution Approach 1:
The patent merges separate traffic management systems into a unified plane that shares common infrastructure and control mechanisms. This consolidation eliminates redundant processing and resource consumption while maintaining service-specific optimization capabilities through the unified plane's ability to apply differentiated policies to different service traffic flows.
3Productivity
If traffic management policies are customized for each service, then service performance is optimized, but policy configuration and maintenance complexity increases
Solution Approach 1:
The unified traffic management plane provides a universal interface and standardized policy framework that can accommodate service-specific requirements. Administrators can configure and maintain policies through a single unified system that automatically applies appropriate management rules to different services, reducing configuration complexity while maintaining service performance optimization.
4Adaptability or versatility
If multiple traffic management planes are maintained for different services, then service independence is preserved, but system reliability decreases due to potential inconsistencies
Solution Approach 1:
The patent combines multiple traffic management planes into a single unified plane that centrally coordinates policy enforcement across all services. This unified structure maintains service independence through standardized interfaces and policy templates while ensuring system consistency by eliminating the possibility of conflicting policies that could arise from multiple independent management planes.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A determination is made that messages from a first constituent service of an application are to be processed at a second constituent service. Networking configuration settings are generated such that a message originating at the first constituent service is directed to a traffic processing agent established by a traffic management service. In response to a receipt of a message from the first constituent service at the agent, one or more packets are delivered to the second constituent service.