API Routing Service for Dynamic Network Traffic Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Resource providers face strain from high volumes of resource requests and complex resource components, leading to latency and congestion issues, which existing content delivery networks struggle to manage efficiently, especially under conditions like DDoS attacks.
Innovation Solution
A routing service that utilizes API-level communication to identify and dynamically route resource requests through alternative servers with different functionalities, optimizing latency and throughput by analyzing congestion and security metrics across a network topology.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If resource providers use traditional content delivery networks to facilitate resource delivery, then resource delivery capability is improved, but system complexity and strain on computing resources increase
Solution Approach 1:
The patent introduces a routing service as an intermediary component that sits between client computing devices and resource providers. This routing service receives resource requests from clients, determines optimal routes through a network of servers, and forwards requests to appropriate resource providers. By centralizing the routing intelligence in this intermediary service, the system achieves improved resource delivery capability without significantly increasing the complexity at individual resource provider nodes, as they simply need to respond to routed requests.
Solution Approach 2:
The patent segments the network into multiple functional components: client computing devices, routing services, intermediate servers, and resource providers. Each component has a specific function - clients generate requests, routing services determine paths, intermediate servers facilitate transmission, and resource providers fulfill requests. This segmentation allows each component to be optimized independently and reduces the burden on any single resource provider, as they only handle requests routed to them rather than managing the entire delivery system.
2Adaptability or versatility
If resource providers handle high volumes of resource requests, then service coverage is improved, but latency and processing strain increase
Solution Approach 1:
The routing service dynamically determines the optimal route for each resource request based on real-time conditions such as server availability, network congestion, and request characteristics. Rather than using a static routing configuration, the system adapts its routing decisions dynamically. This dynamic approach allows the system to handle high volumes of requests efficiently by directing traffic to the least congested paths, thereby maintaining low latency while expanding service coverage to handle increased demand.
Solution Approach 2:
The routing service incorporates feedback mechanisms to monitor the performance of different routes and servers. By tracking metrics such as response time, success rate, and server load, the routing service can adjust its routing decisions based on actual performance data. This feedback loop enables the system to identify and avoid congested paths, redirect requests to healthier servers, and maintain optimal performance even as the volume of requests increases, thus reducing latency while improving service coverage.
3Ease of manufacture
If traditional routing methods are used, then implementation simplicity is maintained, but security and congestion resistance deteriorate
Solution Approach 1:
The routing service acts as a security intermediary that sits between clients and resource providers, filtering and validating requests before they reach the resource providers. This intermediary layer can detect and block malicious requests such as DDoS attacks, while simultaneously maintaining the simplicity of the overall implementation by centralizing security functions in a dedicated service rather than distributing complex security logic across all nodes. The routing service handles both routing and security functions, providing enhanced reliability without significantly complicating the architecture.
4Productivity
If resource providers increase their computing capacity to handle more requests, then productivity is improved, but cost and resource consumption increase
Solution Approach 1:
The routing service dynamically allocates requests to resource providers based on real-time availability and load conditions. Rather than provisioning maximum capacity at all resource providers, the system dynamically routes requests to the most appropriate available servers, optimizing resource utilization. This dynamic allocation allows the system to handle high volumes of requests without requiring all resource providers to maintain maximum capacity continuously, thereby improving productivity while reducing overall computing resource consumption.
Solution Approach 2:
The routing service changes routing parameters such as destination server, route path, and load distribution ratios based on real-time conditions. By adjusting these parameters dynamically, the system can optimize the distribution of requests across the server fleet. This parameter change approach allows the system to handle increased request volumes by intelligently distributing the load rather than simply adding more computing resources, thus improving productivity while minimizing the quantity of computing resources required.
Data Source
AI summary
Systems and methods are described for a routing service that identifies routes for providing a resource with the least cost for providing a resource configured for a data flow. The routing service can operate on various servers with varying functionalities in a distributed network topology. After establishing an application-programming interface (“API”) session, the routing service can send API-based requests to the various servers to obtain API-based routing information. The routing service can use the routing information to determine that a network performance metric exceeds a threshold for providing a resource on a requested route. Advantageously, the routing service can determine alternative routes using the API routing information and, further, identify the least cost route of those alternative routes. Finally, the routing service can provide a resource configured for a data flow (e.g., a video conference) via the least cost route.