Dynamic Virtual Resource Provisioning for Network Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional load balancing systems in high-speed computational networks introduce significant latency and can become performance bottlenecks, and existing methods for dynamically provisioning resources are unsuitable for meeting specific client workload demands due to the time required for reconfiguring resources.
Innovation Solution
A method and apparatus for dynamically provisioning virtualized computational resources, where a resource controller assigns and adjusts physical processors to virtual processing resources based on utilization, allowing for efficient management and allocation of resources across a networked architecture, including the use of stream processors and a virtual resource layer for optimized workload distribution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional load balancing systems are used to distribute workloads, then workload distribution is achieved, but significant latency is introduced and performance bottlenecks occur
Solution Approach 1:
The patent extracts the load balancing function from the traditional in-path load balancer and relocates it to the edge of the network architecture. Virtualized computational resources at the edge perform load balancing locally, removing the central load balancer from the critical data path and eliminating its associated latency.
Solution Approach 2:
The patent transitions from a single centralized load balancing point to a distributed multi-dimensional architecture where load balancing occurs at multiple edge locations simultaneously. This dimensional shift from centralization to distribution eliminates the single bottleneck and reduces overall latency.
2Adaptability or versatility
If computing resources are re-configured to meet specific client workload demands, then resource adaptability is improved, but the time required for reconfiguration becomes prohibitive
Solution Approach 1:
The patent pre-configures virtualized computational resources at the network edge before actual workload demands arise. These edge resources are prepared in advance with necessary computational capabilities, allowing immediate activation and allocation when workload demands occur, eliminating reconfiguration delays.
Solution Approach 2:
The patent implements dynamic resource allocation where virtualized computational resources can be rapidly provisioned and de-provisioned at the edge based on real-time workload demands. This dynamic capability allows resources to be flexibly adjusted without the prohibitive reconfiguration times of traditional systems.
Data Source
AI summary
A system and method of dynamically provisioning virtualized computational resources in a networked computer architecture includes at least one client device operable to run one or more client applications, at least one server device and a resource controller. Each server device comprises one or more physical processors with local memory. Each server device provides a virtual resource layer through which one or more virtual processing resources can be defined and through which the physical processors of the server device can be assigned to the virtual processing resources. In use, one or more virtual processing resources is assigned to a client application for processing of data processing workloads. The resource controller then monitors the utilization of each virtual processing resource and/or any physical processor assigned to the virtual processing resource. The resource controller can dynamically adjust which, and how many, physical processors are assigned to the virtual processing resource.