Spillover Threshold Management in Multi-Core Virtual Servers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Managing spillover in a multi-core system is challenging due to the difficulty in coordinating resource usage across different cores, which can lead to inefficiencies and service disruptions as cores reach their capacity.
Innovation Solution
A method is introduced where a spillover threshold is established for virtual servers, allowing a pool manager to allocate resources between exclusive and shared quota pools, enabling virtual servers to borrow resources from a shared pool and establishing backup virtual servers when necessary to handle service requests.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a spillover system is established to service additional requests when processor capacity is exhausted, then the system can handle more connections, but managing connections across different cores becomes challenging and complex
Solution Approach 1:
The system divides the spillover threshold into separate quota pools (exclusive quota pool and shared quota pool) that can be independently managed for different virtual servers. This segmentation allows each core to have its own resource allocation while maintaining system-wide coordination, reducing the complexity of managing connections across multiple cores.
Solution Approach 2:
The patent introduces a pool manager as an intermediary component that coordinates resource allocation between virtual servers and cores. The pool manager manages the quota pools and determines when to establish backup virtual servers, acting as a mediator that simplifies the complex interactions between multiple cores and virtual servers.
2Adaptability or versatility
If virtual servers are allowed to borrow uses from a shared quota pool, then resource utilization is optimized, but determining when to establish backup virtual servers becomes more complex
Solution Approach 1:
The system implements feedback mechanisms where the pool manager continuously monitors the state of quota pools and virtual server performance. Based on this feedback, the system automatically determines when to establish backup virtual servers, creating a dynamic adaptation process that optimizes resource utilization while managing complexity through automated decision-making.
Solution Approach 2:
The patent creates a dynamic system where virtual servers can flexibly borrow resources from the shared quota pool based on current system conditions. The configuration of backup virtual servers and quota pool allocations can be dynamically adjusted in response to changing workloads, allowing the system to adapt to varying demands while maintaining manageable complexity through structured policies.
Data Source
AI summary
The present invention is directed towards systems and methods for spillover threshold management in a multi-core system. A pool manager divides the spillover threshold limit of connections for vServers into an exclusive quota pool and a shared quota pool. Each vServer operating on a core is allocated an exclusive number of connections from the exclusive quota pool. If a vServer wishes to create connections beyond its exclusive number, the vServer can borrow from the shared quota pool. When the vServers are using at least a first predetermined threshold of their exclusive number of connections and the number of available connections in the shared quota pool has reached a second predetermined threshold, the multi-core system establishes a backup vServer.