Dynamic Virtual Proxies for Data Protection Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In dynamic virtual environments, determining the required number of proxy engines for data protection is challenging due to the high variability in virtual machine loads and frequent changes in workload patterns, making it difficult to efficiently manage data flow and balance loads across proxies.
Innovation Solution
Implementing fully dynamic virtual proxies that determine threshold parameters for each proxy, identify under- and over-utilized proxies, and automatically redistribute data flow and manage proxy resources to maintain optimal load balancing and utilization, allowing for the shutdown and restart of idle proxies and the awakening of previously shutdown ones as needed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a static configuration of proxy engines is used, then device complexity is reduced and ease of operation is improved, but adaptability deteriorates and productivity decreases in dynamic environments
Solution Approach 1:
The patent implements fully dynamic virtual proxies that automatically adjust their configuration and resource allocation based on real-time workload conditions. The system monitors virtual machine loads and dynamically creates, updates, or shuts down proxy engines as needed, transforming the static proxy architecture into a dynamic one that adapts to changing data center requirements.
Solution Approach 2:
The virtual proxy system employs self-service mechanisms where proxies automatically monitor their own utilization metrics, detect when they need to be created or shut down, and manage their own resource allocation without manual intervention. The system autonomously adjusts proxy engine configuration based on detected workload patterns.
2Adaptability or versatility
If the number of virtual machines increases frequently, then adaptability is improved, but device complexity increases and load balancing becomes more difficult
Solution Approach 1:
The system implements continuous feedback loops where virtual proxies monitor workload conditions, detect changes in virtual machine loads, and automatically adjust proxy engine allocation. The feedback mechanism tracks proxy utilization metrics and triggers automatic proxy creation or shutdown based on detected workload patterns, simplifying management despite frequent VM changes.
Solution Approach 2:
The virtual proxy system is designed as a universal platform that can handle multiple virtual machines and diverse workload patterns through a single standardized proxy engine architecture. This multi-functional design allows the same proxy infrastructure to adapt to various VM configurations and load patterns without requiring specialized management for each scenario.
3Productivity
If proxy engines are over-provisioned, then productivity is maintained under peak load, but loss of energy increases and resource utilization deteriorates
Solution Approach 1:
The system dynamically adjusts proxy engine resource allocation based on real-time workload detection. When workload increases, additional proxy engines are activated to maintain productivity. When workload decreases, proxy engines are shut down to reduce energy consumption, eliminating the need for over-provisioning while maintaining peak performance capability.
Solution Approach 2:
The system changes operational parameters of virtual proxies based on detected workload conditions. Proxy engines transition between active and shutdown states based on utilization thresholds, and system parameters such as proxy count and resource allocation are dynamically adjusted to optimize both productivity and energy efficiency under different load conditions.
Data Source
AI summary
Described is a system for utilizing fully dynamic proxies for data flow during data protection. The system determines threshold parameters for each respective virtual proxy in a plurality of virtual proxies. The system receives virtual machine protection data of each respective virtual proxy. The system detects a current data protection workload experienced by each virtual proxy operating according to its respective threshold parameters and virtual machine protection data. The system identifies at least one under-utilized virtual proxy and at least one over-utilized virtual proxy based on the current data protection workload detected on each virtual proxy. The system causes the at least one under-utilized virtual proxy to receive upcoming backup data flow before the at least one over-utilized virtual proxy.