Dynamic Proxy Assignment for Virtual Machine Streaming Backups
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional load balancing techniques for assigning resources to secondary copy operations in virtual machine backup jobs are inefficient, leading to over- or under-utilization of data agent proxies, resulting in delayed or failed backups and performance issues on primary storage devices.
Innovation Solution
A comprehensive approach that dynamically assigns data agent proxies for virtual machine secondary copy operations by setting per-proxy maximum concurrent data streams, generating priority lists based on data store access modes, and re-evaluating proxy choices to balance workload and ensure timely backups.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional load balancing techniques are used for assigning data agent proxies to secondary copy operations, then the system structure remains simple, but the data agents become over- or under-utilized leading to delayed or failed backups
Solution Approach 1:
The patent implements dynamic load balancing that continuously monitors and adjusts the assignment of secondary copy operations to data agent proxies based on current system conditions. The load balancer dynamically determines which data agent proxy should handle each secondary copy operation by evaluating factors such as current workload, proxy capacity, and operation priority, rather than using static assignment rules. This dynamic approach prevents both over-utilization and under-utilization of proxies, ensuring reliable backup completion while maintaining high operational efficiency.
2Speed
If more data agent proxies are assigned to handle secondary copy operations concurrently, then the backup speed increases, but the system complexity and coordination overhead increase
Solution Approach 1:
The patent introduces a load balancer as an intermediary component that sits between the secondary copy operations and the data agent proxies. This load balancer receives requests for secondary copy operations, intelligently determines the optimal data agent proxy assignment based on current system state, and routes operations to appropriate proxies. By centralizing the coordination function in this intermediary layer, the system can effectively manage multiple concurrent proxies without proportionally increasing overall system complexity, as the load balancer abstracts the coordination overhead from individual components.
3Productivity
If data agent proxies are over-utilized to increase throughput, then more backups can be processed, but performance issues occur on primary storage devices
Solution Approach 1:
The patent implements a feedback mechanism where the load balancer continuously monitors the state of data agent proxies and primary storage devices, and uses this information to dynamically adjust assignment decisions. When proxies or storage devices show signs of overload or performance degradation, the load balancer receives feedback about these conditions and modifies its routing decisions to redistribute workload appropriately. This feedback loop allows the system to maintain high throughput by utilizing multiple proxies while preventing any single proxy or storage device from being over-utilized to the point of performance failure.
Data Source
AI summary
A comprehensive approach to streaming backups for virtual machines (“VMs”) in a storage management system comprises improvements to the assignment of data agent proxies for VM secondary copy operations. New considerations in performing a VM streaming backup job include without limitation: determining and enforcing a system-wide per-proxy limit of concurrent data streams; generating an ordered priority list of the VMs to be backed up as a basis for choosing which proxies will back up the respective VM, though the illustrative system may not strictly adhere to the priority list based on further considerations; identifying a next available proxy based on data stream utilization at the proxy; and dynamically re-generating the priority list and re-evaluating considerations if some VMs become “stranded” due to a failure to be backed up. Secondary copy operations are distributed to proxies in ways that improve the chances of successfully completing VM streaming backups.