Backup Segmentation and Node Allocation for Shared Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data backup methods for shared storage systems are inefficient in utilizing available resources, leading to longer backup windows and suboptimal resource utilization across data nodes.
Innovation Solution
A method and system that involves a primary data node receiving a backup request, retrieving file properties, logically dividing the file into segments based on these properties, and coordinating the backup process across multiple secondary data nodes by allocating segments based on their available resources, thereby optimizing resource utilization and load balancing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional data backup methods are used for shared storage systems, then the backup process can be completed, but the resource utilization is suboptimal and backup windows are extended
Solution Approach 1:
The backup system divides the shared storage into multiple segments and assigns different segments to different data nodes for parallel processing. This segmentation enables simultaneous backup operations across multiple nodes, increasing overall backup speed and reducing the backup window duration.
Solution Approach 2:
The system dynamically adjusts the workload distribution among data nodes based on real-time resource availability and performance metrics. This dynamic allocation optimizes resource utilization during the backup process, ensuring that nodes with higher capacity handle more segments while nodes with lower capacity handle fewer segments, thereby improving overall backup efficiency.
2Productivity
If conventional backup methods are used, then the backup process can be completed, but resource utilization across data nodes is suboptimal
Solution Approach 1:
The backup system implements feedback mechanisms where data nodes continuously report their resource status and performance metrics to a coordination module. This feedback enables dynamic adjustment of segment allocation, ensuring optimal resource utilization while maintaining manageable coordination complexity through automated control loops.
Solution Approach 2:
The system introduces a coordination module as an intermediary between the backup initiator and individual data nodes. This intermediary manages the complex coordination tasks by centralizing the logic for segment allocation and workload distribution, simplifying the overall system architecture while achieving optimal resource utilization.
Data Source
AI summary
A method for performing data backup includes: receiving a backup request specifying a file where the file is stored in a shared storage. Additionally, in response to the backup request: retrieving, by a primary data node, properties of the file; determining, by the primary data node, resource availability for plurality of secondary data nodes where the primary data node and the plurality of secondary data nodes is operatively connected to the shared storage and a backup storage; logically dividing, by the primary data node, the file into a plurality of segments using at least the properties of the file; and coordinating, by the primary data node, the backup of the file using the plurality of segments and the resource availability of the plurality of secondary data nodes.