Backup Discovery Breadcrumb Partitioning via Transaction IDs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current backup discovery operations face inefficiencies in managing and processing large volumes of backup metadata, leading to resource consumption issues and suboptimal handling of backup status inquiries.
Innovation Solution
The implementation of a method that utilizes unique transaction identifiers and batch processing architecture to efficiently handle backup discovery operations by partitioning breadcrumb objects based on paging values, enabling targeted metadata retrieval and transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If backup discovery requests process all backup metadata without partitioning, then complete backup status information is retrieved, but resource consumption increases and processing efficiency decreases
Solution Approach 1:
The patent divides the complete set of backup metadata into multiple batches using pagination. The backup agent partitions metadata based on transaction identifiers into discrete batches, each containing a manageable number of records. This segmentation allows the system to process backup status information in smaller, more efficient chunks rather than handling the entire metadata volume at once, directly resolving the contradiction between complete information retrieval and processing efficiency.
Solution Approach 2:
The patent implements partial action by retrieving only the necessary portion of backup metadata required for the discovery operation. Using pagination parameters (batch size, offset), the system fetches only the specific batch of metadata needed for the current query rather than all available metadata. This partial action approach reduces resource consumption while maintaining the ability to retrieve complete information through sequential batch requests.
2Loss of information
If the system retrieves all backup metadata at once, then complete backup status information is obtained, but resource consumption increases
Solution Approach 1:
The patent segments backup metadata into paginated batches, where each batch contains a controlled number of records. The backup agent divides the complete metadata set into discrete portions based on transaction identifier ranges, allowing selective retrieval of only the necessary batches for the discovery operation. This segmentation prevents excessive resource consumption while ensuring complete information availability through sequential batch processing.
Solution Approach 2:
The patent applies partial action by retrieving only the specific portion of backup metadata needed for the discovery request. Using pagination parameters (batch size, offset, limit), the system fetches only the necessary batches rather than all metadata at once. This reduces resource consumption (energy, memory, bandwidth) while maintaining information completeness through the ability to request additional batches if needed.
3Speed
If backup metadata is processed in large batches, then processing speed increases, but system complexity and memory requirements increase
Solution Approach 1:
The patent segments metadata processing into manageable batches with controlled sizes. The backup agent partitions metadata into discrete batches based on transaction identifiers, where each batch is processed independently. This segmentation allows the system to maintain reasonable processing speed through batch operations while avoiding the complexity and memory requirements associated with handling entire metadata sets at once. Each batch processes through a consistent, repeatable mechanism that scales efficiently.
Data Source
AI summary
A method and system for efficiently handling backup discovery operations. Specifically, the disclosed method and system entail enhancing breadcrumbs—e.g., persistent files that store status and other metadata information respective to performed asset backup operations—to further include unique transaction identifiers. These transaction identifiers may serve as markers for distinguishing which subset of breadcrumbs (rather than all breadcrumbs) to forward to a central management system during asset backup discovery operations. The disclosed method and system also implement batch processing architecture to regulate resource consumption on both the client and manager sides.