Parallel Backup Subdivision for Large Data Volumes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing volume and complexity of data in computer systems lead to prolonged backup times, making it inefficient to recover data in case of corruption or disaster.
Innovation Solution
A method that subdivides an initial backup set into smaller backup sets, allowing these to be processed in parallel, reducing overall backup time by utilizing available resources more efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the entire data set is backed up as a single unit, then the backup process is simple to implement, but the backup time increases significantly as data volume grows
Solution Approach 1:
The patent divides the entire data set into multiple smaller data sets (e.g., by file size, type, or location) that can be processed in parallel. This segmentation allows the backup system to handle large data volumes without proportionally increasing backup time, as multiple segments can be backed up simultaneously using multiple processor cores or threads.
2Use of energy by moving object
If data backup is performed sequentially, then the system resource usage is low, but the backup time increases with growing data volumes
Solution Approach 1:
The patent implements a dynamic backup approach where the system automatically determines the optimal parallelization strategy based on data characteristics and available system resources. The backup process adapts its granularity and parallelization level dynamically, allowing efficient use of system resources while minimizing backup time for growing data volumes.
Solution Approach 2:
The patent introduces a new dimension to the backup process by utilizing multiple processor cores and threads to work on different data segments simultaneously. This transforms the traditionally sequential backup process into a parallel execution model, effectively adding a temporal dimension to the backup operation and reducing overall backup time.
3Quantity of substance
If the backup process handles large data volumes, then comprehensive data protection is achieved, but the backup time becomes prolonged
Solution Approach 1:
The patent segments large data volumes into manageable chunks that can be processed in parallel. This segmentation strategy enables the backup system to maintain comprehensive coverage of large data volumes while reducing backup time through concurrent processing of multiple segments using multiple processor cores.
Data Source
AI summary
A method of backing up data is disclosed. Information is collected from a file system corresponding to an initial backup set, wherein the initial backup set comprises a set of data configured to be backed up, and wherein the collected information comprises information regarding how the initial backup set is organized within the file system. Two or more subdivided backup sets are determined based at least in part on the collected information. The two or more subdivided backup sets are backed up.