Data Backup Optimization via Block Segmentation and Hash Deduplication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data backup systems in cloud computing environments face inefficiencies due to data duplication across multiple systems, leading to increased storage needs and prolonged processor loads during backup processes.
Innovation Solution
The method involves dividing data files into smaller blocks, comparing each block to existing stored blocks using hash values, and storing only unique blocks, allowing multiple data processing systems to perform comparisons in parallel, thereby reducing duplication and enhancing backup efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data files are backed up using traditional methods across multiple data processing systems, then data redundancy is created, but storage requirements increase and processor loads are prolonged
Solution Approach 1:
The patent divides data files into smaller data blocks and processes them individually across multiple data processing systems. Each system handles specific blocks independently, allowing parallel processing while eliminating the need to store complete duplicate copies of entire data files across all systems. This segmentation enables efficient deduplication where only unique blocks are stored.
Solution Approach 2:
The patent uses hash value comparison to identify duplicate data blocks across different data processing systems. By computing hash values of data blocks and comparing them against existing stored blocks, the system determines whether a copy already exists before storing new data, thereby eliminating redundant storage while maintaining backup reliability.
2Productivity
If data files are divided into blocks and processed in parallel across multiple systems, then backup efficiency improves, but system complexity increases
Solution Approach 1:
The patent segments data files into manageable blocks that can be independently processed by multiple data processing systems in parallel. This segmentation enables simultaneous hash computation and comparison operations across different systems, significantly improving backup efficiency while maintaining manageable complexity through standardized block processing procedures.
Solution Approach 2:
The patent introduces hash values as an intermediary mechanism to facilitate efficient duplicate detection. Instead of directly comparing entire data blocks across systems (which would be complex and time-consuming), the system uses computed hash values as proxies for comparison, simplifying the deduplication process while enabling parallel processing across multiple systems.
3Reliability
If complete data files are stored across multiple backup systems, then data recovery reliability is maintained, but processor loads are prolonged
Solution Approach 1:
The patent divides data files into blocks and processes them independently across multiple systems in parallel. This segmentation allows simultaneous hash computation and duplicate detection for different blocks, dramatically reducing the total processor load duration compared to sequential processing of complete files, while ensuring all necessary blocks are available for recovery.
Solution Approach 2:
The patent uses hash value matching to identify and eliminate duplicate data blocks across backup systems. By storing only unique blocks and referencing them across systems, the patent maintains data recovery reliability (any system can restore complete files by assembling unique blocks) while reducing processor load through efficient duplicate detection rather than complete file copying.
Data Source
AI summary
At least one data file for backup can be received. The data file can be divided into a plurality of data blocks. A first portion of the plurality of data blocks can be allocated to a first data processing system for backup by the first data processing system. A second portion of the plurality of data blocks can be allocated to a second data processing system for backup by the second data processing system.