Cloud Data Protection Using Incremental Erasure Code Updates
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data protection methods in cloud storage, such as Erasure Code (EC), face high resource consumption and complexity when updating redundant data due to changes in data segments, leading to inefficient I/O operations and maintenance issues.
Innovation Solution
A method and apparatus that determine changes in data segments by generating a second data segment indicating bit identity, expanding it to match the first data portion, and updating redundant data using exclusive-or operations to minimize I/O and memory usage, without complicating the EC library.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional erasure code is used to update redundant data when data segments change, then data protection is maintained, but I/O consumption and resource usage increase significantly
Solution Approach 1:
The patent segments the data update process into identifying only changed segments and processing only those segments, rather than reprocessing all data. This is achieved by comparing data segments and generating difference information, then applying erasure code only to the changed portions, significantly reducing I/O consumption while maintaining data protection.
Solution Approach 2:
The patent applies partial action by performing erasure code operations only on the necessary changed data segments rather than on the entire dataset. The system identifies minimal required updates and processes only those portions, avoiding excessive computation and I/O operations on unchanged data while ensuring data protection integrity.
2Reliability
If traditional erasure code updates are performed when data changes, then data consistency is maintained, but processing time and resource consumption increase
Solution Approach 1:
The patent performs preliminary actions by first identifying changed data segments through comparison before applying erasure code. This preliminary identification step allows the system to prepare only the necessary data for processing, avoiding unnecessary full-data reprocessing and significantly improving processing efficiency while maintaining data consistency.
Solution Approach 2:
The patent divides the data processing task into segments by identifying and processing only the changed portions. This segmentation approach allows parallel processing of different data segments and reduces the overall processing time and resource consumption while ensuring data consistency through targeted updates.
3Reliability
If complete redo of erasure code is performed on changed data, then data durability is ensured, but memory usage and computational resources increase
Solution Approach 1:
The patent extracts only the changed data segments from the complete dataset and processes only those extracted portions with erasure code. This extraction approach reduces memory usage by avoiding loading and processing of unchanged data, while still ensuring data durability through proper protection of the changed segments.
Data Source
AI summary
Embodiments of the present disclosure relate to method and apparatus for data protection. For example, there is provided a computer-implemented method. According to the computer-implemented method, it only needs to read the changed data to be protected rather than the entire data to be protected during the procedure of generating a redundant data portion for the changed data to be protected.