Storage Management via Delta Block Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional storage systems inefficiently manage data by transmitting and restoring entire files, leading to high input/output resource consumption and reduced lifespan of storage devices, especially in scenarios where only parts of files are changed or increased.
Innovation Solution
A method and device for storage management that identifies and transmits only the changed portions of a source file relative to a target file, allowing for efficient updating of the target file by mapping storage portions and determining changed data between virtual storage devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional storage systems transmit and restore entire files, then data protection is achieved, but input/output resource consumption increases and storage device lifespan decreases
Solution Approach 1:
The patent divides files into multiple data blocks and identifies only the changed blocks between source and target files. Instead of transmitting entire files, the system segments the data transmission task to include only the necessary changed blocks, thereby reducing I/O resource consumption while maintaining data protection integrity.
Solution Approach 2:
The system extracts and identifies only the changed portions (delta blocks) from the source file relative to the target file. By taking out only the necessary changed data blocks for transmission and restoration, the system avoids transmitting redundant unchanged data, thus reducing storage device wear and I/O consumption while ensuring complete data protection.
2Reliability
If traditional storage systems transmit and restore entire files, then complete data restoration is achieved, but storage device lifespan is reduced
Solution Approach 1:
The patent segments the file restoration process into block-level operations. By identifying and transmitting only the changed blocks rather than entire files, the system reduces the number of write operations on storage devices, thereby extending storage device lifespan while ensuring complete restoration of all changed data through systematic block identification and transmission.
Solution Approach 2:
The system performs partial action by transmitting only the necessary changed blocks rather than complete files. This partial transmission approach is sufficient for achieving complete data restoration since only changed portions need to be updated, thereby reducing storage device write cycles and extending lifespan without compromising restoration completeness.
3Stability of the object's composition
If traditional storage systems transmit entire files, then data consistency is ensured, but data transmission volume increases
Solution Approach 1:
The system extracts and transmits only the changed blocks from the source file relative to the target file. By taking out only the necessary delta blocks that need to be transmitted to maintain data consistency, the system dramatically reduces transmission volume while ensuring that all changes are accurately captured and applied to maintain data consistency.
Solution Approach 2:
The patent segments data into blocks and identifies changed blocks between source and target files. This segmentation enables the system to transmit only the specific blocks that contain changes, maintaining data consistency through systematic block-level comparison and transmission while minimizing overall transmission volume by excluding unchanged blocks.
Data Source
AI summary
According to embodiments of the present disclosure, a method, device and computer program product for storage management are proposed. The method comprises: obtaining, in a first virtual storage device, a first portion storing a source file, the source file being used to update a target file; determining a second portion in the first virtual storage device, data stored in the second portion being changed relative to data stored in a second virtual storage device, the data stored in the second virtual storage device including the target file; determining a changed portion based on the first portion and the second portion, the changed portion indicating changed data of the source file relative to the target file; and updating the target file based on the changed portion. Therefore, the present solution can reduce data transmission and resource consumption.