Virtual Machine Image Hashing for Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The transfer of virtual machine images across geographical locations consumes significant network bandwidth due to the large size of the images, leading to latency and inefficiency, especially when users move or when data synchronization is required between distant offices.
Innovation Solution
A method and system that reduces the data transfer by computing signature values of disk blocks, identifying and transferring only one copy of duplicate blocks, and using a data transfer manager to reconstruct the virtual machine images at the target location, thereby minimizing the amount of data sent over the network.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If virtual machine images are transferred over the network from one location to another, then data synchronization and user access are enabled, but network bandwidth is significantly consumed and transfer speed becomes slow
Solution Approach 1:
The virtual machine image is divided into multiple disk blocks, and signature values are computed for each block individually. This segmentation enables identification and transfer of only unique blocks rather than the entire image, reducing network bandwidth consumption while maintaining data synchronization capability.
Solution Approach 2:
Instead of transferring duplicate disk blocks multiple times, the system identifies duplicate blocks through signature comparison and transfers only one copy of each unique block. The target location reconstructs the complete virtual machine image by assembling the transferred unique blocks, thereby reducing network bandwidth usage while ensuring data integrity.
2Reliability
If complete virtual machine images are transferred to ensure data synchronization, then reliability is improved, but transfer time increases significantly
Solution Approach 1:
Signature values of disk blocks are computed in advance at the source location before the transfer process begins. This preliminary computation enables rapid identification of unique versus duplicate blocks during transfer, allowing the system to send only necessary data blocks and significantly reducing transfer time while maintaining synchronization reliability.
Solution Approach 2:
The system extracts and identifies duplicate disk blocks through signature comparison and removes them from the transfer set, transmitting only the essential unique blocks. This extraction process eliminates redundant data transmission, thereby reducing transfer time while ensuring complete and reliable data synchronization at the target location.
3Adaptability or versatility
If virtual machine images are transferred for backup or user mobility, then data availability is improved, but network bandwidth consumption increases
Solution Approach 1:
The virtual machine image is segmented into disk blocks with individual signature values computed for each block. This segmentation enables the system to transfer only the unique blocks required for user mobility or backup purposes, rather than transferring complete image copies, thereby reducing network bandwidth consumption while maintaining data availability.
Solution Approach 2:
The system identifies and transfers only one copy of each unique disk block, eliminating redundant transmissions. The target location reconstructs the virtual machine image from these unique blocks, enabling user mobility and backup operations with significantly reduced network bandwidth consumption compared to transferring complete image copies.
Data Source
AI summary
Virtual machine images are transferred from a source storage location to a target storage location over a network. In one embodiment, a host at the source storage location computes signature values of a plurality of disk blocks that contain a plurality of virtual machine images. Each computed signature value corresponds to one of the disk blocks. A subset of the disk blocks, all of which have different signature values, is then transferred from the source storage location to the target storage location. Only one copy of duplicate disk blocks is transferred.