Proxy File Metadata for Secondary Storage I/O Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing backup and recovery systems for virtual machine files face inefficiencies in data retrieval due to high I/O request volumes and differing data access schemes between hypervisors and secondary storage, leading to bottlenecks during parallel recovery sessions.
Innovation Solution
A backup and recovery system that utilizes device metadata to efficiently access secondary storage parameters, creates a logical processing unit to manage I/O requests, and employs proxy files to optimize data retrieval by storing larger blocks of data in a repository, reducing the need for frequent access to secondary storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the hypervisor directly processes I/O requests to secondary storage, then data access is straightforward, but the high volume of I/O requests creates bottlenecks during parallel recovery sessions
Solution Approach 1:
The system performs preliminary actions by creating proxy files that contain metadata and path information before actual recovery operations. This allows the hypervisor to work with lightweight proxy files instead of directly accessing secondary storage for every I/O request, significantly reducing the time spent on I/O operations during parallel recovery sessions
Solution Approach 2:
The patent introduces an intermediary layer consisting of proxy files and a file system that sits between the hypervisor and secondary storage. This intermediary handles I/O requests by translating them into efficient storage operations, reducing the burden on the hypervisor and accelerating data recovery processes
2Reliability
If the system stores backup data in secondary storage with detailed organization, then data can be accurately retrieved, but the complexity of managing different data access schemes between hypervisor and storage increases
Solution Approach 1:
The system creates simplified copies of backup data in the form of proxy files that contain essential metadata and path information. These proxy files replicate the necessary data access information without duplicating the entire backup structure, maintaining retrieval accuracy while reducing the complexity of data access schemes
Solution Approach 2:
The patent segments the data access process into distinct layers: proxy files containing metadata, file system for organization, and secondary storage for bulk data. This segmentation allows each layer to handle specific aspects of data management independently, simplifying the overall complexity while maintaining reliable data retrieval
Data Source
AI summary
A technique includes creating a proxy file that is associated with a recovery request, which is associated with the recovery of data associated with a virtual machine file from a secondary storage. The technique includes using metadata that is extracted from the proxy file to access the data. Using the metadata includes, in response to an input/output (I/O) request associated with the recovery request, storing an association of an identifier of the proxy file with metadata representing a parameter associated with the secondary storage. The metadata is stored outside the proxy file. The metadata is used to identify an I/O processing unit; and the technique includes communicating with the I/O processing unit to notify the I/O processing unit to process the I/O request.