Local Cache for Backup Data Retrieval
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data retrieval from remote storage systems in cloud environments faces performance limitations due to the need for remote data queries, leading to degraded device performance when handling multiple queries.
Innovation Solution
Implementing a caching mechanism that stores search data locally, allowing subsequent queries to be fulfilled partially or fully from the cache instead of the remote storage system, and using an efficient directory structure to separate metadata from data files for faster access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is stored remotely on a storage device connected via public network, then storage capacity and accessibility are improved, but query performance and device performance degrade significantly when handling multiple queries
Solution Approach 1:
The patent applies preliminary action by caching metadata and search data from the remote storage device before actual data retrieval operations. The system pre-loads directory information, file metadata, and search indices into local memory, so that when queries arrive, the application can quickly search local cache rather than accessing remote storage for every query. This preliminary preparation significantly reduces query response time and improves overall system performance.
Solution Approach 2:
The patent introduces an intermediary caching layer between the remote storage device and the application. This cache acts as a mediator that stores frequently accessed metadata and search data locally, translating remote storage operations into faster local operations. The intermediary cache buffer reduces the number of network round-trips required for query processing, thereby improving query handling performance while maintaining access to remote storage capacity.
2Reliability
If applications process each query by searching data stored remotely on storage device, then data accuracy is ensured, but overall device performance degrades with significant number of queries
Solution Approach 1:
The patent applies copying by creating local replicas of metadata and search data from the remote storage device. Instead of searching the actual data files remotely for every query, the system copies relevant metadata, directory structures, and search indices into local cache. These copies enable fast local searching while maintaining data accuracy by ensuring the cached metadata accurately reflects the remote storage contents. This copying strategy ensures query accuracy while dramatically improving device performance.
3Adaptability or versatility
If applications are remote from storage device, then network accessibility and flexibility are improved, but query processing speed and response time deteriorate
Solution Approach 1:
The system performs preliminary actions by pre-caching metadata and search data from remote storage into local memory before query processing. This allows the remote application to quickly search local cache rather than accessing remote storage for every query, significantly improving query processing speed while maintaining network accessibility and flexibility.
Solution Approach 2:
The patent introduces a local cache as an intermediary between the remote application and remote storage device. This intermediary stores frequently accessed metadata locally, reducing network traffic and query response time. The intermediary enables the remote application to maintain fast query processing speeds while preserving the flexibility and accessibility benefits of remote storage architecture.
Data Source
AI summary
Described is a system and method that provides a mechanism for retrieving data from a storage system using one or more techniques. These techniques may be used in a storage configuration that stores backup or recovery data that may be retrieved by an application agent (e.g. intermediary service) in response to a query from a first device (e.g. client device). When data is stored as backup or recovery data, configurations often employ more cost effective (e.g. lower performance) storage solutions. Accordingly, in order to improve retrieval performance, the system may efficiently cache data. For example, the system may store search data from previous queries in a cache associated with the application agent (e.g. local storage) such that subsequent queries may be fulfilled, at least partially, by searching the cached search data instead of the data residing on the remote backup or recovery storage system.