Multi-Protocol Caching Filer Sparse Volume Storage Virtualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional data replication methods require significant administrative overhead and infrastructure, making them impractical for large data sets and preventing server consolidation, while existing proxy caching solutions limit access to read-only data and require continuous administrative management.
Innovation Solution
A network caching system with a multi-protocol caching filer that uses a sparse volume cache, allowing transparent access to data across multiple storage systems by translating client requests into generic file system operations and retrieving missing data from an origin server, enabling efficient access and storage virtualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional data replication mirroring is used to create read-only copies of data sets on distributed servers, then data availability to remote users is improved, but administrative overhead and infrastructure complexity increase significantly
Solution Approach 1:
The patent introduces a caching filer as an intermediary component between clients and the origin server. This caching filer maintains a cache of data blocks and handles client requests locally when possible, reducing the need for complex replication infrastructure while maintaining data availability. The caching filer acts as a mediator that can serve data from its local cache or forward requests to the origin server.
Solution Approach 2:
Instead of creating complete read-only mirror copies of entire data sets on distributed servers, the patent implements block-level caching where only frequently accessed data blocks are replicated and stored in the caching filer's cache. This selective copying approach reduces the infrastructure complexity while maintaining data availability for remote users.
2Speed
If file system mirroring is used to replicate critical data to remote locations, then immediate access to data is improved, but the replication infrastructure requires servers in remote locations preventing consolidation
Solution Approach 1:
The patent consolidates the caching functionality into a single caching filer that can serve multiple clients, rather than distributing mirror servers across multiple locations. This merging of resources maintains fast data access through local caching while enabling server consolidation to a central location, eliminating the need for distributed mirror servers.
Solution Approach 2:
The caching filer serves multiple functions: it acts as a cache for frequently accessed data blocks, a protocol translator between different client protocols and the origin server protocol, and a gateway to the origin server. This multi-functionality allows a single consolidated server to provide fast data access to multiple remote users without requiring distributed infrastructure.
3Ease of operation
If proxy caching is used to transparently replicate data sets on demand, then administrative overhead is reduced, but access is limited to read-only data
Solution Approach 1:
The caching filer acts as an intermediary that can handle both read and write operations. When a client writes data, the caching filer stores the write operation in its cache and can serve subsequent reads from the cache without requiring the data to be immediately replicated to the origin server. This mediator approach enables write access while maintaining the benefits of on-demand replication.
Solution Approach 2:
The system performs preliminary actions by caching data blocks before they are needed (read-ahead caching) and by pre-processing write operations in the cache. This allows the system to prepare data in advance, enabling both read and write access to be served from the cache without immediate replication to the origin server, thus providing write access capability while reducing administrative overhead.
Data Source
AI summary
A network caching system has a multi-protocol caching filer coupled to an origin server to provide storage virtualization of data served by the filer in response to data access requests issued by multi-protocol clients over a computer network. The multi-protocol caching filer includes a file system configured to manage a sparse volume that “virtualizes” a storage space of the data to thereby provide a cache function that enables access to data by the multi-protocol clients. To that end, the caching filer further includes a multi-protocol engine configured to translate the multi-protocol client data access requests into generic file system primitive operations executable by both the caching filer and the origin server.