Asynchronous File System Migration via In-Line Server Replication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing network-based file systems face challenges in seamlessly migrating data from a source file system to a destination file system without interrupting client access or causing performance loss.

Innovation Solution

A data migration system is implemented with a server positioned in-line between clients and the source file system, which transparently replicates file system objects from the source to the destination while clients continue to use the source file system, using asynchronous operations to queue and replay file system requests, ensuring minimal disruption and maintaining data integrity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If synchronous message-based communication is used for file system operations, then data consistency between source and destination is maintained, but client access is interrupted during migration

Engineering Contradiction:
Improvedata consistencyVSAvoidclient access continuity
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent performs preliminary actions by creating a destination file system snapshot before migration begins, and by pre-establishing the asynchronous communication channel. This allows the migration to proceed without interrupting client access to the source file system, as the destination is prepared in advance to receive data asynchronously.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary mechanism - an asynchronous communication channel - that mediates between the source and destination file systems. This channel allows data to be transferred without requiring synchronous acknowledgment, thus maintaining client access continuity while still achieving data consistency through eventual synchronization.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If asynchronous operations are used to replicate file system objects, then client access continues without interruption, but data consistency between source and destination is compromised

Engineering Contradiction:
Improveclient access continuityVSAvoiddata consistency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements feedback mechanisms through acknowledgment messages sent from the destination back to the source via the asynchronous channel. This feedback allows the source to track which operations have been successfully replicated, ensuring data consistency can be verified and maintained even during asynchronous operations.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The destination file system performs preliminary actions by pre-allocating storage space and creating placeholder structures for incoming data. This preliminary preparation ensures that when asynchronous data arrives, it can be immediately integrated without disrupting client access or compromising consistency.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If a server is positioned in-line between clients and source file system, then transparent replication is enabled, but system complexity increases

Engineering Contradiction:
Improvetransparent operationVSAvoidsystem architecture
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The in-line server is designed with multi-functionality, serving both as a transparent gateway for client access and as a replication coordination point. By combining these functions in a single component, the patent reduces overall system complexity compared to having separate transparent proxy and replication management systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9304997B2Asynchronously migrating a file system
Publication Date: 2016.04.05 NETAPP INC
  • US9304997B2 patent drawing
  • US9304997B2 patent drawing
  • US9304997B2 patent drawing

AI summary

A system for migrating data from a source file system to a destination file system, in a manner that is transparent and seamless to clients of the source file system.