Transparent Qtree Quota Metadata Transfer in Logical Replication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Logical replication of volumes with quota structures in network storage systems often results in prolonged service disruptions due to the need for rescanning and updating quota accounting, especially when moving volumes between different file system types, leading to unreliable and delayed file/block usage control.

Innovation Solution

The technique involves sending quota metadata separately during logical replication, allowing the destination to dynamically create and update its own quota accounting in real-time, ensuring immediate and reliable quota control upon completion of the copy/move operation without requiring user intervention or volume remounting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If logical replication is used to copy/move volumes between different file system types, then adaptability and versatility are improved, but service disruption time increases due to required rescanning and quota accounting updates

Engineering Contradiction:
Improveability to copy/move volumes between different file system typesVSAvoidservice disruption time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by sending quota metadata from source to destination before completing the volume copy/move operation. This allows the destination to pre-configure quota structures, so when the volume is fully replicated, quota control is immediately active without requiring time-consuming rescans or service disruption.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If quota accounting is updated after volume copy/move completion, then manufacturing precision is maintained, but reliability of quota control deteriorates due to delayed enforcement

Engineering Contradiction:
Improvequota accounting accuracyVSAvoidquota control reliability
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

Quota metadata including accounting information is transferred in advance during the replication process rather than being generated after completion. This preliminary transfer ensures that quota control is reliable and immediately enforceable upon volume availability, while maintaining precision through the use of accurate source quota data.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If traditional physical block level replication is used, then reliability of quota control is maintained, but adaptability to different file system formats deteriorates

Engineering Contradiction:
Improvequota control reliabilityVSAvoidcompatibility across different file system formats
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

Instead of physical block-level copying, the system uses logical replication that copies data at the file system level, allowing the same volume to be replicated across different file system formats (e.g., FlexVol to striped file system). Quota metadata is separately transferred to maintain reliability of quota control regardless of the underlying file system format differences.

Inventive Principle:
Principle #26Copying

4Manufacturing precision

If volume remounting and reinitialization is required at destination, then manufacturing precision is ensured, but ease of operation deteriorates

Engineering Contradiction:
Improvequota structure integrityVSAvoidoperational transparency
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

All necessary quota metadata and accounting information is transferred preliminarily during the replication process. This eliminates the need for post-replication remounting or reinitialization operations at the destination, making the copy/move operation transparent to users while preserving quota structure integrity through the use of validated source metadata.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8078816B1Transparent transfer of qtree and quota metadata in conjunction with logical replication of user data
Publication Date: 2011.12.13 NETAPP INC
  • US8078816B1 patent drawing
  • US8078816B1 patent drawing
  • US8078816B1 patent drawing

AI summary

A technique that provides the ability to copy or move a volume that includes one or more quota structures, by using logical replication, where the volume and any quota structures in it are immediately accessible upon completion of the copy/move operation, and where the quota structures' usage control functionality is immediately functional and reliable upon completion of the copy/move operation. A user does not have to reinitialize the quota mechanism or invoke a quota scanner at the destination.