File System Data Block Reallocation for WAFL Fragmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Network-based storage systems with write anywhere file systems, such as WAFL, suffer from performance degradation due to fragmentation issues, which traditional defragmentation tools are ineffective in addressing, especially when snapshot operations are involved, leading to increased read operations and inefficient use of storage space.

Innovation Solution

A method and system that analyze the physical arrangement of data blocks to determine fragmentation levels and reallocate only those blocks within predefined allocation areas, avoiding duplication and maintaining contiguous spans associated with read-only snapshots, while distributing data blocks evenly across storage devices to improve performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional defragmentation tools are used to rearrange data blocks, then fragmentation is reduced, but data blocks are duplicated and storage space is wasted

Engineering Contradiction:
Improvedefragmentation effectivenessVSAvoidstorage space waste
Core Design Contradiction:
ProductivityVSLoss of substance

Solution Approach 1:

The patent extracts and identifies data blocks that are part of read-only snapshots before performing reallocation. By separating snapshot data blocks from movable data blocks, the system avoids duplicating snapshot data while still achieving defragmentation of active data, thus resolving the contradiction between defragmentation effectiveness and storage space waste

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of traditional defragmentation that moves all data blocks regardless of snapshot status, the patent inverts the approach by selectively moving only non-snapshot data blocks. This inversion prevents duplication of snapshot data while maintaining defragmentation benefits for active data, addressing both productivity and storage space concerns

Inventive Principle:
Principle #13The other way round (Inversion)

2Productivity

If data blocks are reallocated to contiguous positions, then read operations are reduced, but storage space allocation increases

Engineering Contradiction:
Improveread operation efficiencyVSAvoidallocated storage blocks
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent extracts snapshot data blocks from the set of all data blocks and excludes them from reallocation operations. This ensures that only active data blocks are moved to contiguous positions, achieving read operation efficiency improvements without increasing storage space allocation for duplicate snapshot data

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent discards (excludes from reallocation) snapshot data blocks that cannot be moved, while recovering and reallocating only the active data blocks that can be moved to contiguous positions. This selective approach optimizes read performance for active data without wasting space on不可移动's snapshot data

Inventive Principle:
Principle #34Discarding and recovering

3Adaptability or versatility

If write anywhere file system is used, then write flexibility is improved, but fragmentation increases

Engineering Contradiction:
Improvewrite allocation flexibilityVSAvoidfile system performance
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent performs preliminary identification and classification of data blocks into snapshot and active categories before reallocation operations. This preliminary action enables the system to maintain write anywhere flexibility for future operations while preparing a targeted reallocation strategy that addresses fragmentation without sacrificing the flexibility benefits

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different reallocation strategies to different types of data blocks: snapshot data blocks are left unchanged while active data blocks are reallocated to reduce fragmentation. This local differentiation allows the system to maintain write flexibility for new operations while improving performance for existing data, resolving the contradiction between adaptability and productivity

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS7409522B1Method and system for reallocating data in a file system
Publication Date: 2008.08.05 NETAPP INC
  • US7409522B1 patent drawing
  • US7409522B1 patent drawing
  • US7409522B1 patent drawing

AI summary

A method and system for reallocating the data blocks of a logical data entity are described. According to one aspect of the invention, the physical arrangement of data blocks of a logical data entity are analyzed to determine a fragmentation level. Next the fragmentation level is compared with a fragmentation threshold previously assigned to the logical data entity. If the fragmentation level exceeds the fragmentation threshold, only those data blocks of the logical data entity that are within a predefined allocation area having a predetermined number of contiguous data blocks that are not associated with the logical data entity are reallocated.