File System Metadata Summarization for Storage Area Network Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional storage area network management applications face inefficiencies in collecting and processing file system information, particularly in large environments with heavy processing loads, as they rely on agents to exhaustively collect and transfer metadata, overwhelming network bandwidth and server processing resources.

Innovation Solution

Implementing a file system data collection and processing architecture where agent processes on host computer systems collect and pre-process file system metadata, reducing the burden on central server processes by producing summary records that contain essential statistical information, thereby offloading processing requirements and improving network performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If agents exhaustively collect and transfer all file system metadata to the central server, then complete file system information is obtained, but network bandwidth is overwhelmed and server processing resources are overloaded

Engineering Contradiction:
Improvefile system information completenessVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Loss of informationVSLoss of energy

Solution Approach 1:

The patent extracts only the essential statistical information (summarized file system data) from the complete file system metadata, transferring only this condensed information to the central server. This extraction principle resolves the contradiction by maintaining information completeness at the server level while dramatically reducing network bandwidth consumption during data transfer.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The agent creates a summarized copy of the file system metadata containing only essential statistical information rather than transferring the complete original metadata. This copying approach preserves the necessary information for server-side processing while minimizing network bandwidth usage.

Inventive Principle:
Principle #26Copying

2Loss of information

If agents exhaustively collect and transfer all file system metadata to the central server, then complete file system information is obtained, but server processing load increases significantly

Engineering Contradiction:
Improvefile system information completenessVSAvoidserver processing efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The agent performs preliminary processing of file system metadata locally, calculating and summarizing statistical information before transfer to the server. This preliminary action resolves the contradiction by ensuring information completeness is achieved at the agent level, thereby reducing the processing burden on the server.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the file system data processing task between the agent (local summarization) and the server (received summary processing). This segmentation resolves the contradiction by distributing processing responsibilities, maintaining information completeness while improving server processing efficiency.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If agents collect detailed file system metadata, then comprehensive storage analysis is enabled, but network bandwidth is consumed excessively

Engineering Contradiction:
Improvestorage statistics accuracyVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent changes the parameter representation of file system data from detailed individual file metadata to aggregated statistical parameters (summarized information). This parameter transformation resolves the contradiction by maintaining measurement precision for storage statistics while dramatically reducing network bandwidth consumption.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS7539706B1Methods and apparatus for collecting and processing file system data
Publication Date: 2009.05.26 EMC IP HLDG CO LLC
  • US7539706B1 patent drawing
  • US7539706B1 patent drawing
  • US7539706B1 patent drawing

AI summary

A storage area network management application provides a data collection agent that processes storage information concerning storage entities such as file systems in a storage area network environment by receiving a data collection policy identifying storage information to be collected concerning a set of storage entities in a storage area network environment. The agent collects storage information concerning the set of storage entities according to the data collection policy and processes the collected storage information to produce at least one summary record of the storage information for the set of storage entities. The summary record(s) contain a summary of the collected storage information for the set of storage entities calculated according to the data collection policy. The agent transfers the summary record(s) from the data collection agent to a storage management application for presentation to a user of the storage management application. This offloads processing requirements of the management application to the agents.