File System Query Indexing for Policy Enforcement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current file system policy enforcement is inefficient due to high network latency, bandwidth consumption, and CPU utilization, particularly as the number of files grows, impacting client access to resources.

Innovation Solution

A method and apparatus for generating a query result that identifies files with shared attribute characteristics using a file system query, which includes decoding the query, identifying pre-generated indices, and filtering data to provide efficient query responses, allowing for richer queries and more accurate policy enforcement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If file attribute scanning is performed to obtain current attribute values for policy enforcement, then accurate policy enforcement is achieved, but network latency and bandwidth consumption increase

Engineering Contradiction:
Improvepolicy enforcement accuracyVSAvoidnetwork latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements attribute scanning and indexing operations in advance, before policy enforcement queries are executed. File system attributes are pre-scaned, stored, and organized into indexes, so that when policy enforcement needs to query file attributes, the data is already prepared and readily available, eliminating the need for real-time scanning during policy operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates copies of file attribute data and stores them in pre-generated indexes. Instead of querying the original file system attributes directly during policy enforcement, the system uses these pre-copied attribute values from indexes, which reduces the overhead of accessing and processing attribute data during critical policy operations.

Inventive Principle:
Principle #26Copying

2Loss of information

If comprehensive file attribute scanning is performed across multiple protocols, then complete file information is obtained, but CPU utilization and processing overhead increase

Engineering Contradiction:
Improvefile attribute completenessVSAvoidprocessing efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent divides the file attribute scanning and indexing process into separate, independent operations for different file system protocols. Each protocol's attributes are scanned and indexed separately, allowing parallel processing and reducing the CPU overhead of sequential scanning. The segmentation also enables selective indexing based on protocol-specific requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs comprehensive attribute scanning and index generation in advance, before policy enforcement operations. By completing the expensive scanning and indexing operations beforehand, the system avoids repeated CPU-intensive operations during policy enforcement, thereby improving overall processing efficiency while maintaining complete file information.

Inventive Principle:
Principle #10Preliminary action

3Speed

If pre-generated indices are used to respond to file system queries, then query performance is improved, but device complexity increases

Engineering Contradiction:
Improvequery response speedVSAvoidindex management complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent implements automatic index generation and maintenance mechanisms that operate in advance and continuously. The system automatically creates indexes based on file system attributes and updates them as files change, without requiring manual intervention. This preliminary and continuous index maintenance simplifies the query operation, as the indexing structure is already in place and ready for fast retrieval.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS7805416B1File system query and method of use
Publication Date: 2010.09.28 EMC IP HLDG CO LLC
  • US7805416B1 patent drawing
  • US7805416B1 patent drawing
  • US7805416B1 patent drawing

AI summary

An improved policy enforcement architecture includes several components that improve the performance of policy enforcement in a hierarchical storage environment. A File System Query instruction permits a richer set of queries to be expressed by a policy engine, thereby permitting more complex policies to be implemented with ease. The File System result is generated at the file server, and only files of interest are forwarded to the policy engine. The file system query advantageously may be applied against a pre-generated index having one more characterizing attributes to further reduce the processing required to retrieve policy data. An Index Build instruction, added to a programming interface, allows a policy engine generate the characterizing indices in advance of use. Index maintenance techniques maintain consistency between the index and the file system to ensure that the policy can be enforced using accurate file information.