File Directory Indexing for Query Performance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing indexing methods in database systems lead to increased size and complexity, which can counteract their benefits, especially in large enterprise systems, where smaller index sizes are crucial for system success.

Innovation Solution

A system that indexes file directories by creating an index based on an index key and analyzing files and directories, using a two-query process to efficiently locate files, reducing index size and overhead through incremental aggregation of metadata and caching mechanisms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If traditional indexing methods are used to improve query performance, then query speed is improved, but index size and complexity increase

Engineering Contradiction:
Improvequery performanceVSAvoidindex size
Core Design Contradiction:
SpeedVSVolume of stationary object

Solution Approach 1:

The patent segments the indexing process by creating separate index structures for different query types. It uses a first index for directory-level searches and a second index for file-level searches within directories. This segmentation allows each index to be optimized for its specific purpose, reducing overall complexity and size while maintaining fast query performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the necessary metadata information from the complete file system structure to create the indexes. Instead of indexing all file attributes, it selectively extracts and indexes only the metadata fields needed for efficient queries, such as directory paths, file types, and creation dates, thereby reducing index size while preserving query performance.

Inventive Principle:
Principle #2Taking out (Extraction)

2Loss of time

If indexes are created to enable fast file location, then query time is reduced, but system complexity and overhead increase

Engineering Contradiction:
Improvefile location timeVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent divides the indexing system into distinct components: a first index for directory navigation and a second index for file identification. This segmentation simplifies the overall system by making each index manageable and easier to maintain, while together they provide fast file location capabilities.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary indexing of directory metadata and file references during system initialization or scheduled maintenance periods. By pre-building the index structures in advance, the system avoids the complexity of dynamic index updates during normal operation, reducing real-time system complexity while enabling fast query responses.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If comprehensive metadata is indexed to improve search accuracy, then query precision is improved, but index size increases

Engineering Contradiction:
Improvesearch accuracyVSAvoidindex size
Core Design Contradiction:
Measurement precisionVSVolume of stationary object

Solution Approach 1:

The patent extracts and indexes only the essential metadata fields necessary for accurate file searches, such as directory paths, file names, file types, and modification dates. It deliberately excludes unnecessary metadata like complete file contents, permission details, and other granular information, thereby maintaining high search accuracy while minimizing index size.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different indexing strategies to different levels of the file system hierarchy. Directory-level metadata is indexed with different granularity than file-level metadata. This local quality approach allows the system to index only the level of detail needed for each specific query type, reducing overall index size while maintaining appropriate search accuracy for each level.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11586586B2Indexes and queries for files by indexing file directories
Publication Date: 2023.02.21 EMC IP HLDG CO LLC
  • US11586586B2 patent drawing
  • US11586586B2 patent drawing
  • US11586586B2 patent drawing

AI summary

The described technology is generally directed towards improving indexes and queries for files by indexing file directories. According to an embodiment, a system can comprise a memory and a processor that can execute the components stored in the memory. The components can comprise a data interface to couple to a database system comprising a database storing metadata describing a file system, wherein the database comprises records that correspond to ones of directories of the file system, and wherein the records comprise a field that corresponds to files logically stored in the directories of the file system. The system can further comprise an indexing component that creates an index for the records based on an index key and an analysis of the ones of the files and the directories to which the records correspond, wherein the index comprises links between instances of the index key and ones of the directories. Further, the system can comprise a query component that queries the database for a file of the file system by employing a search key and the index.