Search Index Segmentation for Metadata Update Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing search systems face inefficiencies in resource utilization due to redundant updates of content field entries when metadata changes occur, and fail to satisfactorily respond to queries requiring both content and metadata criteria due to uncoupled indexes, leading to increased implementation and maintenance costs.

Innovation Solution

A computer-implemented method that queries separate content and metadata indexes, assigns unique and additional identifiers to objects, and uses logical operators to correlate these identifiers, eliminating the need for costly mapping databases and preventing redundant updates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If content field entries and metadata field entries are coupled in a single search index, then updates are simplified, but redundant updates of content field entries occur when only metadata changes, wasting computing resources

Engineering Contradiction:
Improveupdate simplicityVSAvoidcomputing resource waste
Core Design Contradiction:
Ease of operationVSLoss of energy

Solution Approach 1:

The patent divides the search index into separate content field entries and metadata field entries. When metadata changes, only the metadata field entries are updated while content field entries remain unchanged, eliminating redundant updates and computing resource waste while maintaining update simplicity through the unified index structure.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different update behaviors to different parts of the index based on the type of change. Content field entries are updated only when content changes, while metadata field entries are updated when metadata changes. This localized update strategy prevents unnecessary computations while maintaining the simplicity of a unified index structure.

Inventive Principle:
Principle #3Local quality

2Loss of energy

If content field entries and metadata field entries are uncoupled into separate search indexes, then redundant updates are avoided, but the system cannot satisfactorily respond to queries requiring both content and metadata criteria

Engineering Contradiction:
Improvecomputing resource efficiencyVSAvoidquery accuracy
Core Design Contradiction:
Loss of energyVSReliability

Solution Approach 1:

The patent introduces a correlation mechanism that acts as an intermediary between separate content and metadata indexes. This correlation structure enables the system to efficiently join results from both indexes based on object identifiers, allowing accurate responses to queries requiring both content and metadata criteria while maintaining the efficiency benefits of separate indexes.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If a mapping database is added to correlate content and metadata indexes, then query accuracy is improved, but implementation and maintenance costs substantially increase

Engineering Contradiction:
Improvequery accuracyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the correlation functionality from a separate mapping database and integrates it directly into the index structure through correlation fields within the unified search index. This eliminates the need for a standalone mapping database, reducing implementation and maintenance costs while maintaining query accuracy through efficient identifier-based correlation.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8805820B1Systems and methods for facilitating searches involving multiple indexes
Publication Date: 2014.08.12 EMC IP HLDG CO LLC
  • US8805820B1 patent drawing
  • US8805820B1 patent drawing
  • US8805820B1 patent drawing

AI summary

What is disclosed includes a method for searching objects in response to a query that includes a first set of criteria pertaining to a first index, a second set of criteria pertaining to a second index, and logic joining the first set of criteria and the second set of criteria. The method includes querying the first and second indexes based on the first and second set of criteria, respectively, to obtain a first set of first-identifier values and a first set of second-identifier values, respectively. The method also includes correlating the first set of second-identifier values with a set of unique-identifier values and/or a second set of first-identifier values. The method also includes using the logic and, the set of unique-identifier values, and/or the second set of first-identifier values to determine a set of matched objects.