Content-Indexed Copy Data Search via Elastic Search Integration

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional copy data management systems do not provide transparent information about the content of copies such as snapshots and clones, making it difficult for users to identify and locate specific data within large numbers of copies.

Innovation Solution

Implementing an intelligent copy data management tool that indexes data close to its creation, using storage array capabilities and an elastic search engine to build a content-indexed repository for quick lookup and search functionality, allowing users to access and locate specific data within copies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual search processes are used to identify and locate particular content in copies, then users can find specific information, but the process involves a significant amount of time and effort

Engineering Contradiction:

Improvecontent identification accuracyVSAvoidsearch time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary indexing of copy data at the time of copy creation or shortly thereafter. An intelligent copy data management tool automatically indexes the content of snapshots and clones, building a searchable repository in advance. This preliminary action eliminates the need for time-consuming manual searches later, as users can immediately query the pre-indexed repository to locate specific information.

Inventive Principle:

Principle #10Preliminary action

2Loss of information

If copy data instances are mounted and manually searched, then specific content can be identified, but the process is complex and requires significant user effort

Engineering Contradiction:

Improvecontent visibilityVSAvoidsearch operation simplicity

Core Design Contradiction:

Loss of informationVSEase of operation

Solution Approach 1:

The system introduces an intelligent copy data management tool as an intermediary between users and copy data instances. This mediator automatically indexes copy data and maintains a searchable repository, allowing users to query content without manually mounting or searching through copy instances. The intermediary handles the complex indexing and search operations, simplifying the user experience while improving content visibility.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Quantity of substance

If conventional copy management systems are used, then copies can be created and stored, but the nature and exact content of data in copies remains hidden

Engineering Contradiction:

Improvecopy data volumeVSAvoidcontent transparency

Core Design Contradiction:

Quantity of substanceVSLoss of information

Solution Approach 1:

The system implements feedback mechanisms where the intelligent copy data management tool continuously monitors and indexes copy data content. Users receive feedback about what information is stored in copies through the searchable repository, which provides visibility into the nature and exact content of data in snapshots and clones. This feedback loop transforms the black-box copy management system into a transparent system where users can understand and locate their data.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS10853186B1Content indexed integrated copy data by integrating elastic search and storage system snapshot differential data

Publication Date: 2020.12.01 EMC IP HLDG CO LLC

AI summary

One example method includes creating a copy of a dataset, wherein the dataset is a backup that was previously created and stored. The copy of the dataset may be a clone, or a snapshot. The method further includes indexing a portion of the copy, mounting the copy at a proxy, associating the index with data in the copy, storing the index, and then using the index to search the copy. The search may be performed in response to a request from a user.