Automatic Computing Resource Estimation for Metadata Import

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Metadata discovery and import operations are resource-intensive, and users often initiate these processes without understanding the required resources, leading to potential failures and resource wastage.

Innovation Solution

A method and system for automatically estimating computing resources required for metadata auto-discovery, which involves identifying asset categories and counts, determining import feasibility, and scheduling imports based on historical data and system load to avoid resource exhaustion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If metadata discovery operations are initiated without resource estimation, then users can proceed with import operations freely, but resource exhaustion and operation failures occur

Engineering Contradiction:

Improveease of initiating import operationsVSAvoidsuccess rate of import operations

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The system performs resource estimation and feasibility determination before the actual metadata discovery operation is executed. By calculating required resources and comparing them against available resources in advance, the system identifies potential failures beforehand, allowing users to make informed decisions about whether to proceed with import operations.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If resource estimation and scheduling mechanisms are implemented, then operation failures are minimized, but system complexity increases

Engineering Contradiction:

Improvesuccess rate of import operationsVSAvoidcomplexity of import management system

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system automatically performs resource estimation, feasibility determination, and scheduling without requiring manual intervention. The automated resource estimator and scheduler work independently to assess resource requirements, compare them against available resources, and determine optimal execution timing, reducing the need for complex manual management while improving reliability.

Inventive Principle:

Principle #25Self-service

3Productivity

If metadata discovery operations are executed immediately upon user initiation, then processing speed is maintained, but resource wastage occurs when resources are insufficient

Engineering Contradiction:

Improvespeed of metadata import operationsVSAvoidwastage of computing resources

Core Design Contradiction:

ProductivityVSLoss of energy

Solution Approach 1:

The system applies preliminary anti-action by performing resource estimation and determining import feasibility before executing the metadata discovery operation. When resources are insufficient, the system proactively prevents the operation from starting, thereby avoiding the wastage of computing resources that would be consumed during a failed execution.

Inventive Principle:

Principle #9Preliminary anti-action

Data Source

PatentUS12235863B2Automatic estimation of computing resources for auto-discovery

Publication Date: 2025.02.25 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

A processor may initiate metadata discovery. The processor may identify an asset category and asset count. The processor may determine whether one or more assets can be imported. The processor may determine whether an import was successful. The processor may terminate the import.