Query Migrator Prevents Federated Query Failures

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Federated systems face query failures due to data sources updating their query models, leading to breakdowns when clients continue to send queries in outdated formats, especially in large-scale data federation scenarios where automated testing is complex and challenging, especially in Platform-as-a-Service (PaaS) solutions with numerous clients.

Innovation Solution

A query migrator system that intercepts federated queries, determines query failures using a query statistics database, and migrates queries to align with the updated data source query models, ensuring transparency to clients and preventing query failures by substituting invalid queries with valid ones.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If automated testing is used to detect query model changes, then query failures can be identified, but the complexity of the system increases significantly

Engineering Contradiction:

Improvequery failure detectionVSAvoidsystem complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces a query migrator as an intermediary component between clients and data sources. This migrator intercepts queries, detects failures by comparing against stored successful queries, and automatically migrates failed queries to match updated data source query models. This intermediary approach provides reliable failure detection without requiring complex automated testing infrastructure at the data source level.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by storing successful query examples in a database before failures occur. When a query failure is detected, the system uses these pre-stored successful queries as templates to automatically generate migrated versions. This preliminary preparation eliminates the need for complex real-time testing and analysis during failure scenarios.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If data sources update their query models, then they can adapt to new requirements, but existing client queries fail

Engineering Contradiction:

Improvedata source query model updatesVSAvoidquery execution success

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the system monitors query execution results and detects failures. When a failure occurs, the system retrieves stored successful queries, compares them with the failed query, and automatically generates a migrated version. This closed-loop feedback ensures that data source adaptability does not compromise query execution reliability.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system handles query model changes by modifying query parameters and structure to match updated data source requirements. The query migrator analyzes the differences between old and new query models and automatically adjusts query parameters, column names, table structures, and other elements to ensure compatibility while preserving the original query intent.

Inventive Principle:

Principle #35Parameter changes

3Productivity

If multiple autonomous data sources are added to the federation, then system capability increases, but the probability of query failures increases

Engineering Contradiction:

Improvedata federation capabilityVSAvoidquery failure probability

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent divides the federated system into independent segments, each with its own query migrator instance. Each migrator manages queries for specific data sources autonomously, storing and comparing queries locally. This segmentation isolates failures to individual data sources, preventing cascading failures across the entire federation while maintaining overall system capability.

Inventive Principle:

Principle #1Segmentation

4Ease of operation

If clients continue to send queries in outdated formats, then client compatibility is maintained, but query failures occur at updated data sources

Engineering Contradiction:

Improveclient query compatibilityVSAvoidquery execution success

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The query migrator acts as an intermediary that transparently translates between outdated client query formats and updated data source query models. Clients continue to send queries in their original formats without modification, while the migrator automatically adapts them before forwarding to data sources. This preserves client ease of operation while ensuring query execution success.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS10089350B2Proactive query migration to prevent failures

Publication Date: 2018.10.02 RED HAT INC

AI summary

A method of processing a federated query includes receiving a first federated query from a first client and receiving a second federated query from a second client. The first federated query includes a first source query that is in accordance with a target data source's query model, and the second federated query includes a second source query. The method also includes sending the second source query to the target data source and determining whether the second source query has failed at the target data source. The method further includes in response to determining that the second source query has failed, migrating the second source query in accordance with the first source query.