Generic Query Templates for Data Stream Processing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data stream management systems require manual and time-consuming processes to create and update queries, especially when dealing with multiple input streams, which limits their efficiency and flexibility.

Innovation Solution

The implementation of generic query templates with placeholders and an orchestration mechanism allows for the automatic generation of deployable queries from a single template, supporting an arbitrary number of input streams and enabling flexible substitution of query template segments with arbitrary logic, independent of specific query languages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual query creation processes are used for data stream management systems, then query accuracy can be maintained, but time consumption and operational complexity increase significantly

Engineering Contradiction:

Improvequery accuracyVSAvoidtime consumption

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-defines query templates with common query patterns and structures stored in a repository. These templates contain placeholder parameters that can be automatically instantiated with specific values, eliminating the need to manually create queries from scratch each time and significantly reducing time consumption while maintaining accuracy through proven query patterns

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system creates query instances by copying and instantiating pre-defined query templates. Instead of manually creating each query, the system generates new queries by substituting parameters in existing validated templates, which maintains query accuracy while dramatically reducing the time and effort required for query creation

Inventive Principle:

Principle #26Copying

2Reliability

If manual query creation is used, then query correctness can be ensured, but productivity and output per unit time decrease

Engineering Contradiction:

Improvequery correctnessVSAvoidquery creation efficiency

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

Query templates are pre-defined and validated in advance, containing correct query structures and logic. When a query is needed, the system instantiates the appropriate template with specific parameters, ensuring correctness is inherited from the validated template while enabling rapid query generation for high productivity

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system copies proven query patterns from templates to create new queries. This copying mechanism ensures that each generated query inherits the correctness and validity of its source template, while the automated instantiation process enables rapid production of multiple queries without manual verification

Inventive Principle:

Principle #26Copying

3Productivity

If generic query templates with placeholders are implemented, then query creation efficiency improves, but system complexity increases

Engineering Contradiction:

Improvequery creation efficiencyVSAvoidsystem complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system segments queries into template definitions and parameter instantiations. The query template repository stores reusable query patterns, while the instantiation mechanism handles parameter substitution. This segmentation allows efficient query creation through template reuse while managing complexity by separating query structure from specific parameters

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Query templates are designed to be universal and reusable across multiple contexts. A single template can serve multiple query needs by accepting different parameter values, reducing the total number of queries that need to be maintained and simplifying the system despite the added template management capability

Inventive Principle:

Principle #6Universality (Multi-functionality)

4Ease of manufacture

If existing data stream management systems are used without generic templates, then implementation simplicity is maintained, but adaptability to different query scenarios decreases

Engineering Contradiction:

Improveimplementation simplicityVSAvoidquery flexibility

Core Design Contradiction:

Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The query template repository stores versatile templates that can adapt to different query scenarios through parameter substitution. This universal approach maintains implementation simplicity by using a standardized template instantiation process while providing high adaptability to handle diverse query requirements across different data stream management scenarios

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS9836509B2Generic query templates for complex event processing and data stream systems

Publication Date: 2017.12.05 SAP SE

AI summary

Systems and methods provide for queries with an arbitrary number of input streams to be created from a generic query template, during runtime, based on, for example, configuration parameters provided by the system or a user. The generic query templates include a generic query template string, query template segments, and an orchestration mechanism for automatic query template generation. The systems and methods of the present invention provide for the substitution of concrete input streams, counters (e.g., stream indices) and query template segments (which can include further placeholders) into the generic query templates. Further, the input placeholders of the generic query template provide for any part of the query template to be substituted with arbitrary logic. Also, the orchestration process is query language independent and can be applied (and extended) for any query language.