Continuous Query Analysis System with Synchronized Event Debugging

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current systems for analyzing continuous queries over data streams lack the ability to effectively compare the output event streams from original and modified queries, making it difficult to determine how the output event stream changes with query modifications, why expected events do not occur, and how sensitive the query results are to the starting point of evaluation.

Innovation Solution

An analysis system that synchronizes the execution of original and modified continuous queries, allowing for parallel or interlocked execution to compare output data streams and identify differences, with features like implicit breakpoints, synchronization points, and graphical user interfaces to highlight operator graph differences, enabling conclusions about query modifications and result stability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional program debugging approaches are used with breakpoints on instruction code, then program execution can be stopped and inspected, but continuous query execution cannot be effectively stopped and inspected at data flow points

Engineering Contradiction:

Improvedebugging capabilityVSAvoidapplicability to continuous queries

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent inverts the traditional debugging approach by placing breakpoints on data flow (events) rather than on instruction flow (code). Instead of stopping execution at specific code locations, the system stops when specific events occur in the data stream, allowing debugging of continuous queries in a manner adapted to their event-driven nature.

Inventive Principle:

Principle #13The other way round (Inversion)

Solution Approach 2:

The patent introduces an intermediary debugging system that sits between the continuous query execution and the event stream. This intermediary captures events, manages breakpoints on event types, and provides inspection capabilities without disrupting the underlying query execution engine, enabling debugging functionality tailored to continuous queries.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of operation

If breakpoints are set between operators in the operator graph, then query execution can be stopped for inspection, but the ability to compare original and modified query outputs is lost

Engineering Contradiction:

Improvequery inspection capabilityVSAvoidoutput stream comparison data

Core Design Contradiction:

Ease of operationVSLoss of information

Solution Approach 1:

The patent performs preliminary actions by recording and storing the output events from both the original and modified continuous queries before comparison is needed. This allows the system to have the comparison data ready when the user requests analysis, rather than attempting to capture and compare streams in real-time during query execution.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent creates copies of the output event streams from both the original and modified queries. These copied streams are stored and can be compared against each other, allowing the system to analyze differences between query versions without interfering with the actual query executions or losing the original stream data.

Inventive Principle:

Principle #26Copying

3Productivity

If continuous queries are executed on infinite data streams, then real-time processing is achieved, but the ability to replay and re-analyze from different starting points is lost

Engineering Contradiction:

Improvereal-time processing speedVSAvoidreplay capability

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent creates copies of the input event stream for replay purposes. These copied streams can be replayed from different starting points or at different speeds for analysis, while the original stream continues to be processed in real-time. This separation allows both real-time processing and flexible replay/analysis capabilities to coexist.

Inventive Principle:

Principle #26Copying

Data Source

PatentUS8346511B2Analysis system and method for analyzing continuous queries for data streams

Publication Date: 2013.01.01 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Certain example embodiments concern an analysis system for analyzing at least one continuous query for at least one input data stream. The at least one input data stream includes a sequence of events captured by at least one sensor. The debugging system includes an analyzer for executing the at least one continuous query and at least one modified continuous query on the at least one input data stream, for comparing at least one output data stream produced by the at least one continuous query with at least one second output data stream produced by the at least one modified continuous query, and for indicating at least one difference between the at least one output data stream and the at least one second output data stream. The analyzer synchronizes the execution of the at least one continuous query and the at least one modified continuous query.