Declarative Engine for Workloads Resilience Testing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing database systems face challenges in efficiently authoring and executing complex workloads for resilience testing, as current methods require extensive coding and resource management, making it time-consuming and resource-intensive to express concurrency and parallelism effectively.

Innovation Solution

A declarative engine for workloads (DEW) framework that allows users to author scripts using declarative and programmatic expressions, enabling the specification of complex concurrency and parallelism without traditional concurrency techniques, with a runtime engine that executes these scripts efficiently, managing resources and optimizing execution plans.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If traditional concurrency techniques are used to author complex workloads, then execution capability is achieved, but coding complexity and time consumption increase significantly

Engineering Contradiction:
Improveease of script authoringVSAvoidcoding complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent replaces traditional programmatic concurrency techniques (mechanical coding approach) with a declarative specification approach. Instead of manually coding complex concurrency logic, users declare the desired workload behavior in a simplified syntax, and the system automatically generates the execution plan, thereby reducing coding complexity while maintaining execution capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a declarative engine as an intermediary between the user's simple workload specification and the complex execution infrastructure. This engine translates high-level declarative statements into detailed execution plans, acting as a mediator that handles the complexity transformation automatically without requiring users to write complex code.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If comprehensive resilience testing is implemented, then system reliability improves, but resource consumption and time requirements increase

Engineering Contradiction:
Improvesystem reliabilityVSAvoidtesting efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent enables preliminary definition of resilience testing scenarios through declarative specifications. Users can pre-define various failure modes, workload patterns, and testing parameters in a simplified format before execution, allowing the system to automatically generate and run comprehensive resilience tests without manual intervention during execution, thereby improving testing efficiency while maintaining comprehensive coverage.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If complex concurrency is expressed using traditional methods, then execution accuracy is achieved, but time consumption increases

Engineering Contradiction:
Improveexecution accuracyVSAvoidscript authoring time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent substitutes manual programmatic approaches with automated declarative specification. The simplified declarative syntax allows users to express complex concurrency requirements quickly, and the system's automatic plan generation ensures execution accuracy is maintained through systematic translation and validation processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses templates and predefined patterns for common workload scenarios. Instead of writing complex concurrency logic from scratch, users can copy and adapt standardized declarative templates, which are then automatically instantiated with specific parameters, ensuring both accuracy and speed in script authoring.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11762702B1Resilience testing using a declarative engine for workloads (DEW)
Publication Date: 2023.09.19 SNOWFLAKE INC
  • US11762702B1 patent drawing
  • US11762702B1 patent drawing
  • US11762702B1 patent drawing

AI summary

Provided herein are systems and methods for resilience testing using a DEW. A system includes at least one hardware processor coupled to a memory and configured to decode a workflow to obtain a plurality of workflow steps. Each workflow step of the plurality of workflow steps includes a runtime engine identifier and a script identifier. A script for a workflow step of the plurality of workflow steps is retrieved based on the script identifier. The script specifies a plurality of tasks. One or more containers are configured with a runtime engine based on the runtime engine identifier. The script executes against the one or more containers using the runtime engine, to perform the plurality of tasks.