Automated Workflow Validation via Test Document Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current workflow management systems lack the flexibility to effectively validate complex business processes, which can lead to difficulties in ensuring that workflows operate as expected and maintain accurate history records.

Innovation Solution

A networked environment with a workflow engine, test engine, and synthesis engine facilitates the validation of workflows by creating test documents based on prior instances, ensuring that workflow instances follow the correct paths and maintain accurate history records through automated testing and synthesis of testing scenarios.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If current workflow management technologies are used to validate complex business processes, then the system structure remains simple, but the validation capability and flexibility are insufficient

Engineering Contradiction:
Improvevalidation capabilityVSAvoidsystem structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The workflow validation system is segmented into distinct functional modules: a workflow engine for executing workflows, a test engine for managing test cases and validating workflow instances, and a synthesis engine for generating test documents from workflow definitions. This segmentation allows each component to specialize in specific validation tasks, enhancing overall validation capability while maintaining manageable system complexity through clear separation of concerns.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary components including a test document that serves as a mediator between the workflow definition and validation execution, and a workflow history that mediates between workflow instances and validation results. These intermediaries enable flexible validation by decoupling the validation logic from the workflow execution, allowing the system to adapt to complex business processes without requiring fundamental structural changes.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If manual validation methods are used for workflow instances, then the system complexity remains low, but the accuracy and reliability of validation results deteriorate

Engineering Contradiction:
Improvevalidation accuracyVSAvoidvalidation system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements feedback mechanisms where the test engine executes test cases against workflow instances and compares actual results with expected outcomes defined in test documents. The workflow history records validation results and feeds back into the synthesis engine, which uses this feedback to generate improved test documents. This closed-loop feedback system continuously enhances validation accuracy while automating the process to manage complexity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The synthesis engine performs self-service by automatically generating test documents from workflow definitions and execution history without requiring manual intervention. The test engine autonomously executes validation cases and produces validation reports, enabling the system to maintain high reliability through automated, consistent validation while reducing the operational complexity associated with manual validation processes.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If comprehensive testing of all workflow paths is performed, then validation coverage is improved, but the time and resources required increase significantly

Engineering Contradiction:
Improvevalidation coverageVSAvoidvalidation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by using the synthesis engine to analyze workflow definitions and execution history before actual validation, generating optimized test documents that identify critical validation paths in advance. This preliminary analysis enables the test engine to focus validation efforts on the most important workflow paths, achieving comprehensive validation coverage for critical scenarios while significantly reducing the time and resources required compared to exhaustive testing of all possible paths.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9170821B1Automating workflow validation
Publication Date: 2015.10.27 AMAZON TECH INC
  • US9170821B1 patent drawing
  • US9170821B1 patent drawing
  • US9170821B1 patent drawing

AI summary

A test document associated with a workflow definition is obtained, the test document including an input for an action of the workflow definition and an expected state for the workflow definition based on the input. The input is delivered for the action of a workflow instance, the workflow instance being an instance of the workflow definition executed by a workflow engine, and the action determined based upon a present state of the workflow instance. A next state of the workflow instance is obtained, where the next state is determined by the workflow engine based upon the present state, the action and the input. The next state of the workflow instance is compared to the expected state of the test document.