Concurrent Exploratory Testing Across Multiple System Landscapes

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Testing new applications on multiple system landscapes is time-consuming and prone to inconsistencies, especially when manual testing is required, and automated testing faces challenges in predefining expected outputs for newly developed application capabilities and user interfaces.

Innovation Solution

A computer-implemented method that identifies instructions to test multiple system landscapes, executes tests on a subset, validates responses, and compares them to a validated response from a single system landscape, allowing for simultaneous and concurrent exploratory testing across various system combinations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual testing is performed on multiple system landscapes, then testing coverage is improved, but time consumption and resource requirements increase significantly

Engineering Contradiction:

Improvetesting coverageVSAvoidtime consumption

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the testing process into distinct phases: automated execution phase where test scripts run across multiple system landscapes simultaneously, and human validation phase where experts review results. This segmentation allows parallel processing of tests across different landscapes while concentrating human effort only on result validation, thereby maintaining comprehensive coverage without proportional increase in time consumption.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent creates virtual copies of system landscapes through virtualization technology, allowing multiple test environments to be replicated and tested concurrently. Instead of physically testing each landscape separately, virtual instances enable simultaneous testing across numerous configurations, dramatically reducing the time required while maintaining thorough coverage.

Inventive Principle:

Principle #26Copying

2Productivity

If automated testing is used across multiple system landscapes, then time efficiency is improved, but difficulty in predefining expected outputs for new capabilities increases

Engineering Contradiction:

Improvetime efficiencyVSAvoidcomplexity of predefining expected outputs

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent applies partial automation by automating only the test execution and data collection phases, while leaving the validation and verification phases for human experts. This partial approach avoids the complexity of fully automating the predefinition of expected outputs for new capabilities, while still achieving time efficiency gains from automated execution.

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The system enables self-service testing where test scripts automatically execute across multiple landscapes and collect results without requiring predefinition of expected outputs. The automated system serves itself by running tests and gathering data, while human experts subsequently validate the results, eliminating the need for complex predefinition while maintaining productivity.

Inventive Principle:

Principle #25Self-service

3Reliability

If comprehensive testing of all system landscape combinations is performed, then consistency and reliability are improved, but resource requirements and testing complexity increase

Engineering Contradiction:

ImproveconsistencyVSAvoidtesting complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a universal testing framework that can operate across multiple system landscapes simultaneously using the same test scripts and validation processes. This multi-functional approach ensures consistency across all landscapes without requiring separate testing procedures for each combination, thereby maintaining reliability while reducing overall testing complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system incorporates feedback mechanisms where test results from one system landscape inform and validate results from other landscapes. By comparing results across landscapes and providing feedback loops, the system ensures consistency without requiring exhaustive manual verification of every combination, thus maintaining reliability while managing complexity.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS10296450B2Exploratory testing on multiple system landscapes

Publication Date: 2019.05.21 SAP PORTALS ISRAEL

AI summary

The present disclosure involves systems, software, and computer implemented methods for testing applications on multiple system landscapes. In one example, a method may include identifying instructions to test a plurality of system landscapes, executing a test of a first system landscape from the plurality of system landscapes, validating a response received from the first system landscape by a user associated with the testing, executing tests of at least a subset of the remaining plurality of system landscapes which includes sending requests including the predefined input to the entry point of each of the subset of the remaining plurality of system landscapes, receiving responses from the subset of the remaining plurality of system landscapes, and comparing each received response to the validated response from the first system landscape, and in response to the comparison, generating a result set of the comparison of each received response to the validated response.