Reverse Black-Box Testing for Output-Driven Test Coverage

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Software complexity leads to inefficient and resource-intensive testing, with traditional methods failing to discover all issues due to the vast number of possible input combinations, making it difficult to ensure high-quality software applications.

Innovation Solution

Implement reverse testing strategies that utilize N-wise design techniques focusing on output parameters, allowing users to define test cases based on expected results, and analyze user interactions to identify quality issues and improve test coverage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If comprehensive testing of all possible input combinations is performed, then test coverage is improved, but resource consumption and time investment increase significantly

Engineering Contradiction:

Improvetest coverageVSAvoidnumber of test cases

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent inverts the traditional testing approach by starting with expected output values and working backward to determine input values, rather than starting with inputs and predicting outputs. This reverse testing methodology reduces the number of test cases needed while maintaining comprehensive coverage, as testers can focus on critical output scenarios rather than enumerating all possible input combinations.

Inventive Principle:

Principle #13The other way round (Inversion)

Solution Approach 2:

The patent changes the testing parameters from input-focused to output-focused. By specifying output values as the starting point and deriving input values accordingly, the system transforms the testing paradigm to achieve better coverage with fewer test cases, directly addressing the contradiction between comprehensive testing and resource consumption.

Inventive Principle:

Principle #35Parameter changes

2Ease of manufacture

If traditional black-box testing with predefined test cases is used, then testing process is structured, but user-specific issues and exploratory scenarios are not discovered

Engineering Contradiction:

Improvetesting process structureVSAvoiduser-specific test coverage

Core Design Contradiction:

Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent introduces dynamic adaptability into the testing process by allowing users to freely input expected output values without being constrained by predefined test case structures. The system dynamically generates appropriate input values and test scenarios based on user specifications, enabling both structured processing and flexible exploration of user-specific issues.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system enables users to directly specify test outputs and derive their own test cases through the reverse testing mechanism. Users can independently define expected results and the system automatically generates corresponding input scenarios, empowering users to create tailored tests for specific user stories and exploratory scenarios without relying on predefined test suites.

Inventive Principle:

Principle #25Self-service

3Adaptability or versatility

If reverse testing with user-defined outputs is implemented, then user-specific test coverage is improved, but test design complexity increases

Engineering Contradiction:

Improveuser-specific test coverageVSAvoidtest design process

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces the manual mechanical process of designing reverse test cases with an automated computational system. The system automatically calculates appropriate input values, generates test scenarios, and manages test execution based on user-specified output values, eliminating the complexity of manual reverse test design while maintaining high user-specific coverage.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system acts as an intermediary between user requirements and test execution. It receives user-specified output values, automatically generates corresponding input parameters and test cases, and manages the testing process, thereby simplifying the overall test design process while enabling comprehensive user-specific testing coverage.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS12517810B2Reverse testing strategies designed for black-box and exploratory testing

Publication Date: 2026.01.06 SAP SE

AI summary

Methods, software, and systems for generating intelligent data reports include obtaining initial test outputs from test case scenarios defined for the data processing application. Instructions are provided to a user to execute user-defined tests and to obtain a particular test output from the test outputs. The instructions are provided without providing instructions to the user for input values for parameters to be used for obtaining the particular test outputs. The user-defined tests are performed at the data processing application when associated with a test data source. Data is obtained from the executed user-defined tests at the data processing application. A data analysis is performed over the obtained data to evaluate quality of executions of services provided by the data processing application. A quality status is obtained for the services provided by the data processing application.