Automated Black Box Test Case Generation and Optimization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Black box testing lacks effective measurement of code coverage, leading to inefficient test suite evaluation, redundant test executions, and manual effort in creating and maintaining test cases, which hampers the quality of testing.

Innovation Solution

A computer-implemented method and system for automatically generating and optimizing test cases based on business models, determining minimal path coverage, and obtaining code coverage data to prioritize and optimize test cases for effective black box testing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual test cases are created and executed, then testing can be performed, but manual effort in designing and maintaining test cases increases and efficiency decreases

Engineering Contradiction:

Improvetesting efficiencyVSAvoidmanual effort in designing and maintaining test cases

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system enables self-service test case generation by automatically creating test cases from business models without requiring manual authoring. The automated system serves itself by generating, executing, and analyzing test cases based on predefined business logic and parameters, eliminating the need for manual test case design and maintenance while improving testing efficiency

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual process of test case creation with an automated computational system. The mechanical effort of manually designing and maintaining test cases is substituted by an automated system that generates test cases algorithmically from business models, thereby reducing manual effort and increasing testing productivity

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If black box testing is performed without code coverage data, then testing can be conducted, but effectiveness of test suite cannot be measured and redundant test executions occur

Engineering Contradiction:

Improvetesting effectiveness measurementVSAvoidcode coverage percentage knowledge

Core Design Contradiction:

ReliabilityVSLoss of information

Solution Approach 1:

The system implements feedback by automatically collecting and analyzing code coverage data from test case executions. This feedback mechanism provides measurable information about testing effectiveness, allowing the system to identify redundant test cases and optimize the test suite. The feedback loop enables continuous improvement of testing quality by comparing actual code coverage against targets and adjusting test case selection accordingly

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent introduces code coverage analysis as an intermediary between test case execution and effectiveness evaluation. This intermediary component automatically measures and reports code coverage percentages, bridging the gap between executing black box tests and assessing their effectiveness. The intermediary provides the missing information about which code paths are covered, enabling informed decisions about test suite optimization

Inventive Principle:

Principle #24Intermediary (Mediator)

3Manufacturing precision

If multiple test cases are executed to ensure coverage, then code coverage improves, but redundant test executions increase and time consumption increases

Engineering Contradiction:

Improvecode coverage percentageVSAvoidtime for test execution

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The system applies partial action by executing only the necessary subset of test cases required to achieve target code coverage. Instead of running all possible test cases excessively, the automated system analyzes code coverage data and selectively executes only those test cases that contribute to uncovered code paths, thereby achieving sufficient coverage with minimal time consumption

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The patent implements dynamics by making the test case execution process adaptive and flexible. The system dynamically adjusts which test cases to execute based on real-time code coverage feedback. As code coverage increases, the system automatically reduces the number of test cases needed, creating a dynamic optimization process that balances coverage achievement with time efficiency rather than following a static predetermined execution plan

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS9251046B2Method and system for generating and processing black box test cases

Publication Date: 2016.02.02 COGNIZANT TECH SOLUTIONS INDIA PVT LTD

AI summary

A method and system for generating and processing test cases for effective black box testing of software applications is provided. Test cases are automatically generated based on parameters that are identified from automated manual test cases associated with business models. The generated automated test cases cover one or more paths in the business models. Further, the automated test cases are optimized by determining minimal path covered by the automated test cases in the business models. The optimization is performed based on analysis of the one or more paths covered by the automated test cases in the business models. Furthermore, code coverage data of the optimized test cases are obtained by execution of the optimized test cases. Finally, based on the code coverage data and predetermined conditions, the optimized test cases are analyzed for at least prioritization and further optimization of the optimized test cases for effective black box testing.