Extensible Automated Test Framework for Software Reuse
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing automated testing frameworks for software systems lack the ability to efficiently reuse and extend automated test procedures across various configurations, making it difficult to ensure that new features and modifications do not break existing functionality.
Innovation Solution
A customizable and extensible test framework that examines the applicability of automated test procedures for multiple test options and executes them using procedure annotations, allowing for the creation of a suite of test specifications that can be reused across different configurations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If comprehensive automated test suites are created for all configurations, then reliability is improved, but device complexity increases
Solution Approach 1:
The patent creates a universal test procedure framework where a single test procedure can be applied across multiple configurations and systems. The test procedure is designed to be configuration-agnostic, using parameter substitution to adapt to different scenarios without requiring separate test procedures for each configuration, thereby reducing overall system complexity while maintaining comprehensive coverage.
Solution Approach 2:
The patent segments test suites into modular, reusable test procedures that can be independently developed and combined. Each test procedure is a discrete unit that can be selectively applied to different configurations, allowing the test framework to be built incrementally and maintained more easily than monolithic test suites.
2Measurement precision
If test procedures are customized for each configuration, then measurement precision is improved, but productivity decreases
Solution Approach 1:
The framework enables a single test procedure to serve multiple configurations through parameterization. Instead of writing custom test procedures for each configuration, the same procedure can be executed with different parameter values, maintaining measurement precision while dramatically improving productivity through reuse.
Solution Approach 2:
The patent utilizes parameter substitution to adapt test procedures to different configurations. By changing parameters rather than rewriting test logic, the system maintains precise measurement capabilities across configurations while reducing the effort required to create and maintain test suites.
3Reliability
If extensive test coverage is achieved, then reliability is improved, but loss of time increases
Solution Approach 1:
The patent establishes test procedures in advance that can be automatically selected and executed based on configuration changes. The framework pre-defines test procedures that cover multiple configurations, so when a configuration change occurs, the appropriate tests are automatically selected and run without manual intervention, reducing the time penalty associated with comprehensive test coverage.
Solution Approach 2:
Universal test procedures that cover multiple configurations reduce the total number of tests needed compared to having separate dedicated tests for each configuration. This consolidation maintains comprehensive coverage while reducing overall execution time through efficient reuse of test logic.
Data Source
AI summary
Methods, software, frameworks, and systems for automating test procedures for a computer processing system. An embodiment of the method includes steps of determining a plurality of available automated test procedures, determining a plurality of available test options, and generating a plurality of test specifications. Each test specification may include option data corresponding to one of the available test options as well as procedure data corresponding to one of the available automated test procedures. The present invention advantageously supports reuse and extensibility of automated test procedures for a variety of configurations.