Test Execution Order Optimization for Interval Dependent Cases
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
System interval dependent test programs often result in elongated execution times, especially when included in regression test suites, due to their dependency on system intervals, leading to increased total execution time as the number of such test programs grows.
Innovation Solution
A method and system for optimizing the execution order of test cases by identifying system interval dependent test cases, determining their execution times, and sorting them to minimize total execution time, allowing non-system interval dependent test cases to be executed between dependent ones, thereby optimizing the execution order.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If system interval dependent test programs are executed sequentially in traditional order, then test coverage and validation completeness are maintained, but total execution time increases significantly
Solution Approach 1:
The system performs preliminary actions by executing non-system interval dependent test cases during the system interval waiting period. Test cases are pre-sorted and scheduled to run in parallel with the system interval dependency, utilizing the waiting time efficiently rather than idling.
Solution Approach 2:
The test suite is segmented into system interval dependent test cases and non-system interval dependent test cases. This segmentation allows independent execution of different test categories, enabling parallel processing and reducing total execution time while maintaining complete validation coverage.
2Reliability
If the number of system interval dependent test programs is increased to improve coverage, then validation thoroughness improves, but total execution time increases dramatically
Solution Approach 1:
The system transitions from sequential one-dimensional execution to parallel multi-dimensional execution. By introducing a second dimension of execution (parallel track for non-dependent test cases), the system can process multiple test cases simultaneously without increasing total time, thus maintaining productivity while improving coverage.
Solution Approach 2:
The system merges the execution of system interval dependent and non-dependent test cases into a unified parallel execution framework. This combining allows both test types to run simultaneously, utilizing available computational resources efficiently and preventing dramatic time increases when adding more test programs.
3Ease of operation
If test cases are executed in traditional sequential order, then execution simplicity is maintained, but computational resource usage is inefficient
Solution Approach 1:
The system implements feedback mechanisms to dynamically manage test case execution. By monitoring system interval status and test case completion, the system adjusts execution scheduling in real-time, optimizing resource allocation and preventing idle computational resources while maintaining manageable execution complexity.
Data Source
AI summary
Systems, methods, and computer-readable media for optimizing the execution order of a set of test programs that includes at least one system interval dependent test program are disclosed. The optimized execution order may be determined by identifying each non-system interval dependent test program that can be executed during each instance of a system interval without impacting execution of system interval dependent test programs. The optimized execution order minimizes a total execution time of the set of test programs.