Dynamic Test Case Execution Scheduling for Early Failure Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional test case assignment technologies in software testing lifecycle systems fail to dynamically schedule test cases that have the potential to generate critical failures/bugs early in the testing phase, do not analyze executed test cases to evaluate the value of unexecuted test cases, and do not match testers' workload and expertise with variable task assignments, leading to suboptimal testing efficiency and effectiveness.
Innovation Solution
A test case execution system that calculates a weighted metric for each tester, dynamically assigns unexecuted test cases based on priority, similarity to executed test cases, and considers testers' workload and expertise to optimize test case execution scheduling, ensuring highly skilled testers are assigned complex cases early in the cycle.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional test case assignment technologies are used, then test cases can be executed, but test cases that have the potential to generate critical failures/bugs early in the testing phase are not dynamically scheduled
Solution Approach 1:
The system dynamically schedules test cases based on real-time analysis of executed test cases and predicted failure generation values, rather than using static assignment methods. The scheduling mechanism adapts as testing progresses, prioritizing unexecuted test cases with higher potential to generate critical failures early in the testing phase.
Solution Approach 2:
The system performs preliminary analysis of test cases to predict their failure generation potential before execution. By evaluating similarity to executed test cases and calculating predicted failure generation values in advance, the system proactively identifies and schedules high-value test cases early, rather than waiting for failures to occur.
2Loss of information
If conventional test case assignment technologies are used, then test execution can proceed, but executed test cases are not analyzed to evaluate the value of unexecuted test cases
Solution Approach 1:
The system continuously analyzes executed test cases and uses this feedback to evaluate unexecuted test cases. By calculating similarity metrics and predicted failure generation values based on actual execution results, the system creates a closed-loop feedback mechanism that improves test case selection over time.
Solution Approach 2:
The system replaces manual or conventional mechanical assignment methods with an automated intelligent system that uses algorithms to analyze test case similarity, calculate predicted failure generation values, and automatically prioritize unexecuted test cases based on their evaluated value.
3Ease of operation
If conventional test case assignment technologies are used, then test cases can be assigned to testers, but testers' workload and expertise are not matched with variable task assignments
Solution Approach 1:
The system assigns test cases to specific testers based on individual tester expertise and current workload status. Rather than uniform assignment, the system matches test case complexity and requirements with each tester's capabilities and availability, optimizing both workload distribution and testing effectiveness.
Solution Approach 2:
The system dynamically adjusts assignment parameters including tester workload capacity, expertise levels, and test case priority rankings. By changing these parameters in real-time based on testing progress and tester performance, the system optimizes the matching between testers and test cases throughout the testing phase.
Data Source
AI summary
Methods, system, and non-transitory processor-readable storage medium for a test case execution system are provided herein. An example method includes selecting an unexecuted test case from a plurality of test cases in a software testing lifecycle system. The test case execution system calculates a weighted metric associated with a tester for each tester in a plurality of testers. Using the weighted metric, the test case execution system determines a tester to which to assign the unexecuted test case for execution, where a tester is associated with a tester system, and assigns the unexecuted test case to the tester. The test case execution system receives results associated with executing the unexecuted test case on the tester system resulting in an executed test case. The test case execution system determines a test case execution value for the executed test case based on test failures associated with the executed test case.


