Network Test Automation Platform Risk-Based Execution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network test automation frameworks face challenges in end-to-end network testing, including inefficient test suite selection, duplication of test cases, lack of uniform frameworks, and extended test cycles due to traditional development methods and lack of cognitive capabilities.
Innovation Solution
A method for smart test execution in a network test automation platform, which involves retrieving parameter values for test cases based on risk parameters, calculating a risk index for each test case, determining an execution order, executing priority test cases until a threshold risk escape value is reached, and dynamically modifying the execution order upon failed test cases. Additionally, real-time live charts are rendered based on the current risk escape value.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional test execution methods are used to cover large set of automated test suites, then comprehensive testing coverage is achieved, but test execution time becomes excessively long (4-8 days)
Solution Approach 1:
The system automatically calculates risk indices for test cases and dynamically determines execution priorities without human intervention. The test execution platform self-adjusts the test suite based on calculated risks, eliminating the need for manual test planning and execution scheduling, thereby reducing execution time while maintaining comprehensive coverage of critical areas.
Solution Approach 2:
The system changes the execution parameter by introducing risk-based prioritization. Instead of executing all test cases uniformly, the platform calculates risk indices and executes test cases in descending order of risk, dynamically adjusting the execution sequence to cover high-risk areas first, thus achieving comprehensive coverage in reduced time.
2Adaptability or versatility
If multiple test frameworks and scripting languages are integrated to address diverse network domains, then testing capability is enhanced, but device complexity and cycle time increase
Solution Approach 1:
The patent implements a universal test execution platform that can handle multiple test frameworks and scripting languages through a single interface. The system provides language-agnostic test case execution and unified risk calculation mechanisms, allowing diverse network domains to be tested without requiring separate frameworks, thereby reducing complexity while maintaining versatility.
Solution Approach 2:
The system introduces an intermediary layer that sits between various test frameworks and the execution engine. This intermediary handles the translation and normalization of different scripting languages and framework formats into a unified execution model, enabling multi-framework support without increasing overall system complexity.
3Reliability
If comprehensive test suites are executed to ensure network stability and security, then testing thoroughness is improved, but productivity decreases due to extended test cycles
Solution Approach 1:
The system performs preliminary risk assessment and test case prioritization before execution. By calculating risk indices in advance and pre-determining the execution sequence, the platform ensures that high-impact tests are executed first, maintaining thoroughness while enabling early detection of critical issues, thus improving productivity without compromising reliability.
Solution Approach 2:
The system implements continuous feedback during test execution by monitoring results in real-time and dynamically adjusting the execution plan. When high-risk test cases are executed and pass, the system can confidently skip or de-prioritize lower-risk tests, maintaining network stability assurance while significantly reducing overall test cycle time and improving productivity.
Data Source
AI summary
The disclosure relates to system and method for smart test execution in a network test automation platform. The method includes retrieving set of parameter values for each of plurality of test cases in test suite corresponding to set of risk parameters based on latest release of product code. The method further includes calculating risk index for each of plurality of test cases based on set of parameter values and predefined set of weightage scores. The method further includes determining execution order of plurality of test cases based on calculated risk index. The method further includes executing set of priority test cases from plurality of test cases based on execution order and predefined threshold risk escape value. The method further includes dynamically rendering in real-time, one or more live charts based on current risk escape value upon execution of the set of priority test cases via GUI.