Framework-Agnostic Test Orchestration for Network Automation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current network testing methods face challenges due to the use of multiple testing frameworks, which require testers to be proficient in various programming languages, leading to increased time and resource consumption, and limitations in dynamic data analysis and real-time feedback.
Innovation Solution
A framework-agnostic smart test orchestration method and system that allows for the execution of test scripts across different frameworks through a web-based application, parsing input data to select appropriate execution modules, and monitoring device health in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple testing frameworks are used to support different programming languages, then the compatibility and versatility of test tools are improved, but the device complexity and difficulty of operation increase
Solution Approach 1:
The patent introduces an intermediary component that acts as a bridge between multiple testing frameworks and the execution environment. This intermediary handles framework-specific details and translations, allowing test scripts to be executed across different frameworks without requiring testers to learn multiple programming languages or framework-specific syntax, thus maintaining versatility while reducing operational complexity
Solution Approach 2:
The patent creates a universal test execution platform that can handle multiple testing frameworks through a single interface. This universal system performs multiple functions by detecting the framework type and routing to appropriate execution modules, eliminating the need for separate toolchains for each framework and reducing overall system complexity
2Adaptability or versatility
If multiple testing frameworks with different programming languages are used, then the versatility of test automation is improved, but the ease of operation deteriorates
Solution Approach 1:
The intermediary component detects the programming language and framework type of test scripts automatically, then translates and routes them to the appropriate execution environment. This allows testers to write scripts in their preferred language without needing to understand framework-specific operational differences, significantly improving ease of operation while maintaining multi-language support
Solution Approach 2:
The system performs self-service by automatically detecting framework types and selecting appropriate execution modules without requiring manual configuration by testers. This automation of framework detection and routing eliminates the operational burden on testers while preserving support for multiple programming languages and frameworks
3Ease of operation
If traditional manual testing methods are used, then the ease of operation for simple test cases is maintained, but the productivity and testing speed decrease
Solution Approach 1:
The system enables self-service automation where test scripts automatically execute themselves without requiring manual intervention for each test case. The framework detects the script type and autonomously routes it to the appropriate execution module, maintaining simplicity of operation while dramatically increasing testing speed and productivity through automated execution
4Adaptability or versatility
If complex scripts combining multiple technologies are developed manually, then the functionality and versatility of test cases are improved, but the loss of time in script development increases
Solution Approach 1:
The system performs preliminary actions by pre-configuring execution modules for different frameworks and technologies before test script development begins. When a test script is created, the system has already prepared the necessary execution environments and routing logic, allowing complex multi-technology scripts to be developed and executed immediately without time-consuming setup, thus preserving functionality while reducing development time
Data Source
AI summary
This disclosure relates to method and system for framework agnostic smart test orchestration in network test automation in a network. The method includes receiving input data for executing one or more test scripts to test one or more functions on one or more devices in the network. The input is received from a user device via a web-based application. The method comprises parsing the input data and selecting an execution module from a plurality of execution modules for executing the one or more test scripts on the one or more devices based on the parsed input data. The method comprises executing the one or more test scripts to test the one or more functions on the one or more devices using the selected execution module.