Autonomous Network Test Case Generation From 5G Failure Logs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems lack a mechanism for automatically generating test scenarios upon detection of failures in multi-vendor 5G telecommunications networks, particularly in environments adopting continuous integration/continuous delivery (CI/CD) processes, leading to inefficiencies in automated testing.
Innovation Solution
An autonomous test case generator that detects failure cases by analyzing application logs, alerts data, and metrics data, and autonomously generates test cases, which can be integrated with a behavioral data-driven test framework to execute and report on failure scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual testing procedures are used to detect and document failure cases, then test coverage can be comprehensive, but testing efficiency and productivity are reduced
Solution Approach 1:
The system enables automated self-service testing by having the network testing system automatically detect failure cases, extract relevant information from logs and metrics, generate test cases, and execute verification without human intervention. This eliminates manual testing overhead while maintaining comprehensive test coverage through automated analysis of network function behaviors.
Solution Approach 2:
The patent replaces manual mechanical testing processes with automated computational systems. The automated testing system uses computer-implemented algorithms to analyze logs, metrics, and traces, generate test cases, and execute tests, substituting human operators with automated software agents that can process and analyze data at much higher speeds and volumes.
2Productivity
If automated testing is implemented without autonomous test case generation, then testing speed increases, but the complexity of test case creation and maintenance increases
Solution Approach 1:
The automated testing system performs self-service by autonomously generating test cases from actual failure cases detected in the network. Instead of requiring test engineers to manually create and maintain test case libraries, the system automatically extracts failure scenarios, generates corresponding test cases, and updates the test suite, thereby reducing the complexity of test case management while maintaining high testing speed.
Solution Approach 2:
The system performs preliminary action by proactively detecting failure cases during normal network operation and automatically generating test cases before formal testing cycles begin. This continuous background monitoring and automatic test case generation prepares the test suite in advance, reducing the complexity of manual test case creation and maintenance while enabling rapid testing execution.
3Productivity
If continuous integration/continuous delivery processes are adopted, then software delivery speed increases, but the need for comprehensive automated testing creates additional complexity
Solution Approach 1:
The automated testing system provides self-service by integrating seamlessly with CI/CD pipelines and autonomously performing test case generation, execution, and reporting without requiring separate complex testing infrastructure. The system automatically detects failure cases, generates appropriate test cases, and executes tests within the existing CI/CD workflow, maintaining software delivery speed while reducing the additional complexity that would otherwise be required for comprehensive automated testing.
Solution Approach 2:
The patent implements universality by designing a multi-functional automated testing system that can handle multiple testing tasks within a single unified platform. The system can detect failure cases, generate test cases for various network functions, execute tests across different scenarios, and integrate with CI/CD processes, thereby reducing the overall system complexity compared to having separate specialized tools for each testing function.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for autonomously generating network function test cases includes detecting a failure case in a network function of a core network of a telecommunications network. The method includes, in response to detecting the failure case, autonomously generating a network function test case based on the failure case. The network function test case includes one or more network status parameters detected when detecting the failure case. The method includes supplying the network function test case to a network testing system configured for executing the network function test case by repeating the one or more network status parameters and determining whether or not the network function repeats the failure case.