Automated Test Case Generation from Software Logs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for evaluating software application issues rely on manual techniques, which are time-consuming, error-prone, and often result in test cases that fail to properly assess software operation, leading to reduced software quality.
Innovation Solution
The proposed solution involves an automated method for generating software application test cases. This method includes obtaining mappings of log event templates to vector representations, and mappings of test step vector representations to test step functions. By analyzing software logs and issue information, the system automatically generates test case logic flows to evaluate software issues.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual techniques are used to generate test cases, then test cases can be created with human judgment, but the process is time-consuming and error-prone
Solution Approach 1:
The patent replaces the manual mechanical process of test case creation with an automated computer-based system that uses machine learning models and natural language processing to generate test cases from software logs and issue descriptions, eliminating human manual intervention while maintaining or improving accuracy
Solution Approach 2:
The system enables self-service test case generation by automatically analyzing software logs, extracting relevant information, and generating test cases without requiring manual human input, allowing the system to serve itself in the test case creation process
2Reliability
If manual techniques are used to generate test cases, then human expertise can be applied, but errors are introduced and software quality is reduced
Solution Approach 1:
The patent replaces manual test case creation with an automated system that uses machine learning models to generate test cases, eliminating human errors while maintaining the ability to evaluate software quality through systematic automated analysis of logs and issue descriptions
3Productivity
If automated methods are used to generate test cases, then time and errors are reduced, but complexity of the system increases
Solution Approach 1:
The patent creates a multi-functional automated system that can perform multiple tasks including log analysis, issue description processing, test case generation, and quality evaluation within a single integrated platform, reducing the need for multiple separate tools and processes
Solution Approach 2:
The system uses natural language processing and machine learning models as intermediaries to bridge the gap between raw software logs/issue descriptions and structured test cases, automatically translating unstructured data into actionable test scenarios without requiring complex manual processing
Data Source
AI summary
Techniques are provided for automated generation of software application test cases for evaluation of software application issues. One method comprises obtaining a first mapping of log event templates, related to log events in a software application log, to respective log event template vectors; obtaining a second mapping of test step vectors, generated using the log event template vectors, to respective test step functions, wherein a given test step vector comprises one or more of the log event template vectors; in response to obtaining information characterizing a software application issue: generating test step vector representations of the information characterizing the software application issue, using the first mapping; mapping the test step vector representations of the information to respective test step functions using the second mapping; and generating a test case logic flow to evaluate the software application issue using the mapped test step functions.