Automated Test Log Analysis for Defect Linking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The manual process of determining whether failed test cases in software testing are known or new defects is inefficient, as it requires software testers to manually search for defect reports, which can be time-consuming and prone to errors.
Innovation Solution
A system and method that automatically analyze test logs to identify failed test cases, determine if they have related defect reports, and store selectable links to these reports, allowing users to easily distinguish between known and new defects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual examination of test logs is used to determine whether failed test cases indicate known or new defects, then testers can identify defects, but the process is time-consuming and inefficient
Solution Approach 1:
The system performs self-service by automatically analyzing test logs and matching failed test cases with defect reports without requiring manual intervention. The automated analysis component scans test logs, extracts failed test case information, and autonomously determines whether each failure corresponds to a known defect, thereby eliminating the need for manual examination and significantly improving efficiency.
Solution Approach 2:
The patent replaces the mechanical manual process of examining test logs with an automated computational system. The automated analysis component uses computer algorithms to parse test logs, match test failures with defect reports in the defect tracking system, and generate results, substituting human manual labor with automated mechanical processing to reduce time and increase consistency.
2Reliability
If manual search for defect reports is performed, then testers can determine if defects are known or new, but the process is prone to errors
Solution Approach 1:
The system implements feedback by automatically comparing test failure information against the defect tracking system database and providing immediate, accurate classification results. The automated matching process provides feedback on whether each failed test case corresponds to a known defect, eliminating human error in classification and ensuring consistent, reliable results across all test analyses.
Solution Approach 2:
The patent introduces an automated analysis component as an intermediary between the test log and the defect tracking system. This intermediary automatically retrieves and matches information between the two systems, eliminating the need for testers to manually search and reducing errors caused by manual data handling. The intermediary ensures accurate, consistent matching without human intervention.
3Productivity
If testers manually look up test cases in repositories or search defect reports, then they can find related information, but the process increases manual effort and reduces productivity
Solution Approach 1:
The automated analysis component performs multiple functions simultaneously: it parses test logs, identifies failed test cases, searches the defect tracking system for related defects, and generates classification results. This multi-functional automated system replaces multiple separate manual tasks (looking up test cases, searching defect reports, analyzing results), thereby increasing productivity while maintaining ease of operation through a single integrated process.
Solution Approach 2:
The system performs preliminary action by pre-establishing connections between the test management system and the defect tracking system. The automated analysis component is pre-configured to access and search defect reports using test case information, so when test failures occur, the matching process can immediately proceed without requiring testers to manually navigate between systems, thereby increasing throughput while keeping the process simple for users.
Data Source
AI summary
A method for analyzing software test results that includes identifying a test result of a failed test case in a test log, determining whether the failed test case has a related defect report, and storing a selectable link to the related defect report in the test result when the failed test case has the related defect report.