Automated software testing and validation system

Abstract

An automated software testing system allows automated test script generation, execution, and result correlation in a recreatable and adaptable manner. A software Application Under Test (AUT) is identified and includes a process having a sequence of Graphical User Interface (GUI) windows. A test thread tree is generated corresponding to the windows in the process. A grid is generated to enumerate test cases indicative of the windows and data objects in the thread. Also generated is a script indicative of each of the test cases. The script is executed to apply each of the test cases to the AUT and receive a response for each test case from the AUT. A report of expected responses is generated, and compared to the actual responses to provide a test result indicative of the status for each test case in question.

Description

RELATED APPLICATIONS[0001]This application claims the benefit of U.S. Provisional Application No. 60 / 308,453, first named inventor E. Givoni, filed Jul. 27, 2001, and U.S. Provisional Application entitled “Automated Software Testing and Validation System,” first named inventor E. Givoni, Ser. No. 60 / 399,586 filed concurrently, i.e., Jul. 29, 2002. The entire teachings of the above applications are incorporated herein by reference.BACKGROUND[0002]In a software development environment, proper testing is a significant component of the resources required to develop a market acceptable software product. Aggressive development schedules may force trimming of time, human resource, and monetary resources invested in a product. Often, testing phases are accelerated or truncated, rather than sacrificing product functionality already promised to customers, in an effort to maintain cost and ship date milestones. Accordingly, testing may be performed in an ad-hoc, unrepeatable manner. Incomplete...

AI Technical Summary

Benefits of technology

[0005]A system and method for automated software testing and validation allows automated test generation, execution, and result correlation in a recreatable and readily adaptable manner.

Problems solved by technology

Aggressive development schedules may force trimming of time, human resource, and monetary resources invested in a product.

Accordingly, testing may be performed in an ad-hoc, unrepeatable manner.

Incomplete testing leads to a product in which many customer execution scenarios have not been exercised, promoting bugs in the released product.

Unrepeatable tests require redundant effort to retest upon successive releases or revisions.

Such practices tend to allow deployment of a product that is prone to short revision cycles and release of bug fix “patches,” which exacerbate the problem presented by unrepeatable testing.

However, a large array of test scripts becomes prone to maintenance issues itself.

Revisions to keep test scripts current also require substantial resources.

Absence of a unified scripting approach may cause scripts developed by one tester to be unwieldy by another tester, and thus trigger duplication of effort.

Incomplete or inaccurate revisions of the test scripts make it unclear whether a failure result is caused by software bugs or merely incorrect test scripts.

As a result, software product testing remains an unglamourous, underestimated, and often overlooked, but necessary aspect to software product development.

Images