3038 results about "Software testing" patented technology

Embodiments relate to systems and methods for testing and evaluating software in the network cloud. A developer or other operator may wish to debug, modify, or update a set of test software based on testing of that software. The developer can instantiate a set of virtual servers or other test beds in the cloud, and install the subject software to the virtual test beds. A test management module can monitor the execution of the set of test software on the set of virtual test beds, to detect execution faults, measure processing performance, stress-test the software with predetermined data inputs, and manage other aspects of software life cycle development. The test management module can provide or access a set of application programming interfaces to a set of software tools external to the cloud, so that the set of test software can be tested and optimized using external programming development tools.

A quality assurance benchmark system tests a target executable application under load stress conditions over an extended period of time. The system has user-controlled parameters to benchmark performance, scalability, and regression testing before deploying the application to customers. The system includes a display processor and a test unit. The display processor generates data representing a display image enabling a user to select: input parameters to be provided to the target executable application, and output data items to be received from the target executable application and associated expected range values of the data items. The test unit provides multiple concurrently operating executable procedures for interfacing with the target executable application to provide the input parameters to the target executable application, and to determine whether data items received from the target executable application are within corresponding associated expected range values of the data items.

Non-redundant software testing is provided based on changes in the execution paths of a software program. Upon changes to the code of the software program, changed or new execution paths are identified. Test cases capable of traversing the changed or new execution paths are then identified and executed to test the modified code. The difference between a first plurality of execution paths of the software program before the changes to the code and a second plurality of the execution paths of the software program after the changes to the code is identified. Test cases that intersect the changed paths may be identified and new test cases may be developed that would execute the changed paths.

A generic testing framework to automatically allocate, install and verify a given version of a system under test, to exercise the system against a series of tests in a “hands-off” objective manner, and then to export information about the tests to one or more developer repositories (such as a query-able database, an email list, a developer web server, a source code version control system, a defect tracking system, or the like). The framework does not “care” or concern itself with the particular implementation language of the test as long as the test can issue directives via a command line or configuration file. During the automated testing of a given test suite having multiple tests, and after a particular test is run, the framework preferably generates an “image” of the system under test and makes that information available to developers, even while additional tests in the suite are being carried out. In this manner, the framework preserves the system “state” to facilitate concurrent or after-the-fact debugging. The framework also will re-install and verify a given version of the system between tests, which may be necessary in the event a given test is destructive or otherwise places the system in an unacceptable condition.

A computer-implemented method for generating and managing test documentation for a software product may include steps of generating a test template; generating at least one test scenario for each of a plurality of functional areas, each test scenario being configured to test a business flow that mimics how an end user would use the software product; associating the generated test scenario(s) with the generated test template; generating at least one test case that includes a plurality of test steps; associating the generated test case(s) with the generated test template; copying the test template to generate test results, the generated test results being independent of the generated test template, and carrying out a test cycle by executing the test scenario(s) and the test case(s) associated with the generated test results of the generated test template and storing the results of the executed test scenario(s) and the executed test case(s) in a database.

A system and method for analyzing a computer program includes performing a static analysis on a program to determine property correctness. Test cases are generated and conducted to provide test output data. Hypotheses about aspects of execution of the program are produced to classify paths for test cases to determine whether the test cases have been encountered or otherwise. In accordance with the hypothesis, new test cases are generated to cause the program to exercise behavior which is outside of the encountered test cases.

A system and method provide testing of software in different configurations automatically. Templates may be provided for developers to create an application or for generating tests. One or more tests may be generated for testing the application. The testing scope may range between a plurality of configurations for the application in one or more environments. Tests may include test blocks corresponding to parts of the application for testing according to the execution order of the parts of the application. Tests may change input values, modules in the application, configuration settings, data types, communication parameters, and / or other application elements for testing. Such changes may be generated automatically during testing. Test code may be inserted in the application for testing. Application generation and compilation may be automated during testing. Deployment and undeployment of applications may also be automated for testing.

A system for automatic generation of test programs employs test generation foci linked to a finite state machine behavioral model of a software application under test to produce abstract test suites that are executed by an execution engine. The foci include directive expressions that tag coverage variables of the behavioral model. The execution engine operates until the tagged coverage variables have assumed all their possible values. Both the behavioral models and the foci are archivable and can be retrieved and reused independently.

A method and computer system for web-interface mediated software testing is disclosed. The computer system includes an application server that provides a web interface for organizing and managing test cases by organizing test cases by the Requirements and Sub-Requirements of a Project. Users can schedule test cases to run on one or more host machines that have loaded thereon a copy of the software being tested, or some part thereof, and an automation tool. The host machine derives test scripts by parsing automation tool recognized syntax from the steps and procedures encoded in the test case files and downloads the appropriate automation tool GUI environment file and running the test script using the automation tool against the software application, or some part thereof, being tested. The progress of each test case or test step can be monitored remotely via the web interface without the need for direct interaction with a host machine. A test case can be generated by an Integrated Test Case Authoring Tool which provides a GUI that translates user keystrokes and mouse actions into strings recognized by standard automation tools.

Embodiments of the present invention provide methods and systems for automated distributed testing of software. A testing service may utilize a distributed architecture that provides a standardized framework for writing tests, scheduling the tests, and gathering and reporting results of the tests. Multiple distributed labs are integrated into the testing service and their environments can be centrally managed by the testing service. The testing service permits the scheduling and performance of tests across multiple machines within a test lab, or tests that span across multiple test labs. Any of the machines in the test labs may be selected based on variety of criteria. The testing service may then automatically locate the appropriate machines that match or satisfy the criteria and schedule the tests when the machines are available. The testing service may also automatically create and set up a desired test environment according to the desired specifications for the test.

In general, in one aspect, a method for distributed testing includes providing a testing framework for the distributed testing of software to a number of clients at least some of which have a different operating environment than other of the clients, transmitting to each testing framework a component for testing, receiving client environment data and testing results from each testing framework, storing the testing results and environment data in a database; and reporting the results of running the tests on the clients.

Embodiments of the present invention address deficiencies of the art in respect to software test automation and provide a method, system and apparatus for a reusable software testing framework. In one embodiment of the invention, an automated application test data processing system can include a reusable test automation framework. The system further can include a test task generator and a scenario generator coupled to one another and to the framework. In this regard, the test task generator can be configured to generate uniform logic for performing testing tasks, while the scenario generator can be configured to arrange testing tasks for a complete test scenario. Finally, a collaborative testing environment can be provided through which multiple users can interact with the scenario generator and test task generator to produce test cases of different test scenarios

A generic testing framework to automatically allocate, install and verify a given version of a system under test, to exercise the system against a series of tests in a “hands-off” objective manner, and then to export information about the tests to one or more developer repositories (such as a query-able database, an email list, a developer web server, a source code version control system, a defect tracking system, or the like). The framework does not “care” or concern itself with the particular implementation language of the test as long as the test can issue directives via a command line or configuration file. During the automated testing of a given test suite having multiple tests, and after a particular test is run, the framework preferably generates an “image” of the system under test and makes that information available to developers, even while additional tests in the suite are being carried out. In this manner, the framework preserves the system “state” to facilitate concurrent or after-the-fact debugging. The framework also will re-install and verify a given version of the system between tests, which may be necessary in the event a given test is destructive or otherwise places the system in an unacceptable condition.

This disclosure describes systems and methods for testing a medical device. The disclosure describes a novel approach determining if the ventilator system is functioning properly without having to connect the medical device to a patient.

The invention discloses a method and a system for realizing automatic software testing. The method includes the following steps: obtaining the object code of the to-be-tested software; obtaining the test case for the to-be-tested software, wherein the test case is generated by adopting the oriented object technology and includes a test object key word and a test drive data for the to-be-tested software; compiling and saving the test script according to the test case; running the test script, so as to carry out the automatic software testing of the object code of the to-be-tested software based on the test object key word and the test drive data. By adopting the solution of automatic testing and utilizing the object oriented test case to carry out the automatic testing based on the assemblage of the test object key word and the test drive data, the automatic software testing can be realized without the participation of any operator, and the method and the system for realizing automatic software testing are applicable to all the stages of software testing.

The invention provides a method for automatically generating software test cases. The method comprises the following steps of: A. reading to-be-tested software, carrying out lexical analysis, syntax analysis and semantic analysis on a source program of the to-be-tested software and generating an abstract syntax tree and a control flow graph of the to-be-tested software; B. preprocessing the source program of the to-be-tested software by traversing the generated abstract syntax tree, identifying initial input-output variables and compressing the space of a definition domain of the initial input variables; and C. generating a path of program elements of the current to-be-tested software by traversing the control flow graph, carrying out assignment operation, implication operation and backtracking operation on the variables in the path, and generating the test cases. The invention also provides a system for automatically generating software test cases. The method and the system for automatically generating the software test cases can accurately and automatically generate the test cases according to the given program elements of the to-be-tested software and verify the generated test cases, thereby improving the accuracy, efficiency and automation degree of the test cases.

A system and method provide testing of software in different configurations automatically. Templates may be provided for developers to create an application or for generating tests. One or more tests may be generated for testing the application. The testing scope may range between a plurality of configurations for the application in one or more environments. Tests may include test blocks corresponding to parts of the application for testing according to the execution order of the parts of the application. Tests may change input values, modules in the application, configuration settings, data types, communication parameters, and / or other application elements for testing. Such changes may be generated automatically during testing. Test code may be inserted in the application for testing. Application generation and compilation may be automated during testing. Deployment and undeployment of applications may also be automated for testing.

The invention discloses a testing method, a testing device and a testing system of application software on a mobile terminal. The method comprises the following steps of receiving an installation package of application software to be tested, which is uploaded by a client end, and an identification of a target mobile terminal to be tested; sending the installation package to the target mobile terminal and instructing the target mobile terminal to install the application software through the installation package; instructing the target mobile terminal to start the application software and traversing to trigger all controls in the application software and obtaining a screenshot of a display interface when the controls are triggered to obtain the display interface every time; returning a picture intercepted on the target mobile terminal to the client end. By using the method, the application software on the mobile terminal can be efficiently tested.

A system and method for automatically managing a distributed software test execution, management and reporting system that includes a network of test computers for executing a plurality of test jobs and at least one client computer for controlling the test computers is disclosed. The method and system include providing the test computers with a service program for automatically registering availability of the computer and the attributes of the computer with the client computer. The execution requirements of each test job are compared with the attributes associated with the available computers, and the test jobs are dispatched to the computers having matching attributes. The method and system further include providing the service programs with a heartbeat function such that the service programs transmit signals at predefined intervals over the network to indicate activity of each test job running on the corresponding computer. The client computer monitors the signals from the service programs and determines that a failure has occurred for a particular test job when the corresponding signal is undetected. The client then automatically notifies the user when a failure has been detected.

A secure memory card with encryption capabilities comprises various life cycle states that allow for testing of the hardware and software of the card in certain of the states. The testing mechanisms are disabled in certain other of the states thus closing potential back doors to secure data and cryptographic keys. Controlled availability and generation of the keys required for encryption and decryption of data is such that even if back doors are accessed that previously encrypted data is impossible to decrypt and thus worthless even if a back door is found and maliciously pried open.

A system that provides easy testing of software objects and reduces the burden on a program developer for maintaining a test system is presented. The system accepts as an input objects and automatically creates test drivers for these objects. The test objects are provided to a test bed comprising an application server where the objects are tested by application of the test drivers.In a preferred embodiment, the test bed comprises a collection of application servers. An application service provider provides the system test driver and the test bed. Access to the test system is provided by passing a representing of the object under test to the application service provided through a network interface. The application service provider provides test services on a fee for service basis.

A system and a method are provided to quantitatively analyze the risk for a risk-based testing of software having at least one module. The risk-based testing comprises obtaining behavior of each module to a set of test cases. The method to quantitatively analyze the risk comprises assigning a confidence weight to each test case for each module based on its test history, assigning a confidence weight to each of a plurality of software specific parameters for each module, calculating a raw confidence level for each module based on the assigned confidence weights to the test cases, and calculating a confidence quotient for each module as a weighted sum of the raw confidence level for each module and the confidence weight for each software specific parameter. The confidence quotient indicates the risk of defects in each module. The module with the smallest confidence quotient is assigned the highest priority during the testing of the software.

Some embodiments of the present invention provide a system that tests a software program. During operation, the system traces a flow of tainted data through the software program during execution of the software program. Next, the system alters the flow by modifying an instruction within the software program. The system then monitors the behavior of the software program after modifying the instruction. Finally, the system analyzes a correctness of the software program based on the monitored behavior.

There is provided a method for the automated testing of software, which has a graphic user interface. With at least one graphic editor, at least the dynamic and the semantic behavior of the user interface of the software is specified. Test cases are generated by a test case generator software using the thus specified behavior of the user interface, which are then executed by a software for automatic running test running either immediately or in a later step.

The invention discloses a software testing automation framework (STAF)-based fault injection automation testing platform and an STAF-based fault injection automation testing method for a high-end fault-tolerant computer, and relates to a fault injection technology. The invention provides a fault injection automation testing platform and a fault injection automation testing method, which are applicable for the high-end fault-tolerant computer. The method is implemented by adopting an embedded software distributed testing environment. An application layer in software is an application program operated in general control end service, manages data and information in an automation testing process by utilizing a relational database and a file system, and provides a friendly graphic interface; a proxy layer is operated between the application layer and a realization layer to realize task proxy, and takes charge of executing an automation testing task submitted by a user from the interface; and the realization layer packages the communication among an automation testing control server and testing proxies of various platforms, and executes specific operations of various automation tests. The STAF-based fault injection automation testing platform is a distributed and automatic fault injection platform which is constructed on the basis of an open source automation testing tool STAF, and can integrate various software fault injection tools.

The invention relates to a system and a method for testing computer software, in particular to a system and a method for on-computer test of mobile application software. The system comprises a server side and a client side, wherein the server side creates and transfers a test-case set to a test-set management unit for running the test set and establishes communication connection with a communication service unit to wait for a client request, and the client side downloads a test packet and executes test. The device supports the on-computer test in actual hardware environment and Java running environment of mobile phones so as to obtain realer running states. The device can automatically generate test cases including test drivers or pile-calling codes and the like, and can improve test coverage rate and error detecting capability.

This invention relates to methods and a system for supporting software. In one embodiment, a method for providing an updated version of a software program includes receiving an indication of a fault in a software program, distributing the faulty software program to a distributed community of programmers, receiving updated versions of the faulty software program from a subset of the distributed community of programmers, and determining a preferred updated software program from the received updated versions of the software program. In another embodiment, a system for providing an updated version of a software program includes a communication server for communicating faulty software programs and updates of the programs to and from the distributed community of programmers, a component storage module for storing the faulty software program, and a software testing module for determining a preferred updated version of the faulty software program.

A computer-implemented system and method for improving the efficiency of testing a process by focusing the testing in the highest risk areas of the process. One application of this computer-implemented system and method is in software testing to improve the effectiveness of software testing by focusing the testing efforts on the parts of the software that have a highest risk of failure and also by focusing the testing on the types of tests needed to reduce the risk.

A software testing framework is described. In one embodiment, the software testing framework is run on a client-side computer system and provides the user an integrated graphical software development and testing environment for use with software programs written in a graphical environment. The software testing framework enables a user to graphically compose software, and configure a number of tests, or test suits, required to validate the operation of software without the need for user supplied custom testing software or program coding.

An automated software testing system allows automated test script generation, execution, and result correlation in a recreatable and adaptable manner. A software Application Under Test (AUT) is identified and includes a process having a sequence of Graphical User Interface (GUI) windows. A test thread tree is generated corresponding to the windows in the process. A grid is generated to enumerate test cases indicative of the windows and data objects in the thread. Also generated is a script indicative of each of the test cases. The script is executed to apply each of the test cases to the AUT and receive a response for each test case from the AUT. A report of expected responses is generated, and compared to the actual responses to provide a test result indicative of the status for each test case in question.