1656 results about "Test harness" patented technology

The present invention relates to a testing tool for testing of complex software systems having a plurality of interrelated system components and a suite of test scenarios for testing the performance of the plurality of interrelated system components. The testing tool includes an Automated Multidimensional Traceability Matrix system for determining linkages between interrelated system components, a means for identifying a change in one or more of the interrelated system components, a means for applying the Automated Multidimensional Traceability Matrix, a means for executing all of or a subset of the test scenarios associated with the interrelated system components that may be affected by the change and a means for evaluating the results of the executed test scenarios.

A testing tool automatically records a series of user steps taken during a user session with a transactional server and generates a test for testing the functionality of server. Through a user interface of the testing tool, the user can define verification steps to automatically test for expected server responses during test execution. The testing tool displays the test to the user as a tree having nodes (displayed as icons) which represent steps of the test. Via the user interface, the user can modify node properties and perform other types of tree edit operations to edit the test, without the need to know a scripting or other programming language. When the user selects a node that corresponds to a particular field or other object of the server screen, the testing tool automatically displays the screen with the object highlighted. The testing tool also allows the test author to use a spreadsheet to conveniently specify data sets for running multiple iterations of a test; thus, the user can record a single transaction and then automatically test the transaction with other data sets.

A software simulation method and program storage device for software defect detection and obtaining insight into software code is disclosed, where simulation consists of executing target software program code for multiple input values and multiple code paths at the same time, thus achieving 100% coverage over inputs and paths without actually running the target software. This allows simulation to detect many defects that are missed by traditional testing tools. The simulation method runs a plurality of algorithms where a plurality of custom defined and pre-defined rules are verified in target software to find defects and obtain properties of the software code.

Methods and systems disclosed herein can be used for testing an application's rendering of output to individual controls of a Graphical User Interface (GUI), displayed on a target device executing the application. A system according to the present invention includes a test tool running on a development computer that communicates with an agent executing on the target device. Testing is performed by using the test tool to execute test scripts, which cause test input to be injected via the agent into the application on the target device. The test tool can validate whether actual output on the target device matches expected output known to the test tool. The present invention includes a variety of key components, such as a flexible trap manager for handling unexpected screens that appear during an automated test, and a configuration manger for testing against multiple languages and platform configurations.

A method of a visual test authoring and automation solution framework for an enterprise comprising supporting the creation of a test case for a visual application. First, the framework allows a user to assign a user-defined name to a test element, and select an action to be performed on the test element from a menu of actions. Second, the framework stores a mapping of the user-defined name assigned to the test element to a coded name in a corresponding language of an automated testing tool. Lastly, the system uses the mapping and the action selected to create the test case in the corresponding language of the automated testing tool.

A system for evaluating a person's athletic ability has a server or a computer system, and several testing locations. The server or computer system includes a database, a central processing unit, and a memory. The database stores results of tests previously subjected to a set of athletes from different physical activities. Each testing location includes testing tools used for subjecting the person to the tests. The results of the tests of the person are temporarily stored in the memory. The central processing unit compares the individual's tests results stored in the memory with the results in the database, and identifies at least one specific physical activity more compatible with the person based on the comparison.

The Functional Tester Plug-in (FTP) extracts information from a data base to enhance automated testing tools to accommodate changes to the computer environment and so that a simulation can be fully executed even if an exception occurs. The FTP accesses the test script and static data store created by a developer using the automated testing tool, wherein the test script and static data store indicate a first resource to be tested at a verification point and a first expected result. The FTP identifies the first resource used by the test script at a first verification point and accesses the data base. The FTP identifies the status and configuration of the first resource in the data base. The FTP calculates and optimal expected result based any changes in the status and configuration of the first resource. The FTP executes the test script using the optimal expected result based any changes in the status and configuration of the first resource.

A method, system and apparatus for the object-oriented automated user interface testing of an application under test in a functional testing tool. The functional testing tool can include a configuration for producing multiple methods defining interactions with individual elements in a user interface to an application under test. The functional testing tool further can include one or more defined actions grouping selected ones of the methods which are used repeatedly within screens of the application under test. Preferably, at least one task defining a group of related activities in the user interface can be produced in the functional testing tool. Subsequently, a test case can be generated which implements the task with at least one verification point.

In an arrangement for testing multiple low-end computing devices simultaneously, different tests are executed simultaneously on different platforms using a single instance of a test harness to which multiple devices are connected. A platform-specific API is provided for independent components of the tests and platform-specific components are implemented for each test according to the respective platform-specific API. At run-time the test harness deploys each test together with a platform-specific execution agent, configured according to the components of the test. The agents execute the test suites, and return test results to the test harness.

A system and method for identifying errors in a computer software include: identifying a potential problem in the computer software; triggering a portion of the computer software by the identified potential problem; determining a control flow graph and a data flow graph for the triggered portion of the computer software originating at the identified potential problem; and analyzing the control flow graph and the data flow graph to verify that the identified potential problem is an actual error. The potential problem may be identified using test tools such as a static analysis tool or a unit test tool.

Embodiments of the present invention generally provide a system and method for testing integrity of data transmitted to and from a target device through a data connection. In one embodiment, the method generally includes creating one or more test threads. The method further includes, for each test thread, generating a data load on the data connection by repetitively writing test data patterns to the target device and reading data patterns from the target device using a synchronous I/O dispatch method, measuring data throughput to and from the target device while generating the data load, comparing the data patterns read from the target device to the test data patterns to detect data corruptions. The method may further include generating debug information if a data corruption is detected by one of the test threads.

A testing tool for verifying a reliability of robot software components is provided, and more particularly, a simulation-based interface testing automation system and method that may automatically perform a test for functions and performance of an interface with respect to robot software components are provided. Thus, it is possible to efficiently perform a test for an interface of robot software components. In particular, it is possible to automatically generate test cases required for testing, to perform a test in various languages, and to perform a test suitable for a robot.

Methods and apparatus for enabling efficient testing of application programming interface (API) frameworks and application code are disclosed. According to one aspect of the present invention, a method for capturing a call to an API using a framework including an execution engine that communicate with an adapter to cause the API call to be executed involves making the API call and constructing an object using metadata associated with the API call. The constructed object is converted into a node that is of a declarative metadata format, and the node is stored.

A method and system are described for migrating test scripts written for a current test tool (CTT) to a new test tool (NTT). A conversion tool sets the CTT in a playback mode and the NTT in a record mode. The CTT provides actions to an application under test (AUT) causing objects to be created and modified. The NTT monitors the actions of the CTT and creates a script to mimic the actions of the CTT. The current test script is modified to add comments, and translated using standard translation tools. Application-specific statements do not translate and are replaced with those previously created by the NTT in the record mode. This results in a script that performs the same functions as the original test script.

The invention belongs to the technical field of computer cloud services, relates to a cloud service platform performance test method, and aims to solve the problem of the existing test tools and test projects of being incapable of meeting cloud service platform performance test requirements. The cloud service platform performance test method tests a service interface layer, a platform management layer and a virtual resource layer of a cloud service platform. The cloud service platform performance test method includes virtualization performance test, resource management ability test and service supply ability test. The virtualization performance test is used for testing the performance of virtual resources at the bottom layer of the cloud service platform. The resource management ability test is used for testing the management ability of the cloud service platform on the virtual resources. The service supply ability test is used for testing the ability of the cloud service platform of supplying services to external users. The cloud service platform performance test method is used for testing and evaluating the cloud service platform.

A system includes a testing device to test a computer application in conjunction with a testing tool, the testing device including a test automation engine to initiate a test, the test automation engine including a programmable data source that is testing tool universal, the programmable data source including one or more automation test scripts that define the test and a data storage device to store results from testing the computer application.

The invention discloses a testing method and system based on a message, which are used for a multiprotocol tested system. Particularly, the method comprises the following steps of: obtaining a test case and analyzing an interface name, parameter values of test parameters and a predicated result out of the test case; determining an interface description file corresponding to the interface name and analyzing a protocol type and attribute information of the test parameters out of the interface description file; converting the parameter values according to the attribute information of the test parameters; splicing the converter parameter values to form a message; and calling a protocol communication processor corresponding to the protocol type to send the message to a tested system. Different interface description files are defined and generated according to different message protocol types so that the test parameters in the test case are converted into the parameter values meeting the protocols according the interface description files of the different protocol types, and the different protocol communication processors are called according to different protocol types to receive and send messages to the tested system; and therefore, the tested system with a plurality of protocols can be conveniently tested and a plurality of test tools do not need to be troublesomely replaced.

A regression testing system comprises an automatic test tool configured to capture a first web screen shot and a second web screen shot of a webpage, where the webpage has undergone an update or edit. The regression testing system also comprises a visual comparator configured to identify similar areas in the first web screen shot and the second web screen shot. The visual comparator receives, and compares characteristics of, the web screen shots. Furthermore, the regression testing system generates a report with marked different characteristics between the first and second web screen shots. The regression testing system identifies similar areas in the first and second web screen shots shot even if the similar areas are at different locations within the web screen shots. The comparison performed by the visual comparator includes performing a pixel comparison combined with a marking algorithm to group differences in smaller, related but separate areas.

Embodiments relate to systems and methods for testing results of configuration management activity. In embodiments, a configuration management server can control and maintain the configuration state of one or more targets, hosts, servers, clients, or other machines in a managed. In aspects, a testing tool hosted on the configuration management server can verify the correct implementation of configuration instructions. In embodiments, the testing tool can access or receive an anticipated or target configuration state for one or more target(s) or other machines, indicating the status of services, memory, security, storage, and/or other configuration parameters after a selected configuration command is to be transmitted and run on the recipient machine. After the configuration change or update is performed, the test tool can receive results indicating the actual configuration state achieved after running the configuration management command(s), and compare those to the anticipated configuration state. Any discrepancies can be flagged, and corrective commands can be issued.