1662 results about "Test harness" patented technology

To test the functionality of a computer system, automated testing may use an automation testing tool that emulates user interactions. A database may store words each having a colloquial meaning that is understood by a general population. For each of these words, the database may store associated computer instructions that can be executed to cause a computer to perform the function that is related to the meaning of the word. During testing, a word may be received having a colloquial meaning that is understood by a general population. The database may be queried for the received word and the set of computer instructions may be returned by the database. The automated testing tool may then perform the function returned to the colloquial meaning of the word. The words stored in the database may be in English or another language.

The present invention relates to a testing tool for testing of complex software systems having a plurality of interrelated system components and a suite of test scenarios for testing the performance of the plurality of interrelated system components. The testing tool includes an Automated Multidimensional Traceability Matrix system for determining linkages between interrelated system components, a means for identifying a change in one or more of the interrelated system components, a means for applying the Automated Multidimensional Traceability Matrix, a means for executing all of or a subset of the test scenarios associated with the interrelated system components that may be affected by the change and a means for evaluating the results of the executed test scenarios.

A system for supervised automatic code generation and tuning for natural language interaction applications, comprising a build environment comprising a developer user interface, automated coding tools, automated testing tools, and automated optimization tools, and an analytics framework software module. Text samples are imported into the build environment and automated clustering is performed to assign them to a plurality of input groups, each input group comprising a plurality of semantically related inputs. Language recognition rules are generated by automated coding tools. Automated testing tools carry out automated testing of language recognition rules and generate recommendations for tuning language recognition rules. The analytics framework performs analysis of interaction log files to identify problems in a candidate natural language interaction application. Optimizations to the candidate natural language interaction application are carried out and an optimized natural language interaction application is deployed into production and stored in the solution data repository.

A testing tool automatically records a series of user steps taken during a user session with a transactional server and generates a test for testing the functionality of server. Through a user interface of the testing tool, the user can define verification steps to automatically test for expected server responses during test execution. The testing tool displays the test to the user as a tree having nodes (displayed as icons) which represent steps of the test. Via the user interface, the user can modify node properties and perform other types of tree edit operations to edit the test, without the need to know a scripting or other programming language. When the user selects a node that corresponds to a particular field or other object of the server screen, the testing tool automatically displays the screen with the object highlighted. The testing tool also allows the test author to use a spreadsheet to conveniently specify data sets for running multiple iterations of a test; thus, the user can record a single transaction and then automatically test the transaction with other data sets.

A testing tool automatically records a series of user steps taken during a user session with a transactional server and generates a test for testing the functionality of server. Through a user interface of the testing tool, the user can define verification steps to automatically test for expected server responses during test execution. The testing tool displays the test to the user as a tree having nodes (displayed as icons) which represent steps of the test. Via the user interface, the user can modify node properties and perform other types of tree edit operations to edit the test, without the need to know a scripting or other programming language. When the user selects a node that corresponds to a particular field or other object of the server screen, the testing tool automatically displays the screen with the object highlighted. The testing tool also allows the test author to use a spreadsheet to conveniently specify data sets for running multiple iterations of a test; thus, the user can record a single transaction and then automatically test the transaction with other data sets.

A software simulation method and program storage device for software defect detection and obtaining insight into software code is disclosed, where simulation consists of executing target software program code for multiple input values and multiple code paths at the same time, thus achieving 100% coverage over inputs and paths without actually running the target software. This allows simulation to detect many defects that are missed by traditional testing tools. The simulation method runs a plurality of algorithms where a plurality of custom defined and pre-defined rules are verified in target software to find defects and obtain properties of the software code.

Methods and systems disclosed herein can be used for testing an application's rendering of output to individual controls of a Graphical User Interface (GUI), displayed on a target device executing the application. A system according to the present invention includes a test tool running on a development computer that communicates with an agent executing on the target device. Testing is performed by using the test tool to execute test scripts, which cause test input to be injected via the agent into the application on the target device. The test tool can validate whether actual output on the target device matches expected output known to the test tool. The present invention includes a variety of key components, such as a flexible trap manager for handling unexpected screens that appear during an automated test, and a configuration manger for testing against multiple languages and platform configurations.

An exemplary method includes parsing data representative of an automated test case into at least one transaction defined in accordance with a global test language, translating the transaction into at least one command specific to an automated test tool, and providing the command to the automated test tool for execution. In certain examples, the method further includes parsing the data representative of the automated test case into at least one other transaction defined in accordance with the global test language, translating the other transaction into at least one other command specific to another automated test tool, and providing other command to the other automated test tool for execution.

A method of a visual test authoring and automation solution framework for an enterprise comprising supporting the creation of a test case for a visual application. First, the framework allows a user to assign a user-defined name to a test element, and select an action to be performed on the test element from a menu of actions. Second, the framework stores a mapping of the user-defined name assigned to the test element to a coded name in a corresponding language of an automated testing tool. Lastly, the system uses the mapping and the action selected to create the test case in the corresponding language of the automated testing tool.

A system for evaluating a person's athletic ability has a server or a computer system, and several testing locations. The server or computer system includes a database, a central processing unit, and a memory. The database stores results of tests previously subjected to a set of athletes from different physical activities. Each testing location includes testing tools used for subjecting the person to the tests. The results of the tests of the person are temporarily stored in the memory. The central processing unit compares the individual's tests results stored in the memory with the results in the database, and identifies at least one specific physical activity more compatible with the person based on the comparison.

The Functional Tester Plug-in (FTP) extracts information from a data base to enhance automated testing tools to accommodate changes to the computer environment and so that a simulation can be fully executed even if an exception occurs. The FTP accesses the test script and static data store created by a developer using the automated testing tool, wherein the test script and static data store indicate a first resource to be tested at a verification point and a first expected result. The FTP identifies the first resource used by the test script at a first verification point and accesses the data base. The FTP identifies the status and configuration of the first resource in the data base. The FTP calculates and optimal expected result based any changes in the status and configuration of the first resource. The FTP executes the test script using the optimal expected result based any changes in the status and configuration of the first resource.

The invention discloses an automatic test device with integrating multi-type test tools and a method thereof, which comprises the following processes: a scene description file and a scene setting script are bound by a scene case; an execution script and a test script are bound by a test case; the scene setting script and the scene description file are downloaded to a test host to carry out test scene automatic configuration by operating the scene case; the operation parameter of the test script is obtained by using the execution script and the corresponding test execution tools are loaded according to the parameter; test is carried out to the tested equipment according to the test script transferred by the execution tool and the parameter obtained by the analysis of the scene description file as well as the basic function order formed the test script; test result is recorded to a log file in the test; if any scene cases and test cases are not executed, the above steps are repeated until the test is finished; the final total test result is recorded and updated to the test case server.

An online marketplace for distributing software applications is established. From the online marketplace, devices are enabled to select respective ones of the software applications and initiate testing of the selected software applications in connection with testing tools operating in respective secure testing environments that shield the devices from potential adverse effects arising from testing the selected software applications. The testing tools generate testing data relating to one or more criteria for certifying the selected software applications. For each of one or more of the selected software applications, a determination is made whether or not to classify the software application as a certified software application based on an evaluation of the testing data generated during the testing of the software applications initiated by a plurality of the devices.

A computer implemented method for generating a test plan for a communication device under test. The test plan defines test tools, test methodologies, test configurations, and algorithms for executing the test. A user input is received to define the communication device under test. Next, a knowledge database is searched to identify test plan parameters for the communication device under test. Thereafter, the test plan parameters and the user input are analyzed to identify the test plan. A system and computer readable medium having program instructions for generating a test plan for a communication device under test are also described.

A method, system and apparatus for the object-oriented automated user interface testing of an application under test in a functional testing tool. The functional testing tool can include a configuration for producing multiple methods defining interactions with individual elements in a user interface to an application under test. The functional testing tool further can include one or more defined actions grouping selected ones of the methods which are used repeatedly within screens of the application under test. Preferably, at least one task defining a group of related activities in the user interface can be produced in the functional testing tool. Subsequently, a test case can be generated which implements the task with at least one verification point.

In an arrangement for testing multiple low-end computing devices simultaneously, different tests are executed simultaneously on different platforms using a single instance of a test harness to which multiple devices are connected. A platform-specific API is provided for independent components of the tests and platform-specific components are implemented for each test according to the respective platform-specific API. At run-time the test harness deploys each test together with a platform-specific execution agent, configured according to the components of the test. The agents execute the test suites, and return test results to the test harness.

A system and method for identifying errors in a computer software include: identifying a potential problem in the computer software; triggering a portion of the computer software by the identified potential problem; determining a control flow graph and a data flow graph for the triggered portion of the computer software originating at the identified potential problem; and analyzing the control flow graph and the data flow graph to verify that the identified potential problem is an actual error. The potential problem may be identified using test tools such as a static analysis tool or a unit test tool.

Methods and systems disclosed herein can be used for testing an application's rendering of output to individual controls of a Graphical User Interface (GUI), displayed on a target device executing the application. A system according to the present invention includes a test tool running on a development computer that communicates with an agent executing on the target device. Testing is performed by using the test tool to execute test scripts, which cause test input to be injected via the agent into the application on the target device. The test tool can validate whether actual output on the target device matches expected output known to the test tool. The present invention includes a variety of key components, such as a flexible trap manager for handling unexpected screens that appear during an automated test, and a configuration manger for testing against multiple languages and platform configurations.

Embodiments of the present invention generally provide a system and method for testing integrity of data transmitted to and from a target device through a data connection. In one embodiment, the method generally includes creating one or more test threads. The method further includes, for each test thread, generating a data load on the data connection by repetitively writing test data patterns to the target device and reading data patterns from the target device using a synchronous I / O dispatch method, measuring data throughput to and from the target device while generating the data load, comparing the data patterns read from the target device to the test data patterns to detect data corruptions. The method may further include generating debug information if a data corruption is detected by one of the test threads.

Methods and systems for testing a subterranean formation penetrated by a wellbore are provided. A testing tool has a plurality of packers spaced apart along the axis of the tool, and at least a testing port. The testing tool is positioned into the wellbore and packers are extended into sealing engagement with the wellbore wall, sealing thereby an interval of the wellbore. In some embodiments, the wellbore interval sealed between two packers is adjusted downhole. In one embodiment, the location of the testing port is adjusted between two packers. The methods may be used to advantage for reducing the contamination of the formation fluid by fluids or debris in the wellbore.

A testing tool for verifying a reliability of robot software components is provided, and more particularly, a simulation-based interface testing automation system and method that may automatically perform a test for functions and performance of an interface with respect to robot software components are provided. Thus, it is possible to efficiently perform a test for an interface of robot software components. In particular, it is possible to automatically generate test cases required for testing, to perform a test in various languages, and to perform a test suitable for a robot.

Methods and apparatus for enabling efficient testing of application programming interface (API) frameworks and application code are disclosed. According to one aspect of the present invention, a method for capturing a call to an API using a framework including an execution engine that communicate with an adapter to cause the API call to be executed involves making the API call and constructing an object using metadata associated with the API call. The constructed object is converted into a node that is of a declarative metadata format, and the node is stored.

A method and system are described for migrating test scripts written for a current test tool (CTT) to a new test tool (NTT). A conversion tool sets the CTT in a playback mode and the NTT in a record mode. The CTT provides actions to an application under test (AUT) causing objects to be created and modified. The NTT monitors the actions of the CTT and creates a script to mimic the actions of the CTT. The current test script is modified to add comments, and translated using standard translation tools. Application-specific statements do not translate and are replaced with those previously created by the NTT in the record mode. This results in a script that performs the same functions as the original test script.

The invention belongs to the technical field of computer cloud services, relates to a cloud service platform performance test method, and aims to solve the problem of the existing test tools and test projects of being incapable of meeting cloud service platform performance test requirements. The cloud service platform performance test method tests a service interface layer, a platform management layer and a virtual resource layer of a cloud service platform. The cloud service platform performance test method includes virtualization performance test, resource management ability test and service supply ability test. The virtualization performance test is used for testing the performance of virtual resources at the bottom layer of the cloud service platform. The resource management ability test is used for testing the management ability of the cloud service platform on the virtual resources. The service supply ability test is used for testing the ability of the cloud service platform of supplying services to external users. The cloud service platform performance test method is used for testing and evaluating the cloud service platform.

Methods and apparatus for constructing integrated computer testing and task management applications provide a computer user access to multiple testing and task management tools, all through a single, uniform interface. According to exemplary embodiments, an integrated testing application controls known test tools through a well defined communications interface, either locally on a single machine or in a distributed fashion across multiple networked machines. Advantageously, such an integrated testing application provides a scalable, tool independent testing framework and thereby enables an organization to readily create sophisticated testing solutions using a heterogeneous mix of available testing and task management tools. Using the methods and apparatus of the invention, organizations can combine, schedule, regress, and report tests and other tasks with a degree of flexibility not previously possible using conventional techniques.

A system includes a testing device to test a computer application in conjunction with a testing tool, the testing device including a test automation engine to initiate a test, the test automation engine including a programmable data source that is testing tool universal, the programmable data source including one or more automation test scripts that define the test and a data storage device to store results from testing the computer application.

The invention discloses a testing method and system based on a message, which are used for a multiprotocol tested system. Particularly, the method comprises the following steps of: obtaining a test case and analyzing an interface name, parameter values of test parameters and a predicated result out of the test case; determining an interface description file corresponding to the interface name and analyzing a protocol type and attribute information of the test parameters out of the interface description file; converting the parameter values according to the attribute information of the test parameters; splicing the converter parameter values to form a message; and calling a protocol communication processor corresponding to the protocol type to send the message to a tested system. Different interface description files are defined and generated according to different message protocol types so that the test parameters in the test case are converted into the parameter values meeting the protocols according the interface description files of the different protocol types, and the different protocol communication processors are called according to different protocol types to receive and send messages to the tested system; and therefore, the tested system with a plurality of protocols can be conveniently tested and a plurality of test tools do not need to be troublesomely replaced.

A testing tool records a user session with a transactional server and generates a test for subsequently testing the server. Through a user interface of the testing tool, the user can define verification steps to automatically test for expected server responses during test execution. The test is displayed to the user as a tree having nodes which represent steps of the test. Via the user interface, the user can modify node properties and perform other types of tree edit operations to edit the test, without the need to know a scripting or other programming language. When a user selects a node that corresponds to a particular field or other object of the server screen, the testing tool automatically displays the screen with the object highlighted. The testing tool also allows the test author to use a spreadsheet to conveniently specify data sets for running multiple iterations of a test.

A regression testing system comprises an automatic test tool configured to capture a first web screen shot and a second web screen shot of a webpage, where the webpage has undergone an update or edit. The regression testing system also comprises a visual comparator configured to identify similar areas in the first web screen shot and the second web screen shot. The visual comparator receives, and compares characteristics of, the web screen shots. Furthermore, the regression testing system generates a report with marked different characteristics between the first and second web screen shots. The regression testing system identifies similar areas in the first and second web screen shots shot even if the similar areas are at different locations within the web screen shots. The comparison performed by the visual comparator includes performing a pixel comparison combined with a marking algorithm to group differences in smaller, related but separate areas.