297 results about "Test suite" patented technology

A method for automatically maintaining a database that stores coverage data for testing software code under development is provided. The method includes providing modified instrumented software and using test cases of a test suite to execute the modified instrumented software. Modified coverage data that includes a call tree defining a path of each test case is created. The method also includes replacing the coverage data with the modified coverage data at scheduled intervals.

A generic testing framework to automatically allocate, install and verify a given version of a system under test, to exercise the system against a series of tests in a “hands-off” objective manner, and then to export information about the tests to one or more developer repositories (such as a query-able database, an email list, a developer web server, a source code version control system, a defect tracking system, or the like). The framework does not “care” or concern itself with the particular implementation language of the test as long as the test can issue directives via a command line or configuration file. During the automated testing of a given test suite having multiple tests, and after a particular test is run, the framework preferably generates an “image” of the system under test and makes that information available to developers, even while additional tests in the suite are being carried out. In this manner, the framework preserves the system “state” to facilitate concurrent or after-the-fact debugging. The framework also will re-install and verify a given version of the system between tests, which may be necessary in the event a given test is destructive or otherwise places the system in an unacceptable condition.

A system for automatic generation of test programs employs test generation foci linked to a finite state machine behavioral model of a software application under test to produce abstract test suites that are executed by an execution engine. The foci include directive expressions that tag coverage variables of the behavioral model. The execution engine operates until the tagged coverage variables have assumed all their possible values. Both the behavioral models and the foci are archivable and can be retrieved and reused independently.

A method of automatically performing a component test at any number of locations in a distributed environment is disclosed. In general, in order to assure compatibility of the various components in an enterprise computing system, a service test is created as part of a compatibility test suite and passed to a test application server having a test application program. The test application program includes a generic vehicle class that includes a plurality of vehicle class invokers each of which is used to implement each of the object types that are run in each of a plurality of containers. During the build process of the CTS, each service test is automatically packaged with each of the appropriate vehicle classes so that each can be deployed into and run within the associated container.

A pre-designed system-on-chip architecture and method includes several standard library devices, HDL source code, simulation environment and regression, synthesis scripts, software header files, software libraries, ASIC verification test suites, and makefiles. The standard library devices comprise an integrated CPU, a shared memory controller, a peripheral controller, system peripherals, a DMA controller, embedded memory, and general system control. CPU bridges are used to accommodate a variety of processor types and to insulate users from the complexities of interfacing to different kinds of processors. Such CPU bridges further allow the latest processors to be rapidly integrated into existing integration platforms and designs.

A test manager software program includes an interactive test graphical-user-interface (GUI) for testing network devices using high-level networking commands. The test GUI allows the test engineer user to enter high-level commands such as Simple Networking Management Protocol (SNMP) commands that read values in a management information database in a network device under test. The high-level commands can be sent from the test manager using a command-line interface (CLI) in a telnet session opened to the network device during testing. The user specifies high-level test, analyze, and restore commands in test cases that are collected into test suites. Rules for logging on to the network device under test are stored that include expected prompts from the network device and user responses such as passwords. Addresses of the network device under test can be re-mapped for testing other devices so the test suites can be reused.

Coverage metrics are expressed with an intuitive graphical interface based upon data flow. Coverage analysis and presentation objects are integrated to produce coverage results which enable device functionality in a device under test to be modeled as objects, subject to event occurrence. Event objects are introspected at run-time, allowing the user to determine the event object's attributes with specification of coverage metrics subject to a selected combination of the event object's attributes. The event objects are serialized into permanent storage, allowing the user to specify and execute new coverage metrics at any time after simulation. Operations used to describe coverage metrics are modeled as analysis objects. Such analysis objects accept event objects as inputs, using a predetermined, well-defined interface. The combination of event objects and analysis objects allows coverage metrics to be specified in a simple data flow manner. With such a coverage metric, the user attaches or wires (metaphorically) the analysis objects together in a visual builder environment. Using the analysis objects, the user specifies desired coverage metrics, such as coverage of sequences of events and/or coverage of events that occur during the same time window of a simulation. The display functionality of the coverage tool is expandable because the presentation objects use the same event object interface as the analysis operator objects. Coverage metrics are subject to specification either before or after event occurrence. The user specifies coverage metrics using an intuitive graphical interface based upon data flow, without any specific programming language skills being necessary. Functional events in the device under test are treated as event objects. Each event object may be passed to selected analysis tools chosen by the user, such as analyzers, logic gates, and coincidence counters.

In an arrangement for testing multiple low-end computing devices simultaneously, different tests are executed simultaneously on different platforms using a single instance of a test harness to which multiple devices are connected. A platform-specific API is provided for independent components of the tests and platform-specific components are implemented for each test according to the respective platform-specific API. At run-time the test harness deploys each test together with a platform-specific execution agent, configured according to the components of the test. The agents execute the test suites, and return test results to the test harness.

Systems and techniques relating to evaluating performance characteristics are provided. One or more fitness devices, for example, a ball and/or a mat, may have sensors for measuring a user's actions during an activity protocol, such as a testing drill. Sensor configured to detect if the fitness device meets operational criteria are disclosed. In one embodiment, the fitness device may comprise a ball and the operational criteria may relate to the weight, dimensions, and/or internal pressure of the ball. In one embodiment, data from fitness device(s) may be used to calculate a score. In other embodiments, a score may be calculated; however, it may not be associated with credentials or certified if an operational criteria is not met.

A verification system for a procedure interface is generated by using formal specifications of the procedure interface and generating test suites. The test suites are generated from the formal specifications and templates or skeletons which are used to generate an element of a verification system. The skeletons are generated based on decomposition of test suits.

A test coverage tool provides output that identifies differences between the actual coverage provided by a test suite run on a program under test and the coverage criteria (e.g., the coverage criteria required by the test/development team management). The output from the test coverage tool is generated in the same language that was used to write the coverage criteria that are input to an automated test generator to create the test cases which form the test suite. As a result, the output from the coverage tool can be input back into the automated test generator to cause the generator to revise the test cases to correct the inadequacies. This allows iterative refinement of the test suite automatically, enabling automated test generation to be more effectively and efficiently used with more complex software and more complex test generation inputs.

In preferred embodiments, test coverage analysis results of several different test suites, some manually generated and others automatically generated, are used to produce a streamlined automatically-generated test suite and/or to add missing elements to an automatically generated test-suite.

This invention is comprised of a system, protocol, method and apparatus for the assessment of properties that may have been, or are being, subject to clandestine drug manufacturing and/or processing activities. The invention includes a comprehensive home test kit to be used in or upon a suspect premises to detect, identify, and delineate toxic chemical hazards that may have originated from an illegal drug making operation. The test kit is designed to be conveniently equipped with all-inclusive content consisting of an assortment of user-selected sampling equipment, media, containers, materials, documentation, instruction manual, as well as an audio-visual instructional media pack. This Kit is designed to enable a person of average intelligence to conduct the sampling activities and the Kit to a designated analytical laboratory for processing and reporting of results in order to determine the risk presented by a property and damages it may have sustained.

A system provides for fuzzy classification in comparisons of scanner responses. A web application test suite performs tests against a web application by sending client requests from a testing computer to the server running the web application and checking how the web application responds. A thorough web application security scan might involve thousands of checks and responses. As a result, some sort of programmatic analysis is needed. One such evaluation involves comparing one response against another. Response matching that compares two HTTP responses might use fuzzy classification processes.

A method and system for generating an optimized suite of test cases includes deriving a set of use case constraints and generating a test suite based upon the set of use case constraints.

An intelligent test system for testing software code is provided. The intelligent system includes a profiled software component, a test executor, a database, a database updater, and a data analyzer/optimizer. The test executor creates a coverage data by using the profiled software component to execute a plurality of test cases of a test suite. The database stores the coverage data and the database updater is configured to store the coverage data into the database. The data analyzer/optimizer analyzes the coverage data contained in the database to find test cases affected by a modification to the software code. The data analyzer/optimizer also optimizes the test cases affected by the modification by selecting fewer test cases that satisfy a criteria. The test executor uses the test cases that satisfy the criteria to test the modification to the software code.

A method and apparatus is disclosed herein for determining whether a test case is to be included in a test suite. In one embodiment, the method comprises executing an application with test inputs of a test case during performance of software application testing and using a Finite State Machine (FSM) model of observable events generated from execution of other test cases in the test suite to determine whether to include the test case in the test suite for use in future testing of the application.

A method for model-based testing of an industrial system includes modeling functionality of an industrial system using a modeling computer language, enhancing the model by adding functionality or refining existing functionality, generating test suites from the system model, and executing the test suites. The modeling computer language is the Unified Modeling Language (UML), wherein modeling includes defining UML use case diagrams to describe relationships among use cases specified for the system and actors who interact with the system according to the use cases, defining UML activity diagrams to model process logic of each use case, wherein the activity diagrams comprise a sequence of activities and transitions, and defining UML class diagrams to specify data categories and attributes that are inputs to the activities of the activity diagrams, wherein data categories relevant for a use case are modeled as test variables in the activity diagram.

A mechanism for testing execution of applets with plug-ins and applications is described. In one embodiment, a data structure that specifies at least two applets of a plurality of applets is accessed. Based on the data structure that specifies the two applets, a plug-in that executes with an application is caused to attempt to execute each of the two applets. After causing the plug-in to attempt to execute the two applets, results are generated based on the attempt to execute each of the two applets. The mechanism may be implemented to test multiple test suites that each comprise one or more test cases that each include an applet, and reports may be generated for individual test cases, test suites, or a set of test suites. This embodiment of the present invention minimizes the time required for testing and allows for testing the effects of applets that are not visible to a user.

A system for testing a software build is presented. A current software build is compared to a reference software build, typically a known, previous build. The comparison identifies those areas in the current software build that have changed with regard to the reference software build. The identified areas are used by a coverage analysis process to determine a focused test suite to test the modified areas of the current build. The test coverage analysis uses information in a master test suite to determine the focused test suite. The focused test suite is used by a test process to test the modified areas of the current software build. The coverage analysis process may also identify those areas of the current software build that cannot be tested using the tests in the master test suite. A report is generated identifying those areas that are not covered by the focused test suite.

The invention provides automated test suite for compliance testing of cloud storage server to a Cloud Data Management Interface (CDMI) by performing functional testing of CRUD (Create, Read, Update, and Delete) operations. It offers a solution containing test scripts for validating the response from CRUD operations performed on CDMI objects and checks for the cloud storage to be CDMI compliant.

A system and method is disclosed to estimate both, the time and number of resources required to execute a test suite or a subset of test suite in parallel, with the objective of providing a balanced workload distribution. The present invention partitions test suite for parallelization, given the dependencies that exists between test cases and test execution time.

A mechanism has been developed for transforming different test suites, written for different test harnesses, into a common XML-type format that can be read by one test harness. Thus differences in the structure of the test suites is transparent to the test harness. To implement this mechanism, a component has been developed that parses XML descriptors and provides an API to the test harness.