7697 results about "Test case" patented technology

An apparatus is provided for evaluating risk to an organization. The apparatus includes a plurality of governmental rules directed to protecting shareholders, a plurality of security domains of the organization wherein each security domain is associated with a different asset of the organization and a request for an information risk assessment within at least one of the plurality of security domains of the organization formed under the plurality of governmental rules from a set of initializing inputs. The apparatus further includes a information risk assessment plan formed from the request for the information risk assessment, a set of information assessment templates and test cases formed from the information risk assessment plan, a set of information risk assessment tests conducted on the IT system using the assessment templates and test cases, a set of test results generated by the risk assessment tests, one or more security control gaps identified by the assessment responses and one or more gap remediation plans formed from the identified security gaps.

A system and method for automatically creating testcases for design rule checking comprises first creating a table with a design rule number, a description, and the values from a design rule manual. Next, any design specific options are derived that affect the flow of the design rule checking, including back end of the line stack options. Then, the design rule values and any design specific options (including back end of the line stack options) are extracted into testcases. Next, the testcases are organized such that there is one library with a plurality of root cells, further comprising one root cell for checking all rules pertaining to the front end of the line, and another root cell for checking design specific options including back end of the line stack options. Finally, the DRC runset is run against the testcases to determine if the DRC runset provides for design rule checking.

In one embodiment, the present invention is a method for automatically preventing errors in computer software. The method includes storing the computer software in a code repository; executing a plurality of software verification tools to verify the computer software, wherein each of the plurality of software verification tools automatically generates one or more test cases; generating verification results responsive to executing the plurality of software verification tools and the automatically generated test cases; processing the verification results for generating an objective criterion of quality of the computer software; and customizing the scope of one or more of the plurality of verification tools responsive to the objective criterion of quality of the computer software.

A method, apparatus, article of manufacture, for generating a test code for an automatic procedure is disclosed. The method comprises the steps of presenting a visual representation of a library of executable code objects comprising a plurality of test objects to a user, accepting a selection of a first test object in the visual representation, presenting first test object options defining at least one test parameter, accepting a selection of a first test option, translating the first test option into at least one tag and at least one tag parameter, and storing the tag and the tag parameter in a source file. The article of manufacture comprises a data storage device tangibly embodying instructions to perform the method steps described above. The apparatus comprises computer with suitable program instructions for presenting a visual representation of a library of executable code objects to a user. The library of executable code objects includes a plurality of test object members, each of which define a set of instructions for performing a portion of the test procedure. The computer is also configured to implement a graphical user interface, to accepting a selection of a first test object in the visual representation, to present test options for the selected test object, and to accept a test object option.

Non-redundant software testing is provided based on changes in the execution paths of a software program. Upon changes to the code of the software program, changed or new execution paths are identified. Test cases capable of traversing the changed or new execution paths are then identified and executed to test the modified code. The difference between a first plurality of execution paths of the software program before the changes to the code and a second plurality of the execution paths of the software program after the changes to the code is identified. Test cases that intersect the changed paths may be identified and new test cases may be developed that would execute the changed paths.

The present invention provides a system, method and computer program for generating a final optimized test data set. An initial test data set, one or more data rules and one or more business rules are provided. The initial test data set is then modified using the one or more data rules. The modified test data set is optimized using an orthogonal array. The final optimized test data set is then generated by applying the one or more business rules to the optimized test data. The present invention can be implemented using a computer program embodied on a computer readable medium wherein each step is executed by one or more code segments. The system used to implement the present invention may include a data storage device, a processor and one or more input / output devices.

A computer-implemented method for generating and managing test documentation for a software product may include steps of generating a test template; generating at least one test scenario for each of a plurality of functional areas, each test scenario being configured to test a business flow that mimics how an end user would use the software product; associating the generated test scenario(s) with the generated test template; generating at least one test case that includes a plurality of test steps; associating the generated test case(s) with the generated test template; copying the test template to generate test results, the generated test results being independent of the generated test template, and carrying out a test cycle by executing the test scenario(s) and the test case(s) associated with the generated test results of the generated test template and storing the results of the executed test scenario(s) and the executed test case(s) in a database.

A system and method for analyzing a computer program includes performing a static analysis on a program to determine property correctness. Test cases are generated and conducted to provide test output data. Hypotheses about aspects of execution of the program are produced to classify paths for test cases to determine whether the test cases have been encountered or otherwise. In accordance with the hypothesis, new test cases are generated to cause the program to exercise behavior which is outside of the encountered test cases.

A system and method provide testing of software in different configurations automatically. Templates may be provided for developers to create an application or for generating tests. One or more tests may be generated for testing the application. The testing scope may range between a plurality of configurations for the application in one or more environments. Tests may include test blocks corresponding to parts of the application for testing according to the execution order of the parts of the application. Tests may change input values, modules in the application, configuration settings, data types, communication parameters, and / or other application elements for testing. Such changes may be generated automatically during testing. Test code may be inserted in the application for testing. Application generation and compilation may be automated during testing. Deployment and undeployment of applications may also be automated for testing.

A pluggable semantic verification and syntactic validation mechanism for server configuration information. In one embodiment, the data verification and validation mechanism may be implemented as modules that may be plugged into a framework. In one embodiment, the mechanism may include a generic test case framework that may call test cases to verify and validate changes to configuration information. In one embodiment, each test case may implement an interface through which the framework calls a test case. The test case may return results, e.g. whether the test passed or failed, and may return additional information, e.g. why the test failed. If the change is valid, then the change may be made to the configuration information. If the change is not valid, the change is not made or alternatively is made with a warning. If the change is made, one or more other servers may be notified of the change.

An exemplary method includes parsing data representative of an automated test case into at least one transaction defined in accordance with a global test language, translating the transaction into at least one command specific to an automated test tool, and providing the command to the automated test tool for execution. In certain examples, the method further includes parsing the data representative of the automated test case into at least one other transaction defined in accordance with the global test language, translating the other transaction into at least one other command specific to another automated test tool, and providing other command to the other automated test tool for execution.

In software development, risks can be quantified and defined by certain attributes. For instance, a risky area will have a large number of defects / changes for that area, a large number of high severity defects for that area, or a large number of coders / authors for that same area. All these metrics are already captured in Unified Change Management tools, version control tools and bug tracking tools. By taking the appropriate data and associating them with certain triggers and thresholds, an embodiment of the invention automatically identifies which test cases to run for regression. Through historical and previous test data and test runs, an embodiment of the invention forecasts how long it will take to run these regression suites.

A method of a visual test authoring and automation solution framework for an enterprise comprising supporting the creation of a test case for a visual application. First, the framework allows a user to assign a user-defined name to a test element, and select an action to be performed on the test element from a menu of actions. Second, the framework stores a mapping of the user-defined name assigned to the test element to a coded name in a corresponding language of an automated testing tool. Lastly, the system uses the mapping and the action selected to create the test case in the corresponding language of the automated testing tool.

Embodiments of the present invention address deficiencies of the art in respect to software test automation and provide a method, system and apparatus for a reusable software testing framework. In one embodiment of the invention, an automated application test data processing system can include a reusable test automation framework. The system further can include a test task generator and a scenario generator coupled to one another and to the framework. In this regard, the test task generator can be configured to generate uniform logic for performing testing tasks, while the scenario generator can be configured to arrange testing tasks for a complete test scenario. Finally, a collaborative testing environment can be provided through which multiple users can interact with the scenario generator and test task generator to produce test cases of different test scenarios

A method, apparatus, article of manufacture, and a memory structure for generating a test code for an automatic procedure is disclosed. The method comprises the steps of defining a source file having a plurality of tags associated with a member of a library of executable code objects defining a set of instructions for performing a portion of the automatic test procedure, generating a test plan in a conventional language from the source file, and generating an automated test code for the automated test procedure from the source file. In one embodiment, a test index identifying system elements tested by the test code is generated and incorporated into the test plan, allowing the user to verify that all desired system elements are exercised by the automated test code. The article of manufacture comprises a data storage device tangibly embodying instructions to perform the method steps described above. The apparatus comprises means for defining a source file having a plurality of tags, wherein each tag is associated with a member of a library of executable code objects defining a set of instructions for performing a portion of an automatic test procedure, means for generating a test plan in a conversational language from the source file, and means for generating an automated test code for the automatic test procedure from the source file.

A computer system, method and computer program product for automatically converting, through automating-test-automation software, a manual test case representation (in a natural language), for testing a target software, into a machine-readable test case representation. In preferred embodiments, the machine-readable test case is in the form of a keyword-based test case that is made from action-target-data tuples. The automation-test-software uses a methodical process of trial-and-error to resolve ambiguities that are generally present (and generally resolvable by humans) in the manual test case representation.

The invention describes an automated software support system comprising automated bug filing and test case creation component to checkpoint a client process initial state and record the client process initial state changes while the client process undergoes sequence of states which need to be analyzed, such as software bug, deliver the recordings to a development node, where the problem can be debugged without reproducing the client process environment by using the recorded state to recreate initial state of the client program and by using the recorded log to simulate the client program execution forwards and backwards.

A test result analyzer for processing results of testing software. The analyzer has an interface emulating the interface of a traditional data logger. After analyzing the test results, selected results may be output to a log file or otherwise reported for subsequent use. The test result analyzer compares test results to results in a database of historical data from running test cases. The analyzer filters out results representative of fault conditions already reflected in the historical data, thereby reducing the amount of data that must be processed to identify fault conditions.

The invention provides a method for automatically generating software test cases. The method comprises the following steps of: A. reading to-be-tested software, carrying out lexical analysis, syntax analysis and semantic analysis on a source program of the to-be-tested software and generating an abstract syntax tree and a control flow graph of the to-be-tested software; B. preprocessing the source program of the to-be-tested software by traversing the generated abstract syntax tree, identifying initial input-output variables and compressing the space of a definition domain of the initial input variables; and C. generating a path of program elements of the current to-be-tested software by traversing the control flow graph, carrying out assignment operation, implication operation and backtracking operation on the variables in the path, and generating the test cases. The invention also provides a system for automatically generating software test cases. The method and the system for automatically generating the software test cases can accurately and automatically generate the test cases according to the given program elements of the to-be-tested software and verify the generated test cases, thereby improving the accuracy, efficiency and automation degree of the test cases.

A system and method provide testing of software in different configurations automatically. Templates may be provided for developers to create an application or for generating tests. One or more tests may be generated for testing the application. The testing scope may range between a plurality of configurations for the application in one or more environments. Tests may include test blocks corresponding to parts of the application for testing according to the execution order of the parts of the application. Tests may change input values, modules in the application, configuration settings, data types, communication parameters, and / or other application elements for testing. Such changes may be generated automatically during testing. Test code may be inserted in the application for testing. Application generation and compilation may be automated during testing. Deployment and undeployment of applications may also be automated for testing.

Testcases are run to test the design of an integrated circuit. The coverage of the testcases is evaluated and compared against one or more microarchitecture models that define the behavior of a portion of the integrated circuit. If the coverage of the testcases is not adequate, new testcases are generated to test the previously untested behavior specified in the microarchitecture models.

A three-dimensional application program framework structure; a method for implementing an application program based on the same; and an automatic testing system based on a three-dimensional application software framework and a method therefor. The three-dimensional application program framework structure provides a framework comprising functions and management of the environment of the system and events to be implemented by the user (developer), and the developer can easily expand the graphic user interface (GUI) and an actual modeling function as required, and user model. In addition, by using an automatic test system based on the framework, it is possible to record the function-execution history of the user and to automatically generate a test case, and to thereby test the functioning of the application software through the use of the test case regardless of changes in the source code and the GUI.

Systems and methods of testing, of software applications, based on business process models are described herein. In one example, the method comprises receiving, by a processor, the at least one business process model, wherein the at least one business process model is indicative of a business process associated with the software application and analyzing, by the processor, the at least one business process model to identify at least one test scenario. The method further comprises generating, by the processor, a set of test cases and test data for the at least one test scenario and producing, by the processor, a set of test automation scripts based on one or more keywords associated with the at least one test scenario.

The invention relates to the use of model checkers to generate efficient test sets for hardware and software systems. The method provides for extending existing tests to reach new coverage targets; searching *to* some or all of the uncovered targets in parallel; searching in parallel *from* some or all of the states reached in previous tests; and slicing the model relative to the current set of coverage targets. The invention provides efficient test case generation and test set formation. Deep regions of the state space can be reached within allotted time and memory. The approach has been applied to use of the model checkers of SRI's SAL system and to model-based designs developed in Stateflow. Stateflow models achieving complete state and transition coverage in a single test case are reported.

A method and system for test automation is described. The method may include creating a test case on a client computer; generating expected testing results by manually executing the test case on a computer system; performing automated testing on the computer system using the test case to generate automated testing results; validating the test case by comparing the automated testing results with the expected testing results; marking the test case as automatable, if the automated testing results match the expected testing results; and storing the automatable test case for later execution.

The invention relates to an automatic test system of a movable terminal, which comprises a testing and management server, a testing personal computer (PC) client terminal and a movable testing terminal. The testing and management server is used for managing testing resources, managing testing tasks, monitoring testing state, sending testing reports and storing testing logs, the testing PC client terminal comprises a testing script developing and debugging environmental module and a testing execution module, and the movable testing terminal is the movable terminal provided with a movable testing terminal agent module. The automatic test system organizes user testing tasks by using a mode of separating testing logic and testing using cases, improves maintainability, greatly reduces working capacity for creating, amending and maintaining a testing script, lowers cost of users on using the automation testing system, and brings convenience for customers in amending the testing using cases.

A machine implemented technique for performing dynamic globalization verification testing in a software user interface includes identifying one or more user interface controls in the software user interface having text strings that have been pseudo translated, generating one or more applicable test cases that test for display defects stemming from the pseudo translations, executing the test cases, and logging defects.

A client-based web server application verification and testing system that requires no technical training, yet provides effective and efficient automated testing. The invention facilitates the rapid generation of test cases for a web site, and the automated execution of those test cases via distributed computing. The transitions through a web site are mapped onto a tree control to exploit user familiarity with a dual pane graphical interface and the drag / drop operation on tree controls. The tree is populated primarily by an autonomous spider exploring the site. Complex sequences requiring form inputs are added by recording sample sequences and then allowing the user to prune from all possible permutations of those samples. The export and import of form input data to a spreadsheet provides additional flexibility. Both the exploration and validation tasks may be distributed to a network of computers.

A method and device with instructions for testing a software application include creating a system model for the software application, wherein the system model includes an activity diagram, and applying one or more test annotations to the activity diagram to control test generation for testing the software application. Further, test annotations and the system model are processed to create one or more test cases, and the software application is tested using a test execution tool that uses the test cases.