44 results about "Model-based testing" patented technology

Some embodiments of the present invention provide a system that tests a software program. During operation, the system creates a behavioral model of the software program using branches, decisions, and options. Next, the system generates a test case from the behavioral model and executes the test case on the software program. Finally, the system analyzes an output of the executed test case to determine a validity of the software program.

An execution engine synchronizes test suite execution to run multiple independent operations concurrently or in parallel. The execution engine operates by stepping through the test suite. At each step it runs the required number of independent operations and waits for their completion. It then checks the results, and continues to the next step of the test suite. If at any step, the actual results are different from the expected results, then the exact sequence that triggered the fault is known. The sequence can be repeated when a correction is provided for the fault. Furthermore, the execution engine allows the user to interactively step through a test case when debugging a fault. A synchronization pattern generator may be incorporated in the system to generate minimal numbers of repetitions of test cases to guarantee varying degrees of interaction coverage.

A testing system and various methods involving testing of a device under test (DUT) use a device model to model a stimulus-response behavior of a the DUT. The testing system includes a device model of the DUT that is fitted to the stimulus-response behavior of the DUT and a measurement projector connected to an output of the device model. The device model includes a block diagram model and a difference model. Test metrics for the DUT are produced by the measurement projector from an output of the fitted device model.

Disclosed is a method for using source code to create the models used in model-based testing. After exploring the intended behavior of a software package, a test engineer writes source code to model that intended behavior. The source code is compiled into a model, and the model is automatically analyzed to generate numerous test scripts that can exercise the behavior of the software package. When the tests are run, their results are compared against intended behaviors, and discrepancies are used to correct the software package (or to correct the source-code model if it was prepared incorrectly). The model coding, test generation, test execution, and comparison steps are repeated as often as necessary to thoroughly test the software package. In some embodiments, the test scripts generated by the model are written in XML (Extensible Markup Language), allowing the easy integration of the test scripts with a number of XML-based tools.

A test coverage tool provides output that identifies differences between the actual coverage provided by a test suite run on a program under test and the coverage criteria (e.g., the coverage criteria required by the test / development team management). The output from the test coverage tool is generated in the same language that was used to write the coverage criteria that are input to an automated test generator to create the test cases which form the test suite. As a result, the output from the coverage tool can be input back into the automated test generator to cause the generator to revise the test cases to correct the inadequacies. This allows iterative refinement of the test suite automatically, enabling automated test generation to be more effectively and efficiently used with more complex software and more complex test generation inputs.In preferred embodiments, test coverage analysis results of several different test suites, some manually generated and others automatically generated, are used to produce a streamlined automatically-generated test suite and / or to add missing elements to an automatically generated test-suite.

Some embodiments of the present invention provide a system that tests a software program. During operation, the system creates a behavioral model of the software program using branches, decisions, and options. Next, the system applies a weight assignment technique to the behavioral model to create a set of global identifiers (IDs), which correspond to test cases of the behavioral model. The system then generates a test case from the behavioral model and executes the test case on the software program. Finally, the system analyzes an output of the executed test case to determine a validity of the software program.

Systems and methods are described that dynamically reprioritize test cases for Model-Based Testing (MBT) during test execution. Test case execution is prioritized according to their potential to detect uncovered failures within a design model.

An electronic arrangement for analyzing a model-based testing scenario relating to a system under test (SUT), includes a model handler entity for obtaining and managing model data indicative of a model intended to exhibit the behavior of the SUT, a test plan handler entity for obtaining and managing test plan data indicative of a number of test cases relating to the model and expected outcome thereof, a test execution log handler entity for obtaining and managing test execution log data indicative of the execution of the test cases by the test executor and / or SUT, a communications log handler entity for obtaining and managing communications log data indicative of message traffic between the test executor entity and SUT, and an analyzer entity for detecting a number of failures and their causes in the model-based testing scenario on the basis of model, test plan, test execution log and communications log data.

A method and apparatus for concurrency testing within a model-based testing environment is provided. One implementation involves concurrency testing within a model-based software system testing environment, by receiving concurrent test service requests; duplicating a model representing software under test, based on the number of requests; sending the concurrent requests to each of the duplicated models sequentially but in different orders; storing the outcomes of each of the models; comparing the outcomes from the models to the outcome from the software system under test; and if all comparisons fail, then indicating test failure.

Some embodiments of the present invention provide a system that tests a software program. During operation, the system creates a behavioral model of the software program using branches, decisions, and options. Next, the system applies a weight assignment technique to the behavioral model to create a set of global identifiers (IDs), which correspond to test cases of the behavioral model. The system then generates a test case from the behavioral model and executes the test case on the software program. Finally, the system analyzes an output of the executed test case to determine a validity of the software program.

Middleware is validated using a two layered modeling strategy for the generation of test suites. A high level model of the syntax of the programming language used to program the middleware generates a series of high level abstract programs. These high level abstract programs then undergo two separate translations. First they are translated directly into actual test programs, which are expressed in the programming language of the middleware. Second, they are translated into second models of the high level abstract programs. Running the model based test generator again on the second models produces a set of suites of test cases, each test case consisting of data inputs and predicted results for one of the actual test programs. The actual test programs are run repetitively using the middleware execution engine. The results are compared with the predicted results, using a generic validation engine.

Systems and methods are described that dynamically reprioritize test cases for Model-Based Testing (MBT) during test execution. Test case execution is prioritized according to their potential to detect uncovered failures within a design model.

A software testing system uses a graph traversal algorithm to explore a model simulating a software product in order to identify errors in the software product. The model employs a Petri's net construct for maintaining state and governing transitions. In particular, the model mediates between a test driver and the software product. The model-based approach is usable both to validate the design of the software and verify the implementation of that design. Using the Petri net model, the test space is bounded.

Some embodiments of the present invention provide a system that tests a software program. During operation, the system creates a behavioral model of the software program using branches, decisions, and options. Next, the system generates a test case from the behavioral model and executes the test case on the software program. Finally, the system analyzes an output of the executed test case to determine a validity of the software program.

A method is provided for creating a behavior pattern of a computer program which comprises at least one source code with a plurality of program operations which are arranged in a logical succession and the source code is provided with annotations. Each annotation is referencing to a respective program operation and the annotations are read out automatically by a modeling tool, which is running on a processing unit and generating the behavior pattern of the computer program by arranging the annotations which have been read out according to the logical succession of the program operations and providing the generated behavior pattern, so that the generated behavior pattern can be represented via a representing unit. Furthermore, an appropriate server and an appropriate network system are provided.

The invention discloses a model-based automated test method for a spacecraft system and belongs to the field of system testing. The method comprises the steps of firstly building a window tree model of a tested spacecraft system through a formalization method, classifying behavior states of the tested spacecraft system during operation according to business processes, and constructing a system behavior state transition diagram; secondly traversing a window tree to generate a test case set, running the test case set in a tested spacecraft digital model and validation prototype system, setting tracking points, obtaining system behavior states and recording a state transition sequence; and finally checking whether the obtained state transition sequence obeys a state transition rule or not through a model detection algorithm, thereby automatically validating overall design of the tested spacecraft system and interface design among modules. According to the method, the test cost of the spacecraft system and the whole research and development cycle of the spacecraft system are reduced and shortened by adopting a model-based test technology; and the quality and accuracy of spacecraft system testing are improved by adopting the formalization method and the model detection algorithm.

A system and computer-implemented method for automatically categorizing test cases is provided. The system comprises a test case importing module configured to receive one or more test cases and a primary grouping module configured to sort the received test cases based on description of the test cases into groups and form a test case array connecting each of the one or more received test cases with a corresponding group number. Furthermore, the system comprises a test step matrix generator configured to receive the one or more test cases and analyze test steps corresponding to each of the one or more received test cases to create a test step matrix. In addition, the system comprises a matrix concatenator configured to concatenate the test case array with the test step matrix and a secondary grouping module configured to generate one or more groups of test cases belonging to one or more categories.

The invention belongs to the technical field of model-based test automation of software engineering, discloses an embedded software black-box test case generation method based on a static model and solves the problems that the black-box test based on requirement specification documents is behind, difficult to understand and low in test efficiency, and test case quality is unguaranteed. The technical scheme includes the embedded software black-box test case generation method includes (1) adopting a data flow diagram, a fault tree, a cause-and-effect diagram, a decision table, a nest mechanism of diagrams and expanded semantics of the diagrams to construct the static model of the embedded software; (2) based on the static model, planning test items, and automatically generating black box test case collections corresponding to the test items according to a test coverage principle and a test case generation algorithm. The embedded software black-box test case generation method is applicable to static test requirement description of the embedded software and black-box test case generation.

The invention discloses a model-based test method for avionics systems and relates to the technical field of avionics system test. By loading a data model of an early design modeling stage, aiming at different interface definitions and behavior logics, a corresponding test use-case model is automatically generated. Test case creation by hand is changed and the working efficiency of generating use cases during test links is greatly increased; at the same time, the manmade errors are reduced. For the stipulation of test case data, the unified management of test cases is realized, which improves the efficiency of management and avoids the possibility of multiple meanings of the same data. It also provides data models for test case execution, test result analysis and report generation. In addition, through the test environment adaptation, various data transmission error is reduced and the degree of automation of the test is increased; through the use case analysis, the coverage rate of use case results on demands and design data is clear.

An embedded assembly modeling and testing method based on an expansion interface automata model relates to the field of software testing and testing automation based on a model and is applicable to testing of an embedded assembly. The embedded assembly modeling and testing method is characterized in that the automata model with constraint conditions is used for description aiming at assembly interface operation, data and behaviors, and a testing case set is generated on the basis of the graph searching and constraint solving technology. The embedded assembly modeling and testing method includes: (1) constructing the expansion interface automata model of the embedded assembly and (2) defining a testing coverage rate goal on the basis of the automata model and generating a normal function testing case and a robustness testing case which achieve the testing coverage rate goal.

The invention provides a model-based test system and method, and relates to the technical field of aviation electronic system tests. The method includes the steps that on the basis of a test requirement, a test case model is generated according to original design model data; a configuration file is generated according to the test case model; the configuration file is loaded on an adaptive test platform, the test case model is executed, and test result information is obtained; according to the test result information, the test case model which does not meet the test requirement is managed to bea test defect record; the test requirement and the test case model which correspond to each other are associated, a mapping relation is established, and a requirement coverage analysis result is calculated according to the mapping relation; a test case coverage analysis result is calculated according to the test case model, and a defect coverage analysis result is calculated according to the testdefect record. The system and method can improve the working efficiency, management efficiency and automation degree of the aviation electronic system tests and reduce the error rate.

An arrangement for providing integrated, model-based testing of industrial systems in the form of a model-based test design module, a test execution engine and an automated test infrastructure (ATI) component. The ATI component includes a keyword processor that interfaces with test commands created by the design module to implement the testing of a specific industrial system. Configuration and deployment information is also automatically created by the design module and used by the ATI component to set up and control the specific industrial system being tested.

A method of testing a downhole component configured to be incorporated in a drilling assembly includes generating a mathematical drilling assembly model representing a connecting string as a virtual connecting string and describing a behavior of the connecting string in response to rotation of the drilling assembly, disposing the downhole component at a sample of a formation material, and rotating the downhole component by applying a torque to the downhole component via a torque motor based on the drilling assembly model and a selected rotational rate of a virtual top drive. The method further includes inputting real time measurements of an angular velocity of the downhole component into the drilling assembly model, calculating a target torque corresponding to an amount of torque that would be applied to the downhole component by the virtual connecting string, and adjusting the applied torque from the torque motor to correspond to the target torque.

The invention discloses an extended finite state machine test data generation method based on variable division, and belongs to the technical field of software test, in particular to the technical field of model-based test. In the test based on extended finite state machine, how to improve the searching efficiency of the algorithm is a key problem in obtaining test data by heuristic method. The invention provides a method for automatically dividing independent input variables in a test path on the basis of a genetic algorithm. This method is characterized by in-depth analysis of variables andvariables in the model, The relationship between a variable and a predicate condition, determining an independent input variable that does not affect the predicate condition in the subpath and its initial partition migration, At the same time, a dynamic executable model framework is developed to provide the information feedback needed by the algorithm, and then the segmented input variables are gradually separated from the individual in the search process of genetic algorithm to achieve the automatic reduction of search space, quickly generate test data of the target test path, and improve theefficiency of test data generation.

The invention discloses an unmanned vehicle simulation test case generation method and system, and relates to the technical field of unmanned vehicle testing. The method comprises the steps: selectinga test site of a test case in a simulation environment; determining initial states of a main vehicle and a participant in the test case, and generating the main vehicle and the participants in the test site; designing an action behavior of the participant in the test case according to an atomic behavior action, and designing a judgment rule of the main vehicle; connecting a tested object to the main vehicle of the simulation environment, and controlling the participant to carry out testing; and analyzing test data according to the action behavior of the participant and the judgment rule of the main vehicle, and returning a test result. The limitation that a traditional unmanned vehicle simulation test uses a fixed test case is broken through, great flexibility is brought to the design ofthe test case, and a technical foundation is laid for model-based test verification in the field of automatic driving.

An arrangement for providing integrated, model-based testing of industrial systems in the form of a model-based test design module, a test execution engine and an automated test infrastructure (ATI) component. The ATI component includes a keyword processor that interfaces with test commands created by the design module to implement the testing of a specific industrial system. Configuration and deployment information is also automatically created by the design module and used by the ATI component to set up and control the specific industrial system being tested.

Provided is a method for automated verification of a software program in a Behavior-Driven Development environment and a data processing system configured to execute such a method. Individual test steps of BDD test scenarios are first matched and then assigned to existing test step definitions from a BDD framework. If a one-to-one matching is not possible, natural language processing is used to decide if an assignment is possible with a certain matching probability. The assigned test step definitions are used to generate graphical test models for the test scenarios, e.g., UML diagrams. Finally, executable test scripts are generated to test the software program. The present invention relates particularly to Behavior-Driven Development and combines traditional BDD advantages with Model Based Testing for improved convenience and automatization in case of complex software packages.