808 results about "System under test" patented technology

Apparatus and methods facilitating a distributed approach to performance and functionality testing of location-sensitive wireless data communication systems and equipment are described. A plurality of test units, geographically distributed at arbitrary points in a three-dimensional volume surround the system or equipment under test. Each test unit generates test stimuli and records responses from the device under test, and emulates the effects of changes in spatial location within an actual wireless network environment. A central controller co-ordinates the set of test units to ensure that they act as a logical whole, and enables testing to be performed in a repeatable manner in spite of the variations introduced by the location sensitive characteristics of wireless data communication networks. The central controller also maintains a user interface that provides a unified view of the complete test system, and a unified view of the behavior of the system or equipment under test. For diagnostic purposes, the recorded responses may be regenerated to view any defects as many times as necessary to correct them. Alternatively, each test unit may have either wired network interface units, instead of a wireless interface unit to test systems or equipment forming part of a wired network portion in the wireless data communication system.

A generic testing framework to automatically allocate, install and verify a given version of a system under test, to exercise the system against a series of tests in a “hands-off” objective manner, and then to export information about the tests to one or more developer repositories (such as a query-able database, an email list, a developer web server, a source code version control system, a defect tracking system, or the like). The framework does not “care” or concern itself with the particular implementation language of the test as long as the test can issue directives via a command line or configuration file. During the automated testing of a given test suite having multiple tests, and after a particular test is run, the framework preferably generates an “image” of the system under test and makes that information available to developers, even while additional tests in the suite are being carried out. In this manner, the framework preserves the system “state” to facilitate concurrent or after-the-fact debugging. The framework also will re-install and verify a given version of the system between tests, which may be necessary in the event a given test is destructive or otherwise places the system in an unacceptable condition.

The invention discloses an automatic detection system of an embedded type system based on a testing script technique, comprising a crosslink environment modeling module, a testing panel allocation module, a testing script interpreter, a multi-task scheduling module, an interface drive module, a data collection module, a testing report generation module and a testing management module. The multi-task scheduling module transmits registered tasks interpreted by the script interpreter to the interface drive module through the crosslink environment modeling module, then the interface drive module excites a system to be tested to finish the test, wherein the interface drive module provides uniform interfaces for the system. The invention is a solution to the defects that the traditonal testing system has poor universality and low automatization degree and has the capability for secondary development.

An automated system that randomly generates test cases for use in hardware or software quality assurance testing, wherein a given test case comprises a sequence (or “chain”) of discrete, atomic steps (or “building blocks”). A particular test case (i.e., a given sequence) has a variable number of building blocks. The system takes a set of test actions (or even test cases) and links them together in a relevant and useful manner to create a much larger library of test cases or “chains.” The chains comprise a large number of random sequence tests that facilitate “chaos-like” or exploratory testing of the overall system under test. Upon execution in the system under test, the test case is considered successful (i.e., a pass) if each building block in the chain executes successfully; if any building block fails, the test case, in its entirety, is considered a failure. The system adapts and dynamically generates new test cases as underlying data changes (e.g., a building block is added, deleted, modified) or new test cases themselves are generated. The system also is tunable to generate test sequences that have a given (e.g., higher) likelihood of finding bugs or generating errors from which the testing entity can then assess the system operation. Generated chains can be replayed easily to provide test reproducibility.

A generic testing framework to automatically allocate, install and verify a given version of a system under test, to exercise the system against a series of tests in a “hands-off” objective manner, and then to export information about the tests to one or more developer repositories (such as a query-able database, an email list, a developer web server, a source code version control system, a defect tracking system, or the like). The framework does not “care” or concern itself with the particular implementation language of the test as long as the test can issue directives via a command line or configuration file. During the automated testing of a given test suite having multiple tests, and after a particular test is run, the framework preferably generates an “image” of the system under test and makes that information available to developers, even while additional tests in the suite are being carried out. In this manner, the framework preserves the system “state” to facilitate concurrent or after-the-fact debugging. The framework also will re-install and verify a given version of the system between tests, which may be necessary in the event a given test is destructive or otherwise places the system in an unacceptable condition.

The method comprises: reading out the pre-configured test solution; according to the function type in said test solution, calling the relevant functional test script; said functional test script calls a browser to open the relevant webpage window of the Web application system under test, and records the identifier of the webpage window; said functional test script calls the browser interface to input the data and operation of current test solution into said webpage window to get test result.

An apparatus and method for high-resolution reflectometry that operates simultaneously in both the time and frequency domains, utilizing time-frequency signal analysis and a chirp signal multiplied by a Gaussian time envelope. The Gaussian envelope provides time localization, while the chirp allows one to excite the system under test with a swept sinewave covering a frequency band of interest. High resolution in detection of the reflected signal is provided by a time-frequency cross correlation function. The high-accuracy localization of faults in a wire / cable can be achieved by measurement of time delay offset obtained from the frequency offset of the reflected signal. The apparatus enables one to execute an automated diagnostic procedure of a wire / cable under test by control of peripheral devices.

A method and apparatus is provided that enables accurate measurement of drop rate and delay in a System Under Test (SUT) by one or more monitoring devices even when the frame error rate of the monitoring devices may be imperfect. During a packet drop measurement process, ancillary information is identified and analyzed to determine if the ancillary information can be used to infer receipt of packets when explicit information regarding receipt is not present. A delay measurement process incorporates the time required to re-transmit packets into the delay measurement to more accurately reflect SUT operation.

The technology disclosed includes a software architecture for methods and devices used to test routers, switches and the like, particularly high volume infrastructure devices. In particular, this architecture associates test data stream definitions with emulated devices that send test frames or packets to and receives them from a system or device under test (“DUT”). By relating the test data stream definitions to definitions of the emulated devices that are coupled to the DUT, automation of test frame and / or test packet design improves, especially where some of the information needed to generate test frames and / or packets is dynamically generated during a test.

According to an embodiment of the present invention, a computer implemented method and system for automated test and retesting using an interactive interface provided by a computer processor comprising: a test case builder, comprising at least one processor, configured to automatically generate code for a test case; a test flow tool, comprising at least one processor, configured to generate a plurality of test flows for the test case; an execution engine, comprising at least one processor, configured to automatically execute the plurality of test flows on a system under test; and an output interface configured to receive output data from the system under test.

A method for synchronizing different components of a computer network system using meta-commands embedded in normal network packets. The data communication channel between different components of a computer network system can be used to transport meta-commands piggybacked in normal network packets, without modifying or compromising the validity of the protocol message. Embodiments of the method can be used for embedding test synchronization and control commands into the network packets sent through a device or system under test. The device or system under test can be an edge device, with the data communication channel carrying normal packets containing meta-commands embedded in the packets to synchronize the test control of the test clients and the test servers connected to the edge device.

The invention discloses a testing method and system based on a message, which are used for a multiprotocol tested system. Particularly, the method comprises the following steps of: obtaining a test case and analyzing an interface name, parameter values of test parameters and a predicated result out of the test case; determining an interface description file corresponding to the interface name and analyzing a protocol type and attribute information of the test parameters out of the interface description file; converting the parameter values according to the attribute information of the test parameters; splicing the converter parameter values to form a message; and calling a protocol communication processor corresponding to the protocol type to send the message to a tested system. Different interface description files are defined and generated according to different message protocol types so that the test parameters in the test case are converted into the parameter values meeting the protocols according the interface description files of the different protocol types, and the different protocol communication processors are called according to different protocol types to receive and send messages to the tested system; and therefore, the tested system with a plurality of protocols can be conveniently tested and a plurality of test tools do not need to be troublesomely replaced.

An apparatus and method for high-resolution reflectometry that operates simultaneously in both the time and frequency domains, utilizing time-frequency signal analysis and a chirp signal multiplied by a Gaussian time envelope. The Gaussian envelope provides time localization, while the chirp allows one to excite the system under test with a swept sinewave covering a frequency band of interest. High resolution in detection of the reflected signal is provided by a time-frequency cross correlation function. The high-accuracy localization of faults in a wire / cable can be achieved by measurement of time delay offset obtained from the frequency offset of the reflected signal. The apparatus enables one to execute an automated diagnostic procedure of a wire / cable under test by control of peripheral devices.

A design verification system generates a small set of test cases, from a finite state machine model of the application under test. The finite state machine is reduced by creating efficient samples of the inputs to the application under test which are prepared by combinatorial input parameter selection. The test cases are generated by finite state machine traversal of the reduced state machine, and tests interacting combinations of input parameters in an efficient way. The technique is integrated into a test generator based on a finite state machine. Using an extended language, partial rulesets are employed to instruct the test generator to automatically employ combinatorial input parameter selection during test generation. Another technique for test case generation is disclosed, which uses combinatorial selection algorithms to guarantee coverage of the system under test from the aspect of interaction between stimuli at different stages or transitions in the test case.

A system and method for testing an application on a target system are described. The target system is assigned a logical name which is used by within a test script to reference the target system. The logical name is associated with a plurality of different communication channels within a system data container (e.g., remote function call (“RFC”) channels, HyperText Transport Protocol (“HTTP”) channels, . . . etc). During replay of the test script, a particular communication channel is selected from the plurality of communication channels based on the type of command within the test script that references the target system using the logical name.

A distributed simulation system includes at least a first node and a second node. The first node is configured to simulate a first portion of a system under test using a first simulation mechanism. The second node is configured to simulate a second portion of the system under test using a second simulation mechanism different from the first simulation mechanism. The first node and the second node are configured to communicate during a simulation using a predefined grammar. In various embodiments, simulation mechanisms may include one or more of: a simulator and a simulation model of the portion of the system under test; a program coded to simulate the portion; a program designed to provide test stimulus, control, or test monitoring functions for the simulation as a whole; an emulator emulating the portion of the system under test, or a hardware implementation of the portion.

The invention discloses a concurrent connections performance testing system and a concurrent connections performance testing method for a file system. A master control node and at least one testing node are arranged, wherein the testing node is arranged on an application server of a storage system, is mainly used for simulating an application load to test a tested system, is connected with the tested file system through a storage network, and is used for testing the tested system; and the master control node performs centralized management which comprises process scheduling and task management on the testing node through a local area network, and is used for performing centralized management on all testing nodes and counting a test result. The system comprises a parameter processing module, a tested system information collecting module, a system initialization module, a condition monitoring module, a distributed management module, a load testing module, a result counting and reporting module and a system recovery module, solves the problems that the concurrent connections of the file system are not definitely defined and a detailed and useable testing method is lacked in the prior art, and is particularly suitable for the concurrent connections performance test of a distributed file system.

A system for applying distributed software simulation techniques to hardware emulation may include a first hardware emulator mounted on a first expansion board at a first host, and a second hardware emulator mounted on a second expansion board at a second host. The first hardware emulator may be configured to emulate a first portion of a system under test, and the second hardware emulator may be configured to emulate a second portion of the system under test, and the first and second hardware emulators may coordinate an emulation of the system under test using one or more messages, i.e., a coordination of an emulation of the system under test may be accomplished using communications between the first and second hardware emulators.

The invention discloses an integrated test system and a relevant method for distributed software systems. The system comprises a test server, at least one test client end and at least one test agent; the test server is respectively connected with the test client end and the test agent, in order to fulfill test on external systems under test according to test information; meanwhile, feed the test results back to the test client end; the test client end is used to receive and transmit test information, control the test server to perform tests, and receive test results; the test agent is also linked to a system under test through an interface for the system under test, in order to monitor message that are received and transmitted through the interface; meanwhile, the test agent is respectively interactive and adaptive with the test server and the system under test, and receives and transmits test message as well as relevant response message. Therefore, the invention adapts to test the second generation of distributed software systems that are fulfilled with distributed computation technology, increases and improves test tool expansibility and integrated test efficiency, and makes for execution of all types of integrated tests and guarantees quality of software products.

An electronic arrangement for analyzing a model-based testing scenario relating to a system under test (SUT), includes a model handler entity for obtaining and managing model data indicative of a model intended to exhibit the behavior of the SUT, a test plan handler entity for obtaining and managing test plan data indicative of a number of test cases relating to the model and expected outcome thereof, a test execution log handler entity for obtaining and managing test execution log data indicative of the execution of the test cases by the test executor and / or SUT, a communications log handler entity for obtaining and managing communications log data indicative of message traffic between the test executor entity and SUT, and an analyzer entity for detecting a number of failures and their causes in the model-based testing scenario on the basis of model, test plan, test execution log and communications log data.

An automated software test is provided which includes a functional model of a system to be tested. The automated software test is utilized to operate a system under test in accordance with specified facts, goals and rules. Quasi-random actions are taken within the system in accordance with specified rules and facts until a defined goal has been accomplished. Training the automated software test is accomplished by specifying a particular goal, i.e. identifying a particularly known defect, and thereafter running the test in a quasi-random fashion until the particular goal has been achieved. The number and nature of actions required to achieve that goal are logged and the process is then repeated until the shortest path required to achieve that goal has been determined. The log of actions which eventually reach a particularly defect may also be utilized a probable cause tree structure for future analysis.

Methods and apparatus for testing performance of an system under test are disclosed. The system under test is loaded with simulated traffic which may be generated from a single test port. The performance of the system under test under load may be tested.

A technique is disclosed for performing testing of an optical device under test (DUT). According to a specific embodiment, the DUT includes a plurality of DUT optical input ports and a plurality of DUT optical output ports. The testing may be performed by an optical switching testing system (OSTS) which includes a plurality of OSTS output ports optically connected to a plurality of DUT input ports, and a plurality of OSTS input ports optically connected to a plurality of DUT output ports. Components of the OSTS are configured in order to perform a specific test on the DUT. A first test scenario is configured at the DUT. At least one optical test signal is transmitted to at least one DUT input port. Test results may then be obtained by monitoring at least one DUT output port for the presence or absence of light. The test results are then analyzed for specific characteristics. According to a specific embodiment, the OSTS of the present invention may be adapted to automatically perform a plurality of testing operations on a selected plurality of different optical paths associated with the DUT. Such testing operations may include, for example, transmitting a plurality of optical test signals to a plurality of DUT input ports during a given test scenario, and / or monitoring a plurality of DUT output ports for test results during a given test scenario. According to a specific embodiment, the optical switch testing system of the present invention may be used to measure and verify selected characteristics associated with a device under test (DUT) or a system under test (SUT). Such characteristics may include, for example, optical cross talk, insertion loss, polarization dependent loss, path switching time, data integrity, optical path verification, optical path stability, etc.

The invention discloses a novel method and system for optimizing a software test case. According to the invention, the advantage of analytic hierarchy process on determining weighted values, as well as the technical advancement of the ant colony algorithm and genetic algorithm on determining the simplest and first priority ordering case subset are utilized. The method comprises the following steps: determining the weighted value of each functional requirement of a to-be-tested system by using the single hierarchical arrangement and total ordering of the analytic hierarchy process as well as the quantification of consistency testing; determining a test case subset, with full covering on all functional requirements and minimum operation cost, by combining the ant colony algorithm with the obtained weighted values and through an essential strategy, a redundancy strategy and a greedy strategy; determining a new estimation formula by combining the genetic algorithm with the obtained weighted values and on the basis of obtaining the simplest case subset; determining a test case sequence with highest error detection rate by a selection operator, a crossover operator and a mutation operator.

A method and system comprising a diagnostic symptom tree system for diagnosing a failing system element causing a symptom in a system-under-test. A diagnostic symptom tree comprises symptom roots and dependent lower function nodes and sub-function nodes. Element nodes depend from the function or sub-function nodes, and a plurality of penultimate failure mode leaves depend from the element nodes. The function and sub-function nodes and the failure mode leaves comprise test information. Responsive to positive test results, the diagnostic symptom tree is configured to identify a function or sub-function or element node associated to a lowest symptom tree node or failure mode leaf for which a test is positive, or advise that no failing function or sub-function or element is found. In one aspect of the invention, nodes may include parameter values allowing successive selections of the nodes of the symptom tree for test iterations according to the parameter values.

The invention supplies software line up using program mapping method and its program line up system. The method includes the following steps: supplying testing agent by the tested target machine; the testing agent according to the testing data base to generate tested program symbol table and type list; it according to the preset script to map the variable and function in the symbol table and type list to variable container, generate script language mapping variable and function. The invention maps variable read-write and function call of the tested system into connate grammar of the script language which can increase software line up ability and line up script exploiting efficiency.

A distributed simulation system includes a plurality of nodes. Each node is configured to simulate a portion of a system under test. The simulation is performed as a series of timesteps. The transition between timesteps is synchronized in the plurality of nodes. In one implementation, the distributed simulation system includes a hub which is configured to synchronize the transition between timesteps in the plurality of nodes. For example, in one embodiment, the hub may receive commands from each of the plurality of nodes. If each command indicates that the corresponding node is capable of completing the timestep, the hub transmits a command to each node indicating that the timestep is complete. The nodes may begin processing the next timestep in response to the command. In other embodiments, a hub may not be included.