116 results about "System under test" patented technology

The invention discloses a software test expected result prediction method and system based on deep learning, and the method comprises the steps: obtaining multi-source heterogeneous data of a tested system, and carrying out the preprocessing and correlation fusion based on the multi-source heterogeneous data, so as to determine a multi-modal data set; performing feature extraction on the multi-modal data set through a text encoder, a structured data encoder and a time sequence feature encoder to obtain a plurality of feature vectors, and performing fusion processing on the feature vectors to generate a feature vector set; performing deep learning reasoning on the feature vector set, and generating a multi-dimensional prediction result through multi-head self-attention mechanism and cross-modal attention fusion; and carrying out dynamic verification and conflict resolution processing on the multi-dimensional prediction result to generate a test expectation result conforming to system constraints and business logic. According to the method, the multi-modal features are automatically extracted and fused through the deep learning technology, the accurate test expected result is generated, manual intervention is reduced, and the software test efficiency and accuracy are improved.

The invention is applicable to the technical field of interface testing, and provides an artificial intelligence-based interface testing optimization method, which comprises the following steps: constructing a multi-dimensional interface knowledge graph of a tested system, the multi-dimensional interface knowledge graph comprising but not limited to static structure information, business semantic information and running state feature information; based on the multi-dimensional interface knowledge graph, the driving state and the action space, deploying a test agent based on reinforcement learning; in the test agent, according to a preset multi-target reward function, executing a target-oriented exploration action, and generating a dynamic test case; according to the method, the twinborn test environment of the tested system is constructed for the test agent to perform exploratory test and generate the test case set, the value density of the test cases generated by the method is high, defects can be effectively found, the test cases are associated with interface service semantics and operation rules, and the reliability of the test cases is improved.

The invention provides a testing method, a server and a storage medium, and relates to the technical field of testing. The test method is applied to a server, a control module and a tested system module are deployed on the server, communication connection is established between the control module and the tested system module, the current operation environment of the server is a pre-silicon environment, and the test method can comprise the following steps: adopting the control module to test a target main program of a test tool through the target main program; test task information is sent to the tested system module, and the main program is used for shielding the peripheral interface and providing simulation test data; the tested system module is adopted to perform test operation based on the test task information to obtain a test result, and the test result is sent to the control module; and receiving a test result by using a control module. The control module deployed on the server based on the pre-silicon environment and the tested system model are tested, so that the dependence on an external control terminal is thoroughly eliminated, the server of the pre-silicon environment is independently operated and tested, and a result is obtained.

Techniques for assigning scenario-based tests to test assets are described. In an example, a scenario-based test operable to test a key performance indicator (KPI) of a System Under Test (SUT), a component behavior exhibited by a first component of the SUT, and a scenario characteristic are received. Based on the component behavior and the scenario characteristic, a first plurality of behavior models associated with the component behavior are identified. Based on the scenario characteristic a characteristic value is extracted from the scenario-based test. Each behavior model of the first plurality of behavior models is executed using the characteristic value to generate a first plurality of predicted behavior outcomes. Based on the first plurality of predicted behavior outcomes, a first test asset type from a plurality of test asset types is selected and the scenario-based test is transmitted to a test asset of the first test asset type.

The invention discloses a method and device for recommending a test case, and the method comprises the steps: obtaining a change function for code change in response to the monitored code change of a tested system; determining a to-be-recommended regression test case for testing code change according to the multi-dimensional information, the multi-dimensional information comprises a dependency relationship and a mapping relationship of a change function obtained in advance, function semantic information of the change function, function semantic information of a dependency function, a historical execution record of the regression test case, and any multiple items in importance attributes of the regression test case; the dependency function refers to a function having a dependency relationship with the change function, and the mapping relationship comprises a regression test case and a function which can be tested by the regression test case; and performing regression testing on the tested system according to the to-be-recommended regression test case.

Method for testing a system. A computer-implemented method for testing a system, in particular a computer program, a hardware system or an embedded system, is presented. Here, a first part of an execution structure for the system is examined using static analysis in terms of whether the system runs error-free when executing an execution path corresponding to the first part of the execution structure. If an error-free execution is determined in the static analysis for the first part of the execution structure, an examination of the system is carried out using dynamic analysis, which skips the execution path corresponding to the first part of the execution structure.

To provide a test precondition data derivation apparatus capable of easily deriving test precondition data corresponding to a test case.SOLUTION: Teacher data storage means stores teacher data used when generating, by machine learning, a model for deriving test precondition data that is either an SQL statement for registering data in a database of a system under test before execution of a test, or a file to be stored in a predetermined folder of the system under test before execution of the test, or both. Machine learning means generates a model for deriving the test precondition data by machine learning using the teacher data. Test precondition data derivation means derives test precondition data corresponding to a test case by applying the input test case to the model.SELECTED DRAWING: Figure 4

The application relates to a pipeline inter-module state transmission method and system, electronic equipment and a readable medium. The method comprises the following steps: an upstream test module obtains a running parameter through non-user interface interaction with a system under test, and writes the running parameter into an in-process shared storage area; a downstream test module detects a data ready state of the in-process shared storage area before execution; if the data ready state is ready, the downstream test module directly reads the running parameter from the in-process shared storage area; if the data ready state is not ready, the downstream test module obtains the running parameter by identifying user interface display information of the system under test; and the downstream test module executes a test task by using the obtained running parameter. The downstream test module can quickly obtain parameters from the shared storage area, and automatically switches to a user interface identification mode when the shared storage area is unavailable, thereby improving test efficiency and independent execution capability of the module.

The invention discloses a multi-target test selection method and system under a test uncertainty condition based on E domination guidance. The method comprises the following steps of: firstly, explicitly modeling uncertainty in a test process by using a detection probability matrix and a false alarm probability matrix; secondly, establishing a multi-objective optimization model which takes the minimum test cost, the minimum missing report rate and the minimum false alarm rate as objectives and takes the fault detection rate and the fault isolation rate as constraints; introducing an E domination relation fused with the preference of a decision maker to improve a traditional Pareto domination criterion; on the basis, designing an E-GPSO algorithm fusing a genetic algorithm and particle swarm optimization to perform iterative search, and dynamically maintaining a non-inferior solution set by adopting an external file based on an E domination criterion; and finally, outputting an optimal test scheme set meeting the constraint and the preference. According to the method, the test cost and the diagnosis reliability can be effectively coordinated and optimized, the decision space is remarkably reduced, and the efficiency and the quality of testability design are improved.

The invention discloses a test data generation method and device, a medium and a program product. The method comprises the following steps: configuring attribute information of a tested system database in a data processing platform through a database configuration component, and establishing data connection with the tested system database through a preset connection mode; inputting test demand information of the tested system database through the test demand input component, and sending the test demand information of the tested system database to the test data generation component; and in response to the test data generation instruction, based on the data connection with the tested system database, obtaining the service test data from the tested system database through the test data generation component according to the test demand information of the tested system database so as to generate the service test data. According to the embodiment of the invention, the preparation of the service test data can be realized without knowing the query logic and technical architecture of the internal interface of the system, so that the generation efficiency of the test data can be improved.

The embodiment of the invention provides a vehicle communication intelligent fuzzy test system and method and a related device, relates to the technical field of vehicle communication test, can accurately hit the security key of a vehicle protocol, can continuously optimize a model according to an actual test effect, and improves the security vulnerability discovery efficiency. The vehicle communication intelligent fuzzy test system comprises a reinforcement learning agent, a test execution unit and a response analysis feedback unit, and the reinforcement learning agent is used for generating a semantic test case according to a current protocol session state and historical test feedback; the test execution unit is used for issuing the semantic test case to the tested system through the adaptive interface; the response analysis feedback unit is used for extracting characteristics related to vehicle safety and protocol states from related response behaviors generated after the tested system receives the semantic test case, and standardized feedback signals are formed; and the reinforcement learning agent is also used for updating parameters of the reinforcement learning agent according to the feedback signal.

To automatically set an appropriate determination rule in a test case regardless of the number of combinations of attribute values.SOLUTION: The generation device includes a request extraction unit that extracts a request from a test case including the request to be transmitted to a system to be tested and a determination rule for determining pass or fail of a test, a test execution unit that executes a test on the system to be tested by transmitting the extracted request to the system to be tested and receives a response to the request, a determination rule extraction unit that extracts the determination rule from the test case, a test result determination unit that determines pass or fail of the executed test based on the request, the response, and the determination rule, and a new rule derivation unit that generates a new rule as a determination rule to be newly applied to the test case based on the request, the response, the determination rule, and the pass or fail of the test determined by the test result determination unit.SELECTED DRAWING: Figure 2

System testing is described. An example system testing method includes: acquiring module relationship information for a system under test, the system under test including a plurality of modules, the module relationship information indicating a logical relationship between each two of the plurality of modules; and testing at least two modules in the system under test based on the module relationship information, the at least two modules being associated with each other for the same function implemented by the system under test. By use of the technical solution of the present disclosure, both system and module perspectives can be applied to system integration testing, so as to achieve a more comprehensive system testing coverage and find problems in the system under test as soon as possible, which can help to improve the system testing coverage and system testing efficiency.

The application relates to a system testing method and device, computer equipment and a storage medium, and relates to the technical field of artificial intelligence. The method comprises the following steps: according to the function type of a system to be tested, dividing the system to be tested into at least one test service module; according to the importance of each test service module, determining the test mode of each test service module; according to the test flow acquisition strategy corresponding to the test mode of each test service module, determining at least one target test flow group corresponding to each test service module, and determining the test case link and flow group execution sequence of the at least one target test flow group; according to the flow group execution sequence of each target test flow group corresponding to each test service module, calling the test case link of the corresponding target test flow group to test the system to be tested. The method can improve the test efficiency, reduce the test cost, and provide guarantee for accurately, efficiently and comprehensively testing the test system.

This invention discloses a method for dynamic virtual testing and evaluation of power grids based on digital twins: a virtual power grid dynamic simulator is connected in series between the power grid signal sensors and the controller of the system under test; the host computer transmits the dynamic parameters of the power grid to be simulated to the simulator; the simulator modulates the parameters with the actual power grid signal to generate a power grid signal containing virtual disturbances, which is sent to the controller of the system under test to disturb the operation of the system under test; the simulator can also receive control signals from the system under test and generate control signals containing disturbances, which are sent to the controller of the system under test; simultaneously, the control and output responses under disturbance are collected and analyzed to evaluate the system's stability, controllability, or resilience. The dynamic parameters of the power grid are generated by a digital twin model of the actual power grid; the response of the system under test is fed back to the digital twin model, reflecting the interaction with the power grid after connection. This invention integrates digital twins and virtual simulation to achieve safe, efficient, and low-cost testing and evaluation of grid-connected equipment under dynamic and fault conditions of the power grid.

The invention provides a test data generation method, a program product, electronic equipment and a storage medium. The method comprises the following steps: acquiring request data, aiming at a target function, of a user on a tested system and response data corresponding to the request data; the request data comprises a request field; the response data comprises a response field; comparing the request data with the response data, and determining an interface field mapping relation of the tested system; the interface field mapping relation is used for describing a corresponding relation between a response field of the tested system and a request field used for generating response data; obtaining configuration list data of the tested system, and converting the configuration list data of the tested system into test request data for the target function based on the interface field mapping relation; wherein the configuration list data comprises at least one piece of data expressed in the format of the response data. The process of independent development and data configuration for automatic testing is omitted, and the efficiency of automatic testing is improved.

The present invention describes system for facilitating testing of a System under Test (SUT). The system comprises a control unit configured to dynamically assign at least one hardware configuration to each of the one or more devices based on SUT information. Further, the control unit is configured to create at least one device classification group to include the one or more devices based on the assigned configuration, and generate a test template for each of the generated at least one device classification group based on the SUT information. Finally, the control unit is configured to perform testing, during real time operation, on the one or more devices associated with the SUT present within the at least one device classification group, based on the generated test template, test sequence, and the assigned hardware configuration to determine health status of the one or more devices.

The invention provides a block chain cross-chain test development platform, which comprises a test function development basic service module used for standardizing a test task execution process into three stages and packaging traffic generation and data acquisition services; the tested system universal adaptation module is used for defining a standardized block chain client interface and collecting system internal data through an under-chain instrumentation mechanism; the test function extension module is used for accessing and managing a test function in a plug-in manner through a unified test function interface; the multi-task concurrent scheduling module is used for maintaining a task queue through a scheduling engine, allocating tasks in parallel based on a Worker pool, and tracking and managing the test tasks at the same time; and the test resource management module is used for managing chain-level resources and maintaining the client instance pool to realize intelligent distribution, recovery and cleaning. Therefore, the development efficiency of the cross-chain test function and the automation level of the test process are greatly improved, and powerful support is provided for performance and safety evaluation of a cross-chain system.

The embodiment of the invention discloses an evaluation method, device, system and equipment of an electronic system and a medium, and the evaluation method comprises the steps that in the testing process of the tested system, the performance index value of the tested system is calculated, the power consumption value of the tested system is calculated, and the performance index comprises the number of instructions per cycle IPC, throughput and / or delay; according to the performance index value, the power consumption value and the area information of the tested system, the comprehensive energy efficiency value of the tested system is calculated, and the area comprises any one or more of the following items: the standard unit area, the storage unit area, the input and output interface circuit area and the interconnection wiring area of the tested system. By adopting the technical scheme, the comprehensiveness and reliability of the test result of the electronic system are improved.

The invention relates to a driver monitoring system test evaluation method based on a simulation robot. Comprising the following steps: step 1, constructing a simulation robot for a DMS test; 2, designing a DMS test simulation robot control system; step 3, establishing a DMS system; step 4, generating and evaluating a test case; according to the method, firstly, a simulation robot used for DMS testing is constructed, then a steering engine is selected and arranged, and fine control over fatigue actions of the simulation robot is achieved through control of a microcontroller; a python language is used as a development basis, modular design is adopted, eye detection, head posture estimation, attention evaluation, parameter configuration, a camera interface and the like are included, and a detected DMS system is deployed; and finally, based on the national standard and the actual driving behavior, generating an efficient and high-coverage test case set by adopting a combined test theory, and executing through a control system, so that the problems of low efficiency, high cost, uncontrollable action, insufficient scene coverage, lack of a standardized evaluation system and the like of the existing DMS test method are solved.

The application provides a test case automatic generation system based on a probability extended finite state machine, which can improve the efficiency and quality of test case generation, and finally generates test cases through probability selection on the processed PEFSM model. The system comprises a PEFSM model construction module, a removing unfeasible path module and a test case probability generation module. The PEFSM model construction module obtains relevant data for constructing a model from a user historical operation record database according to the requirement specification and interface design of a system under test, and outputs a PEFSM model describing the behavior of the system under test. The removing unfeasible path module takes the PEFSM model as input, adopts an evaluation path feasibility measurement method to identify and remove unfeasible paths in the PEFSM model, and outputs a reliable test path set formed by a transition path set. The test case probability generation module takes the reliable test path set as input, initializes context variables, and instantiates test paths in the path set to obtain test cases of the system under test.

The invention provides a double-engine performance automatic test system and method, and the system comprises a pressure test management and control platform which is used for receiving a user instruction, arranging a test task based on test assets, and generating a task scheduling instruction; the pressure measurement execution engine is used for receiving the task scheduling instruction, applying pressure to a tested system, injecting a tracking identifier for a pressure measurement request in the pressure applying process, and generating a first performance data flow containing the tracking identifier and a corresponding transaction performance index; the collector cluster is deployed in the tested system and is used for collecting internal running state data of the tested system in real time and generating a second performance data flow containing a system observation index; and the streaming computation engine is used for receiving the first performance data stream and the second performance data stream in parallel and carrying out real-time association and computational analysis on performance indexes in the two paths of data streams based on the tracking identifier so as to realize cross-layer performance analysis and root cause positioning.

The invention provides a multifunctional frequency characteristic test system and method. A computer control and simulation technology is adopted, a real-time simulation system is built, and an I / O interface collects a sweep frequency excitation signal of a standard instrument in real time and converts the sweep frequency excitation signal into an input signal type of a tested system; output signals of a tested system are collected, analyzed and calculated in real time, are subjected to digital-to-analog conversion through an I / O board card, and are accessed to an analysis channel of a standard instrument. The real-time simulation system sets an appropriate simulation period according to the control step length of the tested object, the real-time performance of the whole system is guaranteed, and the test result is not distorted.

The application relates to an intelligent test case generation method based on an AI adversarial model, and belongs to the technical field of computer software testing, which comprises the following steps: constructing an initial training set according to system information to be tested, test requirements and historical test data; generating a test case by using a generator of the AI adversarial model based on the initial training set; evaluating the quality of the test case by using a discriminator, and iteratively optimizing the generator based on the evaluation result; executing the generated test case, recording execution logs and intermediate results; and evaluating the execution logs and the intermediate results until a preset test termination condition is met. The test case generated by using the AI adversarial model has stronger adversarialness and pertinence, and can effectively find hidden defects that are difficult to be found by traditional methods.

The application provides a method and system for automatically generating a network security test task outline based on subjects, comprising the following steps: S1, based on task information file decomposition index requirements, analyzing network security index keywords related to network security test in the index requirements; S2, based on the network security index keywords, using a related entity discovery technology to obtain recommended subjects corresponding to the index; S3, using a mind map to display the corresponding relationship between the measured system, the index and the subject; and S4, based on the corresponding relationship between the measured system, the index and the subject, using a network security test task outline template to automatically generate a test task outline.

This invention discloses an active simulation system and method for harsh ground planes in DC testing, belonging to the field of electromagnetic environment simulation technology in electrical testing. The system employs a dual DC source architecture with a grounding switch. Two DC sources are connected to the DC power supply circuit of the device under test (DUT), and the grounding switch enables controllable switching between the dual DC sources and the ground plane. By configuring the DC output of the two DC sources and superimposing controllable ripple, while ensuring zero AC component of the voltage between the positive and negative terminals of the DUT and stable power supply, the voltage between the ground plane and the negative terminal of the DUT forms independently adjustable DC and AC components. It also provides two implementation architectures that can flexibly adapt to different testing scenarios. This invention achieves full-parameter active controllable simulation of harsh DC ground planes, accurately reproducing the actual operating conditions of DC tests such as power batteries, motor test benches, and high-power charging and discharging, significantly improving test quality and the verification accuracy of the safety and reliability of the DUT.

An automated simulation test method for test requirement modeling, comprising: modeling modules of a system under test using a module definition graph, and defining parameters, behaviors of the modules, and whether to use existing model files. A parameter graph is automatically generated from the module definition graph, the parameter graph containing models and ports corresponding to the modules participating in simulation. Input ports and output ports between the models in the parameter graph are connected according to variable transmission relationships of the modules. A state machine graph is modeled according to test requirements of the system. Test cases are automatically generated according to parameter definitions of the module definition graph and states and transition conditions in the state machine graph. Simulation engineering parameters are defined, model files are generated or existing model files are imported according to the module definition graph, and a model connection graph is generated according to the parameter graph. The engineering files are imported into simulation tool software to build a simulation engineering. The test cases are executed, and simulation results are collected. The present application improves the accuracy and efficiency of the test.

The invention discloses a signal integrity testing method and device and a storage medium, and relates to the technical field of chip testing, and the method comprises the steps: obtaining a first data eye pattern corresponding to a to-be-tested system before the current moment; performing a signal integrity test on the to-be-tested system to obtain a second data eye pattern corresponding to the to-be-tested system; carrying out superposition fusion processing on the second data eye diagram and the first data eye diagram to obtain an intermediate data eye diagram; determining a target data eye pattern corresponding to the to-be-tested system based on the intermediate data eye pattern; the target data eye diagram is determined after the data eye diagram obtained through multiple signal integrity tests of the to-be-tested system is fused, the accuracy of data receiving of the data port of the to-be-tested system is improved through the target data eye diagram, and then the reliability of signal integrity of the to-be-tested system is improved.

The invention provides a method and a device for evaluating the state of a substation automation system in a novel power system. The method comprises the following steps: establishing a fault instance library according to acquired fault data; performing accuracy evaluation on a model of the substation automation system to be tested based on the fault instance library, loading the evaluated model, and generating a model grading result; simulating and generating a fault scene based on the fault instance library, and injecting the fault scene into a to-be-tested substation automation system; generating a system representation evaluation result according to data output by the to-be-tested substation automation system; determining a comprehensive judgment result according to the representation evaluation result and the model grading result; and generating a state evaluation result according to the comprehensive judgment result in combination with manual check analysis. According to the method and the device, accurate evaluation, defect identification, fault diagnosis alarm and defect intelligent early warning of the equipment state are realized, and the automation and intelligence level of operation and maintenance of the transformer substation is improved.

This application discloses a stress testing method, apparatus, device, and computer-readable storage medium, belonging to the field of system performance testing technology. The method includes: determining the concurrency level based on the number of centralized test data sets of the system under test and the number of concurrent processing data sets of a single server in a server cluster; generating a stress testing application corresponding to the server cluster; sending the stress testing application and the concurrency level to the server cluster; and obtaining the stress testing data fed back by the server cluster. The above technical solution can easily obtain the stress testing data fed back by the server cluster and does not require the use of a dedicated stress testing machine, thus simplifying the stress testing method.