95 results about "Test suite" patented technology

The invention discloses an LLM-based controller CAN communication test method and system, and the method comprises the steps: converting a DBC file into a configuration file, reading a VSS and CAN signal corresponding relation file, and inputting the VSS and CAN signal corresponding relation file to an LLM; calling an LLM model, and generating a test case according to the cue word; constructing an automatic framework to implement an execution function based on a behavior-driven development BDD mode; and associating the generated test case with an execution function in the automation framework, constructing a complete test suite, and operating the test suite to execute a CAN bus communication test. VSS path and CAN Signal verification is carried out on the basis of the controller which already realizes the VSS technology, the test case conforming to the BDD natural language is generated by using the LLM, the test case is directly used as the test script, the step of manually compiling the test case is omitted, the test efficiency is improved, and the test cost is reduced.

The invention provides a vector optimization algorithm translation method and device oriented to an RISC-V vector extension platform, and relates to the technical field of computer software cross-architecture translations. The method comprises the steps that source codes of vector optimization algorithms written by other platforms and translation cues are input into a large language model; outputting a translation code of a vector optimization algorithm oriented to the RISC-V vector extension platform; the translated codes are input into a compiler to be compiled; under the condition that compiling succeeds, a compiling product is linked to the test suite to obtain an executable program, and unit testing is conducted on the executable program on the RISC-V vector extension device; and under the condition that the unit test is passed, determining that the translation code is a first version of correct translation code of a vector optimization algorithm oriented to the RISC-V vector extension platform. According to the method, a vector optimization algorithm written by using a special vector language for other platforms is efficiently translated to the RISC-V vector extension platform.

Processing within a computing environment is facilitated by determining a set of microservices needed to execute a microservice test suite in a test environment, where the test environment is an active microservice test environment with a plurality of microservices. The process also includes determining that the test environment lacks sufficient resources to run the microservice test suite with the set of microservices, and dynamically removing at least one microservice of the plurality of microservices from the test suite not needed to execute the microservice test suite to free test environment resources for executing the microservice test suite with the set of microservices. The process also includes initiating executing, based on the dynamically removing, the microservice test suite in the test environment.

There is provided a system and method of automatic software testing. The method includes obtaining an input including software code of a software program and metadata, and feeding the input to a machine learning model to generate a test suite usable for testing the program. The test suite comprises a set of tests meeting a predefined condition. The test suite is generated by generating at least one question related to at least one of: expected intents of one or more sections of the software code, or tests for testing the sections, and presenting the at least one question to a user; upon receiving feedback from the user, analyzing the feedback with respect to the predefined condition, and determining whether to generate at least one new question; and, in response to an affirmative determination, repeating the above process with respect to the new question, until the predefined condition is met.

Systems and methods for testing sandboxed in-kernel programs are provided. A method of testing a program includes: obtaining a Berkeley Packet Filter (BPF) program to test; obtaining a test to run on the BPF program; performing the test on the BPF program for a plurality of Linux kernels and reporting a result of performing the test on the BPF program for a plurality of Linux kernels. This enables a generic testing solution for black box testing of BPF programs. The embodiments can integrate with existing testing suites and frameworks and can integrate into CI / CD pipelines. Some embodiments allow testing using any kernel from user space. Host kernel testing of BPF programs is enabled by a developer using the developer's own workstation and version of the Linux kernel. Guest kernel testing of BPF programs is enabled using specific kernel versions by providing the framework a specification of the target kernel environment.

The invention relates to the technical field of integrated circuits, and provides a verification platform, a verification method, electronic equipment and a medium. The verification platform comprises: an application layer bus function level model comprising a customized interface for a to-be-tested design for interacting with the to-be-tested design, the to-be-tested design being a PCIe protocol docking and protocol compliance test suite, and the to-be-tested design being a PCIe protocol docking and protocol compliance test suite; the PCIe protocol docking and protocol compliance test suite supports a verification demand of a physical layer intellectual property core and a verification demand of protocol consistency of a PCIe controller and a physical layer subsystem level; and the to-be-tested design interacts with the application layer bus function level model through the customized interface. Thus, the integration and through-flow debugging cost of subsystem protocol consistency verification is reduced, the verification period of a docking test of PCIe subsystem protocol standardization is shortened, and the completeness of docking verification of a full quantization protocol of a PCIe subsystem and the platform reuse efficiency are improved.

The invention discloses an intelligent test generation method, system and device for an H5 page and a medium, and the method specifically comprises the steps: collecting a user operation event sequence of the H5 page, and building an operation log stream with a timestamp through the user operation event sequence; collecting equipment fingerprint data and a network delay index, and performing space-time correlation coding on the equipment fingerprint data and the network delay index to generate an enhanced operation track data set; inputting the enhanced operation track data set into a pre-trained depth time sequence neural network to obtain an anomaly detection result; sending out safety early warning based on an abnormal detection result, extracting boundary condition features in the operation log stream, and automatically generating a boundary test case set; and fusing the boundary test case set with the user operation reproduction case, constructing a hybrid test suite, and triggering an automatic test assembly line through a CI / CD integrated interface. According to the method, the comprehensiveness, the accuracy and the efficiency of H5 page testing are remarkably improved, and the performance and the safety of the H5 page are effectively guaranteed.

The invention relates to the technical field of deep learning testing, in particular to a deep learning test sample generation method utilizing a reinforcement learning optimization genetic algorithm, which comprises the following steps: constructing different types of seed data sets based on an image data set, and determining and initializing an initial population; obtaining a deep learning model, executing a genetic algorithm, and optimizing the initialized initial population; combining reinforcement learning to dynamically optimize genetic algorithm parameters; and performing iterative optimization on the optimized initial population through the optimized genetic algorithm to generate a new population, screening a data sample with a prediction error, and obtaining a test suite. The deep learning model and the genetic algorithm are integrated, the genetic algorithm is executed, reinforcement learning is introduced to dynamically optimize operation parameters of the genetic algorithm, the problems of local optimum and parameter sensitivity are solved, generation of a test suite with smaller distribution difference is promoted, the convergence speed of fitness can be effectively improved, and the robustness of the deep learning model is improved.

A remote software development infrastructure can include cross-continent datacenters with a variety of remote devices. The infrastructure can provide automated testing on the remote devices. A software development kit (SDK) can be used to integrate a test suite with the infrastructure. The SDK can modify the test suite to issue test commands to a remote test server of the infrastructure, as opposed to local test servers. A remote test server routes the test commands to a remote device in a datacenter. Both local testing and remote testing of a test script is possible. The SDK enables cross-browser, cross-device, cross-operating system and / or parallel testing of the test suite, without the user having to make code changes to the test suite. The test results and additional information are automatically captured and are aggregated in a dashboard in the form of aggregated reports and other graphical user interface elements.

The invention relates to the technical field of software engineering and automatic testing, and discloses a self-adaptive multi-dimensional risk testing strategy design method and system and a storage medium. The method comprises the following steps: triggering a risk assessment service through a CI / CD assembly line, preprocessing original data obtained by a plurality of heterogeneous data sources, and generating a risk feature vector; outputting a multi-dimensional risk index by using the risk assessment model, fusing the multi-dimensional risk index and the dynamic weight thereof based on an adaptive weighted fusion model, and calculating a comprehensive risk score; dynamically updating a risk score threshold value used for dividing the risk level, automatically generating a test strategy matched with the current risk level according to a preset mapping rule of the risk level and the test strategy, and calling the test suite to automatically execute the test strategy; and collecting a test execution result and online operation data as training data, and regularly optimizing parameters of the risk assessment model. The test strategy can be dynamically adjusted according to the real-time risk situation.

A computing platform may receive test input information comprising input information to validate code for an application. The computing platform may test the code by inputting the test input information into the application and executing the code to produce initial test results. The computing platform may store the test input information / initial test results in a table. The computing platform may identify that subsequent testing should be initiated. The computing platform may automatically identify the test input information and the corresponding initial test results using the stored table. The computing platform may automatically test the application by inputting the test input information into the application and executing the application to produce automated test results. The computing platform may compare the automated test results to the initial test results. Based on identifying that the automated test results match the initial test results, the computing platform may deploy the application.

The invention discloses a multi-modal-based automatic test script generation method and system, and the method comprises the steps: a user describes a test demand through a natural language, uploads an interface screenshot to carry out multi-modal input, and calls a large language model to generate an AIRTEST script; performing mode matching on the generated script by using a regular expression, extracting all picture element names, and performing reordering processing to form an element name list; the original interface screenshot and the element name list are input into the visual large model, and the visual large model is required to return standardized coordinate data; image cutting operation is executed based on the coordinate data, and actual image resources are provided for the test script; and automatically generating a. Air item folder named by a timestamp, creating a Python script file with the same name in a directory, writing a test script code generated previously, storing picture resources obtained by cutting into the item folder, and forming a complete executable test suite meeting the requirements of an AIRTEST framework. According to the invention, the core pain points of high learning cost and difficult maintenance of a traditional automatic test tool can be solved.

The invention discloses a whole-process intelligent unit testing method driven by a large language model, belongs to the technical field of software testing, and aims to solve the problems of poor testing quality, difficulty in effective understanding of testing intentions and low coverage rate of testing codes in existing unit testing. The method comprises the following steps: intelligently analyzing a to-be-tested code driven by a large language model; automatically generating a test code driven by the large language model; testing code intelligent verification driven by the large language model; error codes driven by the large language model are automatically repaired; and automatic construction of a test suite and intelligent evaluation driven by a large language model. According to the method, the advantages of the large language model in the aspects of natural language understanding and code generation are fully played, so that the large language model can more accurately grasp the test intention and the function requirement, the generation quality and the coverage range of the test code are remarkably improved, and a brand new solution is provided for realizing efficient, intelligent and whole-process automatic unit test generation.

A diversified validation test suite application (DVTSA) for a generative AI powered tool or large language model (LLM) tool includes at least first, second, and third control logics. The first control logic receives a seed test input or user input, analyzes the seed test input or user input, and extracts key elements for variations. The second control logic performs a coverage measurement of outputs of the first control logic. The third control logic causes a human validator to evaluate outputs of the second control logic relative to predefined coverage metrics and selectively and continuously iterate to cause outputs of the second control logic to increase LLM tool input robustness and output robustness from a first level to a second level greater than the first level, in both production and pre-production LLM tool processes.

The invention relates to an OCamml unit test system, which adopts a layered architecture design and comprises a test driving layer, a test case regulation layer and a test suite function layer. The test driving layer automatically manages compiling, execution and result archiving of OCAML test codes through Makefile scripts; the test case regulation layer defines and organizes test cases based on a standardized template, and each test case annotates and declarates information such as a unique identifier and an airworthiness demand number through structured metadata; the test suite function layer comprises an assertion module, a report generation module, a data conversion module and a test auxiliary module. Through the layered architecture design, standardized management and automatic execution of the test process are realized, the standardization and traceability of the test activity are ensured, a complete demand-test-verification traceability evidence chain is provided for airworthiness certification, and the strict requirement of the high-security field for unit test is met.

In accordance with a technique of parallelized computer system testing, a processor develops, on a representative computer system, a plurality of groups of system tests based on test-ordering constraints, where the system tests in each of the plurality of groups are executable in a temporally overlapping manner. The processor applies a test suite including a sequence of multiple of the plurality of groups of system tests to a production computer system. Applying the test suite includes performing the system tests in each of multiple of the plurality of tests groups in a temporally overlapping manner, such that testing efficiency is improved.

There is provided an architecture, methods and a system for live testing in a production environment. The architecture comprises a platform independent Test Planner for generating a test package in response to receiving an event. Generating a test package comprises selecting test goals, generating a test suite and generating a test plan. The architecture comprises a platform dependent Test Execution Framework (TEF) for executing the test package in an environment serving live traffic. Executing the test package comprises initializing the test plan, starting the test plan and reporting the successful completion of the test plan, reporting the suspension of the test plan and waiting for further instructions, or reporting a failure of the test plan and executing a corresponding contingency plan.

The application provides an artificial intelligence-based software test case automatic generation system and method, relates to the technical field of software testing, and comprises the following modules: a project management data acquisition module that collects code metadata and project management data; a dynamic risk weight allocation module that inputs the two types of data into a risk prediction model, outputs a risk heat map, and allocates the dynamic risk weight of the input parameters; a basic test suite generation module that generates a basic test suite according to the input parameters and the dynamic risk weight; and a software test algorithm execution module that starts a software test algorithm and iteratively evolves to generate a test case set. The application solves the technical problem that the existing software test case generation mode is difficult to effectively integrate software related data to identify high-risk links, and the generated test cases are insufficient in covering key areas and low in accuracy, achieves the technical effect of accurately identifying high-risk links of software, and the generated test cases are more targeted, thereby improving software testing efficiency and software quality evaluation accuracy.

This invention provides a method and system for evaluating the compatibility of power grid business applications with processor architectures. The method includes: determining a power grid business scenario-based test suite based on the type of the power grid business application to be evaluated. The test suite includes a power industry protocol test script for verifying the processor architecture's power protocols, a real-time control performance test script for evaluating the processor architecture's control performance, and a power grid data consistency verification script for verifying the processor architecture's timing synchronization. On a multi-platform test environment cluster, an automated task scheduling engine is used to execute compatibility tests of the power grid business application on each processor architecture within the multi-platform test environment cluster, based on the power grid business scenario-based test suite. A rule engine is used to generate a compatibility rating level based on multi-dimensional test indicators collected during the testing process, achieving a comprehensive evaluation of the compatibility of the power grid business application with the processor architecture in terms of functional adaptation, performance, and data consistency.

Systems and methods for checking the correctness of a computer program with at least one incorrect instruction inserted into at least one of a plurality of branches of the computer program. At least one prover generates a counterexample of computer program correctness in order to switch focus from a failed proof of the correctness of the computer program to a failed test of the correctness of the computer program.

The application discloses a kind of keyword-driven spaceflight TT&C software automation test method and system, method includes: based on the formation keyword of spaceflight TT&C software operation process;Spaceflight TT&C software operation process uses multiple programming languages;Keyword uses uniform programming language;Configuration test case template, template element is defined based on test case template and forms test case;Wherein, at least one of natural language, keyword and test data defines template element;According to the attribute of test type, filter test case and pack the test case filtered into test suite;Execute test case in test suite and collect execution, according to mapping rule, fill execution into corresponding test document template to form test document.The application can complete multiple complex spaceflight TT&C software test by the keyword and test case design compatible with multiple programming languages, realize that test script writing language is uniform and forms general operation to multiple spaceflight TT&C software.

The invention provides a continuous integration test balance method and device based on dynamic quality evaluation and a medium, and belongs to the technical field of vehicles. The method includes monitoring a code submission event, capturing changes in the code submission event, forming change set data, and determining a quality assessment indicator from a plurality of data sources. And determining a comprehensive risk coefficient of current code integration by utilizing the set risk assessment model according to the quality assessment index and the change set data. And dynamically deciding a corresponding test execution strategy according to the comprehensive risk coefficient, driving a corresponding test suite according to the corresponding test execution strategy, and distributing a corresponding test task to obtain a test execution result. The efficiency of continuous integration testing is improved, and testing resources are optimized.

The invention discloses a unit test generation method based on a large language model, and belongs to the field of test generation. The method comprises the steps that firstly, context information related to a tested method is extracted through a static analysis means, then the tested method is sliced through the extracted context information by means of a large language model, an original complex method is cut into multiple sections of simple code slices, and the multiple sections of simple code slices are stored in a database; and finally, generating different unit test methods for each section by utilizing the code slice information, and combining a plurality of unit test methods into a final test suite. According to the method, the codes are sliced through the large language model, the complex codes are segmented into the multiple simple codes, then the test cases are generated, and compared with the mode that the test cases are generated for the tested method through the large language model directly, the line coverage rate and the branch coverage rate of the complex method are effectively increased.

The invention discloses a timely software quality assurance method based on automatic defect detection and software testing, and belongs to the technical field of software quality assurance. The method comprises the following steps: pre-training a timely defect prediction model, predicting a prediction probability that a current code change has defects, and judging whether the current code change needs to be tested or not; searching a test suite related to the current code change; selecting or generating a test case related to the current code change; and executing the test case to judge whether the current code change introduces defects or not, and updating the timely defect detection model by using the current code change. According to the method, a collaborative guarantee mechanism of automatic defect detection and software testing is constructed, the advantages of real-time prediction and determinacy verification are fused, test resources are dynamically optimized, the problems of verification delay and test case missing are solved, efficient quality guarantee without manual intervention is achieved, and the software development iteration rate and reliability are remarkably improved.

A system accesses a code module that includes one or more units of code and instructs a machine learning model to generate a test suite based on a specification for the code module. The test suite includes tests for testing the code module to verify that one or more units of code successfully execute in accordance with the specification. The specification includes preconditions that precede successful execution of the one or more units of code and postconditions that exist following successful execution of the one or more units of code. The machine learning model generates the test suite. The system receives the test suite from the machine learning model. The system stores and / or transmits the test suite for use in testing the code module.

The invention discloses a CGF initial test data selection method based on coverage rate analysis of anti-sensitive neurons. An adversarial sample is generated based on training data, and an absolute difference between an original sample and the adversarial sample in an activation state in a neural network is used to identify an adversarial sensitive neuron, and then a proportion of the test data set to activate the adversarial sensitive neuron is used as a coverage rate. Through the method, the ability of the intelligent software test suite to verify the robustness of the model can be effectively evaluated. According to the CGF initial seed selection method based on the adversarial neuron coverage rate, the initial seed scale can be greatly reduced under the condition that the adversarial neuron coverage rate is basically unchanged, and the CGF efficiency is effectively improved.

This invention discloses a method and system for generating static code checkers based on a large language model. The method involves: acquiring rule descriptions and a test suite containing positive and negative examples; generating detection logic corresponding to the rule descriptions and their corresponding checker specifications using the large language model; retrieving the corresponding API context based on the detection logic; generating candidate checker code based on the checker specifications, rule descriptions, test suites, and the retrieved API context; validating the candidate checker code based on the test suites and relevant rule descriptions; and obtaining the final checker code that passes the verification. The method proposed in this invention significantly reduces the technical threshold and development cost of customizing checkers for static analysis frameworks, efficiently generating checker code with high accuracy, low false positive rate, and low false negative rate, and possesses good scalability.

The invention provides a board card performance test method, device and equipment, and the method comprises the steps: obtaining a standard data file generated by testing a board card, and analyzing the standard data file to obtain a target test suite name and a measurement data set; determining a target board card type to which the target test suite represented by the target test suite name belongs; determining a target configuration file corresponding to the target board card type based on an associated file representing the corresponding relationship between the board card type and the configuration file; analyzing the target configuration file to obtain a performance standard value and a data analysis mode corresponding to the target test suite name; and determining a performance test result of the board card based on the measurement data set and the performance standard value through a data analysis mode. Therefore, the performance test efficiency of the board card can be improved.

Aspects of the invention include mutating each neural network of a portion of a first array of neural networks, wherein each neural network of the first array of neural networks is configured to select a respective sequence of test cases for testing a computing infrastructure. Causing each neural network of a second array of neural networks to select a respective sequence of test cases for testing the computing infrastructure. Generating a child neural network by performing a crossover operation between a mutated neural network of the portion of the first array and a neural network of the second array of neural networks, the child neural network generating a new sequence of test cases for testing the computing infrastructure.