116 results about "Test suite" patented technology

The invention discloses a software test case generation method and system based on a large language model, and relates to the technical field of software testing, and the system comprises a to-be-tested module detection subsystem which is used for constructing a to-be-tested module set; the test case generation subsystem is used for constructing a prompt template according to the to-be-tested module and generating a test case by utilizing a program generation model based on an adaptive focus context generation mechanism and the prompt template; the correction verification subsystem is used for performing multi-stage correction processing on the test case, eliminating errors and generating an initial test suite; and the test case supplement subsystem is used for carrying out coverage rate analysis and variation test on the initial test suite, constructing a model input text according to a result, and generating a supplement test case by utilizing a program generation model so as to update the initial test suite and obtain a final test suite. By combining the functional annotation of the to-be-tested module with the logical reasoning ability of the LLM, misjudgment caused by assertion errors can be reduced, and the accuracy of test feedback is ensured.

The invention discloses an LLM-based controller CAN communication test method and system, and the method comprises the steps: converting a DBC file into a configuration file, reading a VSS and CAN signal corresponding relation file, and inputting the VSS and CAN signal corresponding relation file to an LLM; calling an LLM model, and generating a test case according to the cue word; constructing an automatic framework to implement an execution function based on a behavior-driven development BDD mode; and associating the generated test case with an execution function in the automation framework, constructing a complete test suite, and operating the test suite to execute a CAN bus communication test. VSS path and CAN Signal verification is carried out on the basis of the controller which already realizes the VSS technology, the test case conforming to the BDD natural language is generated by using the LLM, the test case is directly used as the test script, the step of manually compiling the test case is omitted, the test efficiency is improved, and the test cost is reduced.

A system for generating non-fungible token-based test suites from design diagrams comprises a processor associated with a server. The processor is configured to obtain image objects representing a workflow associated with a design diagram and a user profile of a user. The processor is configured to generate a design non-fungible token (NFT) associated with the design diagram to verify a design diagram ownership. The processor is configured to convert the image objects of the design diagram into corresponding text objects and to process the corresponding text objects of the design diagram to generate a plurality of text datasets corresponding to the workflow of the design diagram, analyze the plurality of the text datasets and generate a test suite which comprises a set of test scripts corresponding to the design diagram, and generate a test case NFT associated with the test suite to verify a test suite ownership.

The invention provides a vector optimization algorithm translation method and device oriented to an RISC-V vector extension platform, and relates to the technical field of computer software cross-architecture translations. The method comprises the steps that source codes of vector optimization algorithms written by other platforms and translation cues are input into a large language model; outputting a translation code of a vector optimization algorithm oriented to the RISC-V vector extension platform; the translated codes are input into a compiler to be compiled; under the condition that compiling succeeds, a compiling product is linked to the test suite to obtain an executable program, and unit testing is conducted on the executable program on the RISC-V vector extension device; and under the condition that the unit test is passed, determining that the translation code is a first version of correct translation code of a vector optimization algorithm oriented to the RISC-V vector extension platform. According to the method, a vector optimization algorithm written by using a special vector language for other platforms is efficiently translated to the RISC-V vector extension platform.

Processing within a computing environment is facilitated by determining a set of microservices needed to execute a microservice test suite in a test environment, where the test environment is an active microservice test environment with a plurality of microservices. The process also includes determining that the test environment lacks sufficient resources to run the microservice test suite with the set of microservices, and dynamically removing at least one microservice of the plurality of microservices from the test suite not needed to execute the microservice test suite to free test environment resources for executing the microservice test suite with the set of microservices. The process also includes initiating executing, based on the dynamically removing, the microservice test suite in the test environment.

An initial corpus of source code is received. The initial corpus of source code is for training an Artificial Intelligence (AI) algorithm that generates source code. The initial corpus of source code is scanned, using a test suite, to identify one or more potential vulnerabilities in the initial corpus of the source code. The identified one or more potential vulnerabilities in the initial corpus of the source code are mitigated to produce a training corpus of source code. For example, the mitigation may comprise removing malware from the initial corpus. The mitigation is to remove the vulnerabilities so that the vulnerabilities do not show up in source code generated by the AI algorithm. The AI algorithm is then trained using the training corpus of source code. The trained AI algorithm is executed to produce generated source code.

There is provided a system and method of automatic software testing. The method includes obtaining an input including software code of a software program and metadata, and feeding the input to a machine learning model to generate a test suite usable for testing the program. The test suite comprises a set of tests meeting a predefined condition. The test suite is generated by generating at least one question related to at least one of: expected intents of one or more sections of the software code, or tests for testing the sections, and presenting the at least one question to a user; upon receiving feedback from the user, analyzing the feedback with respect to the predefined condition, and determining whether to generate at least one new question; and, in response to an affirmative determination, repeating the above process with respect to the new question, until the predefined condition is met.

Systems and methods for testing sandboxed in-kernel programs are provided. A method of testing a program includes: obtaining a Berkeley Packet Filter (BPF) program to test; obtaining a test to run on the BPF program; performing the test on the BPF program for a plurality of Linux kernels and reporting a result of performing the test on the BPF program for a plurality of Linux kernels. This enables a generic testing solution for black box testing of BPF programs. The embodiments can integrate with existing testing suites and frameworks and can integrate into CI / CD pipelines. Some embodiments allow testing using any kernel from user space. Host kernel testing of BPF programs is enabled by a developer using the developer's own workstation and version of the Linux kernel. Guest kernel testing of BPF programs is enabled using specific kernel versions by providing the framework a specification of the target kernel environment.

Execution of software applications can be controlled based on application profiles to facilitate safety compliance. For example, a system can execute a test suite to identify a function call of a software application that is associated with a functional safety standard issued by a standard-setting organization. In response to identifying the function call, the system can generate a risk score for the function call. The risk score can indicate a likelihood of the function call causing non-compliance with the functional safety standard. The system can further generate an application profile including a permission for the software application based on the risk score. The permission may disable the function call of the software application. The system may then execute the software application based on the application profile. As a result, execution of the software application can comply with the functional safety standard.

The invention relates to the technical field of integrated circuits, and provides a verification platform, a verification method, electronic equipment and a medium. The verification platform comprises: an application layer bus function level model comprising a customized interface for a to-be-tested design for interacting with the to-be-tested design, the to-be-tested design being a PCIe protocol docking and protocol compliance test suite, and the to-be-tested design being a PCIe protocol docking and protocol compliance test suite; the PCIe protocol docking and protocol compliance test suite supports a verification demand of a physical layer intellectual property core and a verification demand of protocol consistency of a PCIe controller and a physical layer subsystem level; and the to-be-tested design interacts with the application layer bus function level model through the customized interface. Thus, the integration and through-flow debugging cost of subsystem protocol consistency verification is reduced, the verification period of a docking test of PCIe subsystem protocol standardization is shortened, and the completeness of docking verification of a full quantization protocol of a PCIe subsystem and the platform reuse efficiency are improved.

The invention discloses an intelligent test generation method, system and device for an H5 page and a medium, and the method specifically comprises the steps: collecting a user operation event sequence of the H5 page, and building an operation log stream with a timestamp through the user operation event sequence; collecting equipment fingerprint data and a network delay index, and performing space-time correlation coding on the equipment fingerprint data and the network delay index to generate an enhanced operation track data set; inputting the enhanced operation track data set into a pre-trained depth time sequence neural network to obtain an anomaly detection result; sending out safety early warning based on an abnormal detection result, extracting boundary condition features in the operation log stream, and automatically generating a boundary test case set; and fusing the boundary test case set with the user operation reproduction case, constructing a hybrid test suite, and triggering an automatic test assembly line through a CI / CD integrated interface. According to the method, the comprehensiveness, the accuracy and the efficiency of H5 page testing are remarkably improved, and the performance and the safety of the H5 page are effectively guaranteed.

The invention relates to the technical field of deep learning testing, in particular to a deep learning test sample generation method utilizing a reinforcement learning optimization genetic algorithm, which comprises the following steps: constructing different types of seed data sets based on an image data set, and determining and initializing an initial population; obtaining a deep learning model, executing a genetic algorithm, and optimizing the initialized initial population; combining reinforcement learning to dynamically optimize genetic algorithm parameters; and performing iterative optimization on the optimized initial population through the optimized genetic algorithm to generate a new population, screening a data sample with a prediction error, and obtaining a test suite. The deep learning model and the genetic algorithm are integrated, the genetic algorithm is executed, reinforcement learning is introduced to dynamically optimize operation parameters of the genetic algorithm, the problems of local optimum and parameter sensitivity are solved, generation of a test suite with smaller distribution difference is promoted, the convergence speed of fitness can be effectively improved, and the robustness of the deep learning model is improved.

Methods, system, and non-transitory processor-readable storage medium for a source code file association system are provided herein. An example method includes receiving, by a project management tool associated with a software test lifecycle system, a pull request to merge software code changes with a software project repository on an enterprise system. The software testing life cycle system executes a plurality of integration test suites associated with the pull request on at least one test system associated with the enterprise system. The integration test suites are executed to test the software code changes. The project management tool captures the integration test suite output. A source code file association system preprocesses the integration test suite output for input into a machine learning system. The integration test suite output is encoded. The output of the machine learning system identifies at least a portion of source code exercised by the integration test suites.

A remote software development infrastructure can include cross-continent datacenters with a variety of remote devices. The infrastructure can provide automated testing on the remote devices. A software development kit (SDK) can be used to integrate a test suite with the infrastructure. The SDK can modify the test suite to issue test commands to a remote test server of the infrastructure, as opposed to local test servers. A remote test server routes the test commands to a remote device in a datacenter. Both local testing and remote testing of a test script is possible. The SDK enables cross-browser, cross-device, cross-operating system and / or parallel testing of the test suite, without the user having to make code changes to the test suite. The test results and additional information are automatically captured and are aggregated in a dashboard in the form of aggregated reports and other graphical user interface elements.

The invention relates to the technical field of software engineering and automatic testing, and discloses a self-adaptive multi-dimensional risk testing strategy design method and system and a storage medium. The method comprises the following steps: triggering a risk assessment service through a CI / CD assembly line, preprocessing original data obtained by a plurality of heterogeneous data sources, and generating a risk feature vector; outputting a multi-dimensional risk index by using the risk assessment model, fusing the multi-dimensional risk index and the dynamic weight thereof based on an adaptive weighted fusion model, and calculating a comprehensive risk score; dynamically updating a risk score threshold value used for dividing the risk level, automatically generating a test strategy matched with the current risk level according to a preset mapping rule of the risk level and the test strategy, and calling the test suite to automatically execute the test strategy; and collecting a test execution result and online operation data as training data, and regularly optimizing parameters of the risk assessment model. The test strategy can be dynamically adjusted according to the real-time risk situation.

A computing platform may receive test input information comprising input information to validate code for an application. The computing platform may test the code by inputting the test input information into the application and executing the code to produce initial test results. The computing platform may store the test input information / initial test results in a table. The computing platform may identify that subsequent testing should be initiated. The computing platform may automatically identify the test input information and the corresponding initial test results using the stored table. The computing platform may automatically test the application by inputting the test input information into the application and executing the application to produce automated test results. The computing platform may compare the automated test results to the initial test results. Based on identifying that the automated test results match the initial test results, the computing platform may deploy the application.

The embodiment of the invention discloses a development data detection method and equipment based on a low-code platform and a medium, belongs to the technical field of software development, and solves the problem that the repair efficiency is reduced by manual coding when a software code is changed and a test fails. Based on the development data change amount, matching a test suite containing the corresponding number of test cases in a preset test suite set, and testing the change data through the test suite; under the condition that the test fails, performing frequent item set query in a historical database through an association rule mining algorithm, and constructing an item set association relationship corresponding to the modified data according to the frequent item set; inputting the change data and the item set association relationship corresponding to the change data into a preset failure data analysis model group, and outputting a test failure reason and a repair suggestion through the preset failure data analysis model group; and based on the test failure reason and the repair suggestion, filling the preset code update meta-language, and repairing the modified data through the filled update meta-language.

The invention discloses a multi-modal-based automatic test script generation method and system, and the method comprises the steps: a user describes a test demand through a natural language, uploads an interface screenshot to carry out multi-modal input, and calls a large language model to generate an AIRTEST script; performing mode matching on the generated script by using a regular expression, extracting all picture element names, and performing reordering processing to form an element name list; the original interface screenshot and the element name list are input into the visual large model, and the visual large model is required to return standardized coordinate data; image cutting operation is executed based on the coordinate data, and actual image resources are provided for the test script; and automatically generating a. Air item folder named by a timestamp, creating a Python script file with the same name in a directory, writing a test script code generated previously, storing picture resources obtained by cutting into the item folder, and forming a complete executable test suite meeting the requirements of an AIRTEST framework. According to the invention, the core pain points of high learning cost and difficult maintenance of a traditional automatic test tool can be solved.

The invention discloses a whole-process intelligent unit testing method driven by a large language model, belongs to the technical field of software testing, and aims to solve the problems of poor testing quality, difficulty in effective understanding of testing intentions and low coverage rate of testing codes in existing unit testing. The method comprises the following steps: intelligently analyzing a to-be-tested code driven by a large language model; automatically generating a test code driven by the large language model; testing code intelligent verification driven by the large language model; error codes driven by the large language model are automatically repaired; and automatic construction of a test suite and intelligent evaluation driven by a large language model. According to the method, the advantages of the large language model in the aspects of natural language understanding and code generation are fully played, so that the large language model can more accurately grasp the test intention and the function requirement, the generation quality and the coverage range of the test code are remarkably improved, and a brand new solution is provided for realizing efficient, intelligent and whole-process automatic unit test generation.

The invention discloses a database compatibility test method and system, which can structurally store data from different database systems, test scenes and compatibility indexes by defining a multi-dimensional array, cover key indexes such as data integrity, consistency, transaction processing, query performance and the like, and ensure that the test is comprehensive and systematic. A cluster containing a plurality of database instances is constructed, and the same test data set is configured, so that the consistency of a test environment is ensured, the accuracy and comparability of a test result are improved, a preset compatibility test suite is automatically executed, the test efficiency is greatly improved, manual intervention and errors are reduced, multi-dimensional array data are deeply analyzed, compatibility differences can be accurately identified, and the test efficiency is improved. According to the scheme, the performance bottleneck is positioned, potential problems are identified, the problems are found and solved in the development, upgrading or integration stage in time, risks are avoided, in addition, the scheme supports on-demand extension of array dimensions, test suites and data sets can be customized and adjusted, more requirements can be flexibly met, and high adaptability is achieved.

A diversified validation test suite application (DVTSA) for a generative AI powered tool or large language model (LLM) tool includes at least first, second, and third control logics. The first control logic receives a seed test input or user input, analyzes the seed test input or user input, and extracts key elements for variations. The second control logic performs a coverage measurement of outputs of the first control logic. The third control logic causes a human validator to evaluate outputs of the second control logic relative to predefined coverage metrics and selectively and continuously iterate to cause outputs of the second control logic to increase LLM tool input robustness and output robustness from a first level to a second level greater than the first level, in both production and pre-production LLM tool processes.

The invention relates to an OCamml unit test system, which adopts a layered architecture design and comprises a test driving layer, a test case regulation layer and a test suite function layer. The test driving layer automatically manages compiling, execution and result archiving of OCAML test codes through Makefile scripts; the test case regulation layer defines and organizes test cases based on a standardized template, and each test case annotates and declarates information such as a unique identifier and an airworthiness demand number through structured metadata; the test suite function layer comprises an assertion module, a report generation module, a data conversion module and a test auxiliary module. Through the layered architecture design, standardized management and automatic execution of the test process are realized, the standardization and traceability of the test activity are ensured, a complete demand-test-verification traceability evidence chain is provided for airworthiness certification, and the strict requirement of the high-security field for unit test is met.

In accordance with a technique of parallelized computer system testing, a processor develops, on a representative computer system, a plurality of groups of system tests based on test-ordering constraints, where the system tests in each of the plurality of groups are executable in a temporally overlapping manner. The processor applies a test suite including a sequence of multiple of the plurality of groups of system tests to a production computer system. Applying the test suite includes performing the system tests in each of multiple of the plurality of tests groups in a temporally overlapping manner, such that testing efficiency is improved.

There is provided an architecture, methods and a system for live testing in a production environment. The architecture comprises a platform independent Test Planner for generating a test package in response to receiving an event. Generating a test package comprises selecting test goals, generating a test suite and generating a test plan. The architecture comprises a platform dependent Test Execution Framework (TEF) for executing the test package in an environment serving live traffic. Executing the test package comprises initializing the test plan, starting the test plan and reporting the successful completion of the test plan, reporting the suspension of the test plan and waiting for further instructions, or reporting a failure of the test plan and executing a corresponding contingency plan.

The application provides an artificial intelligence-based software test case automatic generation system and method, relates to the technical field of software testing, and comprises the following modules: a project management data acquisition module that collects code metadata and project management data; a dynamic risk weight allocation module that inputs the two types of data into a risk prediction model, outputs a risk heat map, and allocates the dynamic risk weight of the input parameters; a basic test suite generation module that generates a basic test suite according to the input parameters and the dynamic risk weight; and a software test algorithm execution module that starts a software test algorithm and iteratively evolves to generate a test case set. The application solves the technical problem that the existing software test case generation mode is difficult to effectively integrate software related data to identify high-risk links, and the generated test cases are insufficient in covering key areas and low in accuracy, achieves the technical effect of accurately identifying high-risk links of software, and the generated test cases are more targeted, thereby improving software testing efficiency and software quality evaluation accuracy.

This invention provides a method and system for evaluating the compatibility of power grid business applications with processor architectures. The method includes: determining a power grid business scenario-based test suite based on the type of the power grid business application to be evaluated. The test suite includes a power industry protocol test script for verifying the processor architecture's power protocols, a real-time control performance test script for evaluating the processor architecture's control performance, and a power grid data consistency verification script for verifying the processor architecture's timing synchronization. On a multi-platform test environment cluster, an automated task scheduling engine is used to execute compatibility tests of the power grid business application on each processor architecture within the multi-platform test environment cluster, based on the power grid business scenario-based test suite. A rule engine is used to generate a compatibility rating level based on multi-dimensional test indicators collected during the testing process, achieving a comprehensive evaluation of the compatibility of the power grid business application with the processor architecture in terms of functional adaptation, performance, and data consistency.

Systems and methods for checking the correctness of a computer program with at least one incorrect instruction inserted into at least one of a plurality of branches of the computer program. At least one prover generates a counterexample of computer program correctness in order to switch focus from a failed proof of the correctness of the computer program to a failed test of the correctness of the computer program.

The present application provides a GPIO driver test system, method, device and storage medium, which relate to the field of GPIO test technology, and solve the problem that manual test process easily causes differences and affects test results. In this solution, the main controller can control other modules in the GPIO driver test system by running the set test script, thereby providing an output channel from GPIO to the test module for the tested signal to complete the functional test, and the main controller can also generate a test report corresponding to the test result in combination with the signal fed back by the test hardware module and / or the GPIO test suite module for the test personnel to review. The test process is simple and does not require manual testing by the test personnel, thereby effectively avoiding the differences caused by manual testing, and helping to provide more accurate and effective test results.

The application discloses a kind of keyword-driven spaceflight TT&C software automation test method and system, method includes: based on the formation keyword of spaceflight TT&C software operation process;Spaceflight TT&C software operation process uses multiple programming languages;Keyword uses uniform programming language;Configuration test case template, template element is defined based on test case template and forms test case;Wherein, at least one of natural language, keyword and test data defines template element;According to the attribute of test type, filter test case and pack the test case filtered into test suite;Execute test case in test suite and collect execution, according to mapping rule, fill execution into corresponding test document template to form test document.The application can complete multiple complex spaceflight TT&C software test by the keyword and test case design compatible with multiple programming languages, realize that test script writing language is uniform and forms general operation to multiple spaceflight TT&C software.

The invention provides a continuous integration test balance method and device based on dynamic quality evaluation and a medium, and belongs to the technical field of vehicles. The method includes monitoring a code submission event, capturing changes in the code submission event, forming change set data, and determining a quality assessment indicator from a plurality of data sources. And determining a comprehensive risk coefficient of current code integration by utilizing the set risk assessment model according to the quality assessment index and the change set data. And dynamically deciding a corresponding test execution strategy according to the comprehensive risk coefficient, driving a corresponding test suite according to the corresponding test execution strategy, and distributing a corresponding test task to obtain a test execution result. The efficiency of continuous integration testing is improved, and testing resources are optimized.