210 results about "Code coverage" patented technology

The invention discloses a test case generation method and device, equipment and a medium, and relates to the technical field of software testing, and the test case generation method comprises the following steps: storing request data subjected to structured processing into a seed case library; the request data are various types of request data in the operation process of the service system; determining a cue word according to the target information based on the large model, and generating an initial test case through the cue word and a generation rule; the target information comprises characteristics of request data in the seed case library, an interface document of the tested software and a business logic specification; executing the initial test case according to the test request of the tested software, performing statistical analysis on the code coverage rate of the tested software in the execution process, and screening the initial test case according to an analysis result to obtain a screened test case; and after the execution is finished, filtering the screened test cases according to the first execution result of each test case to obtain a target test case. Therefore, the testing efficiency and quality can be improved, and automatic testing is achieved.

The invention relates to a fuzzy test Kubernete-based three-party component vulnerability mining method, which comprises the following steps of: firstly, automatically identifying a user controllable function by combining a large language model based on an official document, a configuration list and source code information of a three-party component, and constructing a keyword dictionary to assist in large-scale identification of a potential target function; then analyzing context information of the target function and an interaction relation of the target function in a Kubernetes cluster, constructing a front dependency library required by fuzzy testing, and automatically generating a fuzzy testing driving program; integrating a fuzzy test driving program with a three-party component source code, performing code instrumentation, pre-compiling and corpus optimization, generating test input according to a set variation strategy, dynamically monitoring a coverage rate and an abnormal behavior, and continuously optimizing a test corpus; and finally, based on the crash behavior of the fuzzy test record, analyzing a trigger path of the vulnerability, performing vulnerability verification in a local Kubernetes cluster environment, and finally generating a vulnerability analysis report.

The invention discloses a test case generation method and device, a test case test method and device, a medium and a program product, and relates to the technical field of interface test and artificial intelligence, the method comprises the following steps: obtaining flow data of a first interface in a first service and a code corresponding to the first service; based on the traffic data, the code and a target model, a test case is generated, the test case comprises a test scene, test traffic and an assertion rule, and the test scene is used for representing a target field in the traffic data and a combination of values of the target field, the assertion rule is used for representing a target test result of the test case. According to the method, the generation efficiency of the test case can be improved under the condition of ensuring the test coverage and the code coverage.

The invention discloses a prototype verification method of a DDR4 controller in the technical field of chip verification, the method is applied to a prototype verification platform, a DDR controller and a PHY module in a chip to be verified are matched on the prototype verification platform, and the PHY module integrates a DFI to phy only interface module and a standalone PHY only block module through a python script; the prototype verification method comprises the steps that in response to a verification instruction received by a DDR controller, the DDR controller generates a control instruction according to the verification instruction and sends the control instruction to a DFI to phy only interface module; in response to the control instruction received by the DFI to phy only interface module, the DFI to phy only interface module converts the control instruction from a DFI protocol to a target control instruction of a PHY protocol, and sends the target control instruction to the standalone PHY only block module; in response to the control instruction received by the standalone PHY only block module, the standalone PHY only block module sends a target control instruction to a DDR particle externally connected with the prototype verification platform, so that read-write and verification with the DDR particle are realized; according to the method, the DDR memory interface IP prototype verification code coverage rate can be improved.

The invention discloses a full-process automatic unit testing method, device and equipment for an AI chip operator, a medium and a product. The method comprises the following steps: generating an engineering directory and a test framework design document through an architect agent according to operator interface information and a DSL operator design document knowledge base; the method comprises the following steps of: generating a test code for unit test by a software engineer agent according to a test framework design document and a domain knowledge base, and storing the test code in an engineering directory; multiple rounds of interaction are carried out through a software engineer agent and a test engineer agent, a test code is gradually corrected into a target test code which can be successfully compiled, a generated test case can be successfully executed and the generated test case meets the code coverage rate requirement, and a target operator code passing a unit test is obtained; and submitting the target operator code and the target test code which pass the normativity check to a code warehouse through a code auditing engineer agent so as to automatically realize the whole-process unit test of the AI chip operator.

The invention discloses a test case generation method and device, equipment and a medium, and relates to the technical field of software test optimization. According to the scheme, the multiple initial test cases are obtained, and the test reports corresponding to the initial test cases are generated through the first preset test tool, so that the time for manually compiling the test cases is effectively shortened; when it is determined that a to-be-supplemented test case of which the corresponding code coverage rate index does not meet a preset requirement exists according to each test report, code uncovered information of the to-be-supplemented test case is determined, and test case optimization parameters are configured in combination with project requirements; and based on the parameter, calling a second preset test tool and a large language model to supplement the to-be-supplemented test case to obtain a complete test case. According to the scheme, the availability of the test case is improved through combination of multiple tools; workflows of test cases covering complex environments such as a function calling relation and a control flow structure are generated by utilizing the inference capability of a large language model, and the code coverage rate of the test cases is remarkably increased.

The invention relates to the technical field of automatic testing, and discloses an automatic testing scheme generation method and device and a medium, and the method comprises the steps: matching a demand action in a test demand with a code entry name corresponding to a code segment, and determining a code risk level of a current demand code block; analyzing the code change frequency and the code dependency degree of the current demand code block according to historical test records in the test domain knowledge base, and determining the test dynamic priority of the current demand code block; constructing a control flow diagram and a data flow diagram of the current demand code block, and detecting risk nodes in the control flow diagram and the data flow diagram; generating a test scene of the current demand code block according to the risk node, and generating a boundary value test rule according to a key constraint condition in the data flow diagram; and querying an environment simulation rule of the current demand code block, and packaging the test scene, the boundary value test rule and the environment simulation rule into an automatic test scheme. According to the invention, the code coverage when the test scheme is generated can be improved.

The invention relates to the technical field of chips, in particular to a large-scale chip code coverage rate obtaining method, electronic equipment and a medium, and the method comprises the following steps: S1, constructing different test clusters; s2, setting verification configuration information, test parameters and a to-be-verified interface set for the Giq; s3, generating a corresponding file list based on each Aiq in parallel, and compiling to generate a corresponding executable file Fiq; s4, transmitting the Biq to a test case in the Giq in parallel, executing a corresponding verification operation based on the Fiq, and obtaining a set Eiq of the interfaces to be verified which are overturned by the Giq; s5, after the Gq is completely executed, obtaining a union set GEiq of all Eiq corresponding to the Gq; and S6, after all Gq are executed, obtaining a union set GE of all GEiq, and determining the code coverage rate of the large-scale chip based on GE and GD. According to the method, the large-scale chip code coverage rate can be accurately and quickly obtained.

The invention relates to the technical field of computer testing, in particular to an incremental code coverage rate calculation method which comprises the following steps: executing a test case on a current version code, and collecting code test coverage information; comparing the baseline version code with the current version code to obtain a change code; based on a baseline version code, performing semantic equivalence analysis on the change code to obtain a logic change code, the semantic equivalence analysis being used for filtering change codes of non-logic factors; and calculating an incremental code coverage rate according to the logic change code and the code test coverage information, wherein the incremental code coverage rate comprises a change line coverage rate and a change link coverage rate. According to the multi-dimensional analysis method, coverage rate evaluation is more scientific and comprehensive, developers can better find test blind spots and potential defects, and therefore the software quality is improved.

The invention discloses an automatic test case generation and execution method, which comprises the following steps: obtaining input content uploaded by a user, and analyzing the input content uploaded by the user to obtain structured key data; generating a preliminary test case according to the structured key data and a general rule of a knowledge base, optimizing the preliminary test case according to historical data and a code coverage rate, and generating a test case; compiling a test script according to the test case, and executing the test script; analyzing and processing the test execution result, and generating an execution structure and a test case analysis report; and performing optimization processing on the test execution result and the historical data, and dynamically adjusting a test strategy according to an optimization processing result. The invention further discloses a system for realizing the automatic test case generation and execution method. The test efficiency is improved, the test coverage rate is increased, the execution performance is improved, and automatic continuous testing is supported.

The invention discloses an incremental code coverage rate acquisition device based on a Java bytecode dynamic instrumentation technology, and relates to the technical field of software testing and quality control. Comprising a code difference analysis module, a byte code instrumentation module, a coverage rate data acquisition module, a coverage rate data integration module, a coverage rate report generation module and a test trigger and threshold control module, and a syntax tree structure of incremental codes is generated based on a Java syntax analysis tool, so that line level analysis of code differences is realized. According to the method, incremental codes are accurately analyzed through Git and JavaParser, coverage rate data are collected through dynamic instrumentation, a unified report is generated in combination with path analysis, missing scenes are marked in a highlighted mode, and the test efficiency and the code quality control capacity are improved.

The invention provides an automobile electronic control unit fuzzy testing method based on partial code coverage rate feedback and a computer, and belongs to the technical field of automobile electronic control unit code testing. The computer performs static analysis on source codes of the automobile electronic control unit, identifies inevitable execution blocks and conditional execution blocks, performs selective instrumentation on the conditional execution blocks, and inserts coverage rate recording instructions of the conditional execution blocks. And the computer source code is loaded into the automobile electronic control unit, and a test input signal is generated through the fuzzy test engine and is injected into the automobile electronic control unit. In the process of executing the program by the automobile electronic control unit, recording the coverage condition of the condition execution block to a bitmap in the memory; the computer reads the coverage rate data of the condition execution block through the debugger every time a complete execution cycle is completed; and the fuzzy test engine adjusts the input generation strategy according to the coverage rate data feedback of the condition execution block and tests again. According to the method, the automobile electronic control unit source code fuzzy test coverage condition is efficiently collected.

The invention discloses a test method based on code link dynamic tracking. The method comprises the steps of obtaining version difference information of a to-be-tested code from a version library and generating a code test submission list; when a tester initiates a test request, performing flow identification injection on the test request through the front-end agent module and forwarding the test request to the tested application service module; the back-end acquisition module monitors all the tested application service modules in a dynamic code instrumentation mode, and extracts code link calling information of the service modules from all the tested application service modules based on the traffic identifiers; and comparing the code coverage rate of the code link calling information with the code test submission list, determining an abnormal code path based on the code coverage rate and the code link calling information, and generating abnormal information. According to the method, the code coverage rate can be calculated in real time in the process of executing the function test by testers, and the situations that the function test cases are missed and developers carry non-demand codes to be online are avoided.

The invention relates to the technical field of program testing, in particular to a seed scheduling method and system for multi-objective optimization in grey box fuzzy testing, and the method comprises the steps: dividing related indexes of seeds into state related indexes and state independent indexes; modeling a priority ranking problem of the seeds into a multi-objective optimization problem according to state related indexes, calculating Pareto leading edges of the seeds based on a non-dominated ranking algorithm, and screening out the seeds with high priorities; selecting seeds according to a seed selection basic principle; determining the weight of each index by using an analytic hierarchy process according to the state-independent indexes, evaluating the quality of the seeds through an approximate ideal solution algorithm, and distributing reasonable energy for the seeds; and based on the priority and the energy distribution result, selecting the seeds for mutation to generate a new test case. According to the method, seed priority division and energy distribution are optimized, so that the seed scheduling efficiency in grey-box fuzzy testing is remarkably improved, and accurate testing is realized at a higher code coverage rate and a faster vulnerability discovery speed.

The invention relates to a stateful protocol fuzzy test method and system based on response information. The method comprises the following steps: S1, a preprocessing stage; S2, a fuzzy test stage; s3, a state selection stage; and S4, a seed scheduling stage. The system comprises a test preparation module, a fuzzy test module, a state selection module and a seed scheduling module. According to the method, the source code of the protocol entity program to be tested is statically analyzed to capture distribution and use of enumeration type variables in the source code. According to the method, the response result information of the tested program is analyzed, the response header field is extracted, on the basis that the response code represents the state, the state is further subdivided, the states represented by a plurality of same state codes in the same seed are effectively distinguished, and the detection accuracy is improved. And the seed value and the variation position are adjusted by using the response header field information reaching the target state and the coverage rate information, so that the code coverage rate of the stateful protocol fuzz test is remarkably improved, more vulnerabilities are found, and the fuzz test efficiency is greatly improved.

The invention discloses a test case obtaining method and device, equipment and a medium. The method comprises the following steps: generating a test case feature vector and a code branch condition coverage feature vector according to a historically generated code coverage report, and splicing the test case feature vector and the code branch condition coverage feature vector to generate a transaction set; generating a plurality of multi-item sets according to a preset support degree and the transaction set; generating a first result set and a second result set according to a preset confidence coefficient and each multi-item set; and when the incremental code coverage report is generated each time, determining a plurality of target test case feature vectors in the first result set or the second result set according to the incremental code coverage report, and obtaining a test case according to the target test case feature vectors. By adopting the technical scheme, the supplementary test case can be intelligently and accurately provided for the uncovered code, the test efficiency and quality are improved, and the cost is saved.

The invention discloses a chaos test scene supplementing method and device, equipment and a storage medium. The method comprises the steps that a software system is analyzed through a micro-service analysis tool, and a chaos test scene corresponding to the software system is generated in combination with a rule engine tool; executing the chaos test scene on a chaos engineering platform, and obtaining scene data when the chaos test scene is executed in combination with a code coverage rate tool; and when the current code coverage rate of the software system does not reach the expectation, inputting the scene data into a pre-trained machine learning model, and supplementing a new chaos test scene based on the machine learning model. According to the method, when the current code coverage rate of the software system does not reach the expectation, a new chaos test scene is supplemented through the machine learning model, and the code coverage rate of the chaos test scene can be improved.

The invention discloses a method and a system for evaluating a test coverage rate based on a Java call link, and relates to the field of software testing. The method comprises the following steps: identifying a difference function according to a first comparison result, and constructing a call chain tree structure by taking the difference function as a root node based on a code call relation graph; analyzing the difference function to obtain a direct code change line of the difference function, based on a call chain tree structure, identifying a related code line on a call chain where each call point is located as a call point code line, and summarizing the direct code change line and the call point code line; and analyzing the code coverage rate data to obtain an actually covered code line, comparing the to-be-tested code line with the actually covered code line, determining coverage rate index data based on a call chain according to a second comparison result, and determining a test coverage rate evaluation result according to the coverage rate index data. The test coverage rate can be evaluated more comprehensively and accurately.

The invention provides a mobile application GUI automatic testing method and system based on hierarchical reinforcement learning, and belongs to the technical field of mobile application testing. A real hardware device or a virtual machine is used for building a testing environment and configuring an automatic exploration framework, a to-be-tested application program is initialized, GUI layer information and control layer information are extracted respectively, and the GUI layer information and the control layer information are extracted respectively; the method comprises the following steps: acquiring a GUI layer and a control layer, converting the GUI layer and the control layer into a fine-grained state vector convenient for subsequent reinforcement learning processing, exploring the GUI layer and the control layer by using hierarchical reinforcement learning in combination with a reward function, processing interaction between the two layers of networks, and performing conversion by using an FSM when an exception occurs. Respectively obtaining a code coverage rate and a crash detection result by utilizing the code coverage rate detection framework and the log information of Appium; the problem that an existing mobile application GUI automatic testing method does not consider rough GUI information granularity and too single exploration level, and consequently exploration path coverage is not comprehensive is solved.

The invention provides an automatic calculation method, system, equipment and program product for incremental code coverage rate, which are applied to the field of software testing, and the method comprises the following steps: receiving a code version change event, collecting and merging binary coverage rate data, obtaining an incremental code change set, and generating a structured coverage rate report. According to the scheme, the incremental code coverage rate can be accurately calculated, and the code quality measurement efficiency is improved.

The invention relates to a simulation modeling system based on a UVM. The system comprises a component library management module, an incentive library management module, a top layer generation module, a graphical modeling module, a script generation module, a coverage rate statistics module and a server calling module, wherein the component library management module is used for managing a UVM component model; the incentive library management module is used for managing the incentive model; the top layer generation module is used for generating a corresponding top layer module according to the top layer file; the graphical modeling module is used for modeling according to the UVM component model; the coverage rate counting module is used for counting coverage rate data in the verification test process; the script generation module is used for generating various modeling files; and the server calling module is used for completing simulation of the modeling file. Therefore, the UVM can be directly used to realize random generation of test vectors, automatic comparison of test results and automatic statistics of code coverage rate and function coverage rate, and the FPGA test coverage rate and quality are greatly improved.

The invention belongs to the related technical field of software engineering, and particularly relates to a directional test case generation method based on a large language model and a symbolic execution tool, which comprises the following steps: generating a cue word p based on a to-be-tested program P and a test object code branch T, and generating a test case i through the large language model; using i to test P, and if T is covered, completing generation; otherwise, the code coverage information of the P in the current test is added to the current p in an accumulated mode, the test cases i are regenerated and tested, when the number of retimes reaches the preset retry upper limit m, T is still not covered, the m test cases i serve as input templates, the program literal quantity in each input template is modified into symbolization variables of the symbolization execution tool, and the program literal quantity in the input templates is changed into the symbolization variables of the symbolization execution tool. Constructing a test entry function f of the symbolic execution tool; and synchronously inputting f, P and T into a symbolic execution tool to generate a corresponding test case j, and testing P to complete the generation of the test case. According to the invention, the software test coverage rate can be improved.

The invention discloses a coverage rate testing method and system for incremental codes, and the method comprises the steps: analyzing a current version code and a reference version code of a target project, so as to recognize a change function; performing influence range analysis on the change function to determine an associated code directly or indirectly influenced by the change function, and taking the change function and the associated code as a target monitoring code; executing acquisition logic at a preset position of the target monitoring code through instrumentation implantation so as to collect execution data of the target monitoring code in the running process; and calculating an incremental coverage rate of the target monitoring code based on the execution data. By analyzing and identifying a change function, analyzing and locking associated codes in combination with an influence range, collecting execution data through instrumentation, calculating an incremental coverage rate, accurately positioning a change point and determining a test range, the problems of resource redundancy and low efficiency of a full test are solved, and the defects of insufficient change positioning and coverage analysis are overcome; and precise quantification of incremental code testing is realized.

The embodiment of the invention provides a fuzzy test method based on coverage rate for trusted firmware, and the method comprises the steps: carrying out the variation of functions and parameters based on code coverage information during the variation of a seed, and guiding the generation of a test case through the coverage rate. The situation that the same function or the same segment of code of the BL31 firmware is repeatedly tested due to the fact that the generated test cases are the same is avoided, and on the basis that comprehensive testing of the BL31 firmware is guaranteed, the testing efficiency can be improved.

The invention relates to a high code coverage rate fuzzy test method based on a parallel strategy. The method comprises the following steps: deploying a plurality of fuzzy test examples running in parallel; acquiring an execution path and state data of the target program in real time through a dynamic instrumentation technology; dynamically evaluating the seed priority based on the central management system; distributing a high-priority seed to each fuzzy test instance through a feedback driving mechanism, and optimizing file operation and multi-thread synchronization; and dynamically adjusting the seed priority and the test strategy according to the real-time test data. The method has the advantages that system calling and resource contention are effectively reduced, the test efficiency and coverage rate are improved, and efficient cooperation and intelligent test strategy adjustment are achieved through the design of a multi-thread synchronization mechanism and a central management system.

The invention relates to the technical field of chips, in particular to a code coverage rate processing method, electronic equipment and a medium, and the method comprises the steps: S1, designing a test case in a running regression test based on a to-be-tested chip, and obtaining text information corresponding to each code coverage object; s2, analyzing the attribute information, obtaining chip level information and code coverage rate types corresponding to each code coverage object, analyzing the operation information, and obtaining a regression test sequence number, regression test time and an operation result corresponding to each code coverage object; s3, generating metadata corresponding to each code coverage object, and storing the metadata in a preset script file; s4, analyzing metadata in a preset script file to generate a first database, a second database and a third database; and S5, displaying the form of the code coverage rate. The processing efficiency of the code coverage rate is improved, and resource consumption in the processing process of the code coverage rate is reduced.

The application discloses a kind of stateful network protocol-oriented fuzz testing method, constructs the corpus of initial test case, and carries out compiling and inserting plug-in operation;Through state selection algorithm, the target state of each round of fuzz testing is selected;From the test case set, the corresponding test case queue is selected, then a test case is selected from the test case queue to generate new test case by variation operation, then the new test case is sent to network protocol server to carry out fuzz testing;After a round of fuzz testing is completed in network protocol server, the feedback information of network protocol server is collected, including code coverage, state coverage and state transition, and subsequent fuzz testing process is guided according to feedback information.The above-mentioned method can solve the problems existing in state selection, test case scheduling and other aspects of traditional network protocol fuzz testing, improve network protocol fuzz testing efficiency and vulnerability mining capability.

The invention discloses a code coverage rate statistical method and device, and relates to the technical field of computers. A specific embodiment of the method comprises the following steps: in response to a received software code coverage rate statistical request, implanting a monitoring code into a code of to-be-tested software; obtaining pre-recorded online traffic of the to-be-tested software, performing analysis processing on the online traffic, and starting and executing a code of the to-be-tested software according to an analysis processing result; and obtaining the code execution condition of each component code of the to-be-tested software through the monitoring code, and obtaining the code coverage rate of the to-be-tested software according to the obtained code execution condition. According to the implementation mode, the code coverage rate is reliably and accurately counted, the code of the to-be-tested software is started and executed by using the real online flow, the accuracy and authenticity of the statistical result are ensured, a test case is omitted, and the statistical efficiency is improved.

The embodiment of the invention provides a code coverage rate file superposition method and system, and relates to the technical field of software test.The method comprises the steps that an initial code version is tested for the first time to generate a full coverage rate file; testing the new code version updated each time to generate an incremental coverage rate file; wherein the byte quantity of the incremental coverage rate file is smaller than the byte quantity of the full coverage rate file; and carrying out file superposition on the full coverage rate file and the incremental coverage rate file generated by each update test to generate a complete coverage rate file. Through the embodiment of the invention, the problems of long time consumption and large occupied storage space in the superposition process of the code coverage rate file in the related technology are at least solved, and the effect of reducing the time consumption and the occupied storage space in the superposition process of the code coverage rate file is further realized.

A coverage-guided code generation and fuzzing method based on a large model is proposed to address the problems of existing large model fuzzers, which not only ignore the guiding role of coverage information in the fuzzing loop but also generate prompts too hastily. This invention comprises four stages: prompt generation, fuzzing loop, mutation operator selection, and vulnerability detection. This method proposes a prompt generation method based on expert templates and a fuzzing loop method guided by unequal interval coverage information. The former lowers the barrier to entry for users of CoverFuzz and improves the quality of initial prompts; the latter, guided by coverage information, better covers the object under test to detect vulnerabilities. This invention significantly improves the effectiveness of programs generated by fuzzing based on large models, solves the problem of existing large model-based fuzzers ignoring coverage information, and also achieves higher code coverage.