164 results about "Code coverage" patented technology

The invention discloses a test case generation method and device, equipment and a medium, and relates to the technical field of software testing, and the test case generation method comprises the following steps: storing request data subjected to structured processing into a seed case library; the request data are various types of request data in the operation process of the service system; determining a cue word according to the target information based on the large model, and generating an initial test case through the cue word and a generation rule; the target information comprises characteristics of request data in the seed case library, an interface document of the tested software and a business logic specification; executing the initial test case according to the test request of the tested software, performing statistical analysis on the code coverage rate of the tested software in the execution process, and screening the initial test case according to an analysis result to obtain a screened test case; and after the execution is finished, filtering the screened test cases according to the first execution result of each test case to obtain a target test case. Therefore, the testing efficiency and quality can be improved, and automatic testing is achieved.

The invention relates to a fuzzy test Kubernete-based three-party component vulnerability mining method, which comprises the following steps of: firstly, automatically identifying a user controllable function by combining a large language model based on an official document, a configuration list and source code information of a three-party component, and constructing a keyword dictionary to assist in large-scale identification of a potential target function; then analyzing context information of the target function and an interaction relation of the target function in a Kubernetes cluster, constructing a front dependency library required by fuzzy testing, and automatically generating a fuzzy testing driving program; integrating a fuzzy test driving program with a three-party component source code, performing code instrumentation, pre-compiling and corpus optimization, generating test input according to a set variation strategy, dynamically monitoring a coverage rate and an abnormal behavior, and continuously optimizing a test corpus; and finally, based on the crash behavior of the fuzzy test record, analyzing a trigger path of the vulnerability, performing vulnerability verification in a local Kubernetes cluster environment, and finally generating a vulnerability analysis report.

The invention discloses a full-process automatic unit testing method, device and equipment for an AI chip operator, a medium and a product. The method comprises the following steps: generating an engineering directory and a test framework design document through an architect agent according to operator interface information and a DSL operator design document knowledge base; the method comprises the following steps of: generating a test code for unit test by a software engineer agent according to a test framework design document and a domain knowledge base, and storing the test code in an engineering directory; multiple rounds of interaction are carried out through a software engineer agent and a test engineer agent, a test code is gradually corrected into a target test code which can be successfully compiled, a generated test case can be successfully executed and the generated test case meets the code coverage rate requirement, and a target operator code passing a unit test is obtained; and submitting the target operator code and the target test code which pass the normativity check to a code warehouse through a code auditing engineer agent so as to automatically realize the whole-process unit test of the AI chip operator.

The invention discloses a test case generation method and device, equipment and a medium, and relates to the technical field of software test optimization. According to the scheme, the multiple initial test cases are obtained, and the test reports corresponding to the initial test cases are generated through the first preset test tool, so that the time for manually compiling the test cases is effectively shortened; when it is determined that a to-be-supplemented test case of which the corresponding code coverage rate index does not meet a preset requirement exists according to each test report, code uncovered information of the to-be-supplemented test case is determined, and test case optimization parameters are configured in combination with project requirements; and based on the parameter, calling a second preset test tool and a large language model to supplement the to-be-supplemented test case to obtain a complete test case. According to the scheme, the availability of the test case is improved through combination of multiple tools; workflows of test cases covering complex environments such as a function calling relation and a control flow structure are generated by utilizing the inference capability of a large language model, and the code coverage rate of the test cases is remarkably increased.

The invention relates to the technical field of automatic testing, and discloses an automatic testing scheme generation method and device and a medium, and the method comprises the steps: matching a demand action in a test demand with a code entry name corresponding to a code segment, and determining a code risk level of a current demand code block; analyzing the code change frequency and the code dependency degree of the current demand code block according to historical test records in the test domain knowledge base, and determining the test dynamic priority of the current demand code block; constructing a control flow diagram and a data flow diagram of the current demand code block, and detecting risk nodes in the control flow diagram and the data flow diagram; generating a test scene of the current demand code block according to the risk node, and generating a boundary value test rule according to a key constraint condition in the data flow diagram; and querying an environment simulation rule of the current demand code block, and packaging the test scene, the boundary value test rule and the environment simulation rule into an automatic test scheme. According to the invention, the code coverage when the test scheme is generated can be improved.

The invention discloses an incremental code coverage rate acquisition device based on a Java bytecode dynamic instrumentation technology, and relates to the technical field of software testing and quality control. Comprising a code difference analysis module, a byte code instrumentation module, a coverage rate data acquisition module, a coverage rate data integration module, a coverage rate report generation module and a test trigger and threshold control module, and a syntax tree structure of incremental codes is generated based on a Java syntax analysis tool, so that line level analysis of code differences is realized. According to the method, incremental codes are accurately analyzed through Git and JavaParser, coverage rate data are collected through dynamic instrumentation, a unified report is generated in combination with path analysis, missing scenes are marked in a highlighted mode, and the test efficiency and the code quality control capacity are improved.

The invention provides an automobile electronic control unit fuzzy testing method based on partial code coverage rate feedback and a computer, and belongs to the technical field of automobile electronic control unit code testing. The computer performs static analysis on source codes of the automobile electronic control unit, identifies inevitable execution blocks and conditional execution blocks, performs selective instrumentation on the conditional execution blocks, and inserts coverage rate recording instructions of the conditional execution blocks. And the computer source code is loaded into the automobile electronic control unit, and a test input signal is generated through the fuzzy test engine and is injected into the automobile electronic control unit. In the process of executing the program by the automobile electronic control unit, recording the coverage condition of the condition execution block to a bitmap in the memory; the computer reads the coverage rate data of the condition execution block through the debugger every time a complete execution cycle is completed; and the fuzzy test engine adjusts the input generation strategy according to the coverage rate data feedback of the condition execution block and tests again. According to the method, the automobile electronic control unit source code fuzzy test coverage condition is efficiently collected.

The invention relates to the technical field of program testing, in particular to a seed scheduling method and system for multi-objective optimization in grey box fuzzy testing, and the method comprises the steps: dividing related indexes of seeds into state related indexes and state independent indexes; modeling a priority ranking problem of the seeds into a multi-objective optimization problem according to state related indexes, calculating Pareto leading edges of the seeds based on a non-dominated ranking algorithm, and screening out the seeds with high priorities; selecting seeds according to a seed selection basic principle; determining the weight of each index by using an analytic hierarchy process according to the state-independent indexes, evaluating the quality of the seeds through an approximate ideal solution algorithm, and distributing reasonable energy for the seeds; and based on the priority and the energy distribution result, selecting the seeds for mutation to generate a new test case. According to the method, seed priority division and energy distribution are optimized, so that the seed scheduling efficiency in grey-box fuzzy testing is remarkably improved, and accurate testing is realized at a higher code coverage rate and a faster vulnerability discovery speed.

The invention discloses a test case obtaining method and device, equipment and a medium. The method comprises the following steps: generating a test case feature vector and a code branch condition coverage feature vector according to a historically generated code coverage report, and splicing the test case feature vector and the code branch condition coverage feature vector to generate a transaction set; generating a plurality of multi-item sets according to a preset support degree and the transaction set; generating a first result set and a second result set according to a preset confidence coefficient and each multi-item set; and when the incremental code coverage report is generated each time, determining a plurality of target test case feature vectors in the first result set or the second result set according to the incremental code coverage report, and obtaining a test case according to the target test case feature vectors. By adopting the technical scheme, the supplementary test case can be intelligently and accurately provided for the uncovered code, the test efficiency and quality are improved, and the cost is saved.

The invention discloses a chaos test scene supplementing method and device, equipment and a storage medium. The method comprises the steps that a software system is analyzed through a micro-service analysis tool, and a chaos test scene corresponding to the software system is generated in combination with a rule engine tool; executing the chaos test scene on a chaos engineering platform, and obtaining scene data when the chaos test scene is executed in combination with a code coverage rate tool; and when the current code coverage rate of the software system does not reach the expectation, inputting the scene data into a pre-trained machine learning model, and supplementing a new chaos test scene based on the machine learning model. According to the method, when the current code coverage rate of the software system does not reach the expectation, a new chaos test scene is supplemented through the machine learning model, and the code coverage rate of the chaos test scene can be improved.

The invention discloses a method and a system for evaluating a test coverage rate based on a Java call link, and relates to the field of software testing. The method comprises the following steps: identifying a difference function according to a first comparison result, and constructing a call chain tree structure by taking the difference function as a root node based on a code call relation graph; analyzing the difference function to obtain a direct code change line of the difference function, based on a call chain tree structure, identifying a related code line on a call chain where each call point is located as a call point code line, and summarizing the direct code change line and the call point code line; and analyzing the code coverage rate data to obtain an actually covered code line, comparing the to-be-tested code line with the actually covered code line, determining coverage rate index data based on a call chain according to a second comparison result, and determining a test coverage rate evaluation result according to the coverage rate index data. The test coverage rate can be evaluated more comprehensively and accurately.

The invention provides a mobile application GUI automatic testing method and system based on hierarchical reinforcement learning, and belongs to the technical field of mobile application testing. A real hardware device or a virtual machine is used for building a testing environment and configuring an automatic exploration framework, a to-be-tested application program is initialized, GUI layer information and control layer information are extracted respectively, and the GUI layer information and the control layer information are extracted respectively; the method comprises the following steps: acquiring a GUI layer and a control layer, converting the GUI layer and the control layer into a fine-grained state vector convenient for subsequent reinforcement learning processing, exploring the GUI layer and the control layer by using hierarchical reinforcement learning in combination with a reward function, processing interaction between the two layers of networks, and performing conversion by using an FSM when an exception occurs. Respectively obtaining a code coverage rate and a crash detection result by utilizing the code coverage rate detection framework and the log information of Appium; the problem that an existing mobile application GUI automatic testing method does not consider rough GUI information granularity and too single exploration level, and consequently exploration path coverage is not comprehensive is solved.

The invention provides an automatic calculation method, system, equipment and program product for incremental code coverage rate, which are applied to the field of software testing, and the method comprises the following steps: receiving a code version change event, collecting and merging binary coverage rate data, obtaining an incremental code change set, and generating a structured coverage rate report. According to the scheme, the incremental code coverage rate can be accurately calculated, and the code quality measurement efficiency is improved.

The invention relates to a simulation modeling system based on a UVM. The system comprises a component library management module, an incentive library management module, a top layer generation module, a graphical modeling module, a script generation module, a coverage rate statistics module and a server calling module, wherein the component library management module is used for managing a UVM component model; the incentive library management module is used for managing the incentive model; the top layer generation module is used for generating a corresponding top layer module according to the top layer file; the graphical modeling module is used for modeling according to the UVM component model; the coverage rate counting module is used for counting coverage rate data in the verification test process; the script generation module is used for generating various modeling files; and the server calling module is used for completing simulation of the modeling file. Therefore, the UVM can be directly used to realize random generation of test vectors, automatic comparison of test results and automatic statistics of code coverage rate and function coverage rate, and the FPGA test coverage rate and quality are greatly improved.

The invention belongs to the related technical field of software engineering, and particularly relates to a directional test case generation method based on a large language model and a symbolic execution tool, which comprises the following steps: generating a cue word p based on a to-be-tested program P and a test object code branch T, and generating a test case i through the large language model; using i to test P, and if T is covered, completing generation; otherwise, the code coverage information of the P in the current test is added to the current p in an accumulated mode, the test cases i are regenerated and tested, when the number of retimes reaches the preset retry upper limit m, T is still not covered, the m test cases i serve as input templates, the program literal quantity in each input template is modified into symbolization variables of the symbolization execution tool, and the program literal quantity in the input templates is changed into the symbolization variables of the symbolization execution tool. Constructing a test entry function f of the symbolic execution tool; and synchronously inputting f, P and T into a symbolic execution tool to generate a corresponding test case j, and testing P to complete the generation of the test case. According to the invention, the software test coverage rate can be improved.

The invention discloses a coverage rate testing method and system for incremental codes, and the method comprises the steps: analyzing a current version code and a reference version code of a target project, so as to recognize a change function; performing influence range analysis on the change function to determine an associated code directly or indirectly influenced by the change function, and taking the change function and the associated code as a target monitoring code; executing acquisition logic at a preset position of the target monitoring code through instrumentation implantation so as to collect execution data of the target monitoring code in the running process; and calculating an incremental coverage rate of the target monitoring code based on the execution data. By analyzing and identifying a change function, analyzing and locking associated codes in combination with an influence range, collecting execution data through instrumentation, calculating an incremental coverage rate, accurately positioning a change point and determining a test range, the problems of resource redundancy and low efficiency of a full test are solved, and the defects of insufficient change positioning and coverage analysis are overcome; and precise quantification of incremental code testing is realized.

The invention relates to the technical field of chips, in particular to a code coverage rate processing method, electronic equipment and a medium, and the method comprises the steps: S1, designing a test case in a running regression test based on a to-be-tested chip, and obtaining text information corresponding to each code coverage object; s2, analyzing the attribute information, obtaining chip level information and code coverage rate types corresponding to each code coverage object, analyzing the operation information, and obtaining a regression test sequence number, regression test time and an operation result corresponding to each code coverage object; s3, generating metadata corresponding to each code coverage object, and storing the metadata in a preset script file; s4, analyzing metadata in a preset script file to generate a first database, a second database and a third database; and S5, displaying the form of the code coverage rate. The processing efficiency of the code coverage rate is improved, and resource consumption in the processing process of the code coverage rate is reduced.

The application discloses a kind of stateful network protocol-oriented fuzz testing method, constructs the corpus of initial test case, and carries out compiling and inserting plug-in operation;Through state selection algorithm, the target state of each round of fuzz testing is selected;From the test case set, the corresponding test case queue is selected, then a test case is selected from the test case queue to generate new test case by variation operation, then the new test case is sent to network protocol server to carry out fuzz testing;After a round of fuzz testing is completed in network protocol server, the feedback information of network protocol server is collected, including code coverage, state coverage and state transition, and subsequent fuzz testing process is guided according to feedback information.The above-mentioned method can solve the problems existing in state selection, test case scheduling and other aspects of traditional network protocol fuzz testing, improve network protocol fuzz testing efficiency and vulnerability mining capability.

The invention discloses a code coverage rate statistical method and device, and relates to the technical field of computers. A specific embodiment of the method comprises the following steps: in response to a received software code coverage rate statistical request, implanting a monitoring code into a code of to-be-tested software; obtaining pre-recorded online traffic of the to-be-tested software, performing analysis processing on the online traffic, and starting and executing a code of the to-be-tested software according to an analysis processing result; and obtaining the code execution condition of each component code of the to-be-tested software through the monitoring code, and obtaining the code coverage rate of the to-be-tested software according to the obtained code execution condition. According to the implementation mode, the code coverage rate is reliably and accurately counted, the code of the to-be-tested software is started and executed by using the real online flow, the accuracy and authenticity of the statistical result are ensured, a test case is omitted, and the statistical efficiency is improved.

The embodiment of the invention provides a code coverage rate file superposition method and system, and relates to the technical field of software test.The method comprises the steps that an initial code version is tested for the first time to generate a full coverage rate file; testing the new code version updated each time to generate an incremental coverage rate file; wherein the byte quantity of the incremental coverage rate file is smaller than the byte quantity of the full coverage rate file; and carrying out file superposition on the full coverage rate file and the incremental coverage rate file generated by each update test to generate a complete coverage rate file. Through the embodiment of the invention, the problems of long time consumption and large occupied storage space in the superposition process of the code coverage rate file in the related technology are at least solved, and the effect of reducing the time consumption and the occupied storage space in the superposition process of the code coverage rate file is further realized.

A coverage-guided code generation and fuzzing method based on a large model is proposed to address the problems of existing large model fuzzers, which not only ignore the guiding role of coverage information in the fuzzing loop but also generate prompts too hastily. This invention comprises four stages: prompt generation, fuzzing loop, mutation operator selection, and vulnerability detection. This method proposes a prompt generation method based on expert templates and a fuzzing loop method guided by unequal interval coverage information. The former lowers the barrier to entry for users of CoverFuzz and improves the quality of initial prompts; the latter, guided by coverage information, better covers the object under test to detect vulnerabilities. This invention significantly improves the effectiveness of programs generated by fuzzing based on large models, solves the problem of existing large model-based fuzzers ignoring coverage information, and also achieves higher code coverage.

The application discloses a firmware code coverage statistics method and electronic equipment, and relates to the technical field of program detection, and comprises the following steps: responding to a first script construction command, calling an automatic script to insert a stub point code in a firmware code file, and the stub point code comprising a file index, a statistics function and a macro definition; wherein, a first array created by the macro definition records a code line number and an execution frequency, a second array created by the macro definition records a file index, a line number limit value and a first array address; when executing the firmware code file, the statistics function is called when executing the stub point position, the statistics function counts the executed code in the firmware code file according to the first array and the second array, and the firmware coverage is calculated by combining the executed code with the total code of the firmware code file, thereby solving the problems that the related art occupies a large amount of storage and memory and affects the running performance, and achieving the technical effects of reducing the firmware resource occupation and not affecting the firmware running performance.

The invention provides a code coverage rate statistical method and device, a medium and a product. The code coverage rate statistical method comprises the steps of obtaining a to-be-tested source code file; the source code file is a source code file after code modification; analyzing the source code file to obtain an abstract syntax tree; determining a statement node to be tested according to the modified content in the source code file; after the statement nodes in the abstract syntax tree are subjected to instrumentation, the coverage rate of the source code file is counted.

The invention provides an interactive code coverage rate defect detection method, device and equipment and a medium, the interactive code coverage rate defect detection method comprises the following steps: executing static analysis on a target system by adopting a hook function to obtain a taint set and a call graph of an interactive code configured by the target system; determining a running state diagram of the target system according to the stain set and the calling diagram; obtaining a configuration coverage rate and call stack information of a target system to which the workload is applied through the hook function, and testing the target system according to the configuration coverage rate, the call stack information and the running state diagram to obtain a tested seed pool and variation configuration parameters; and executing an iterative test according to the seed pool and the variation configuration parameters to obtain a configuration defect detection result. The method has the beneficial effect that the configuration interaction code coverage rate and the overall code coverage rate are improved.

The invention discloses a software testing method and device, a medium and a product, and relates to the technical field of software test.The software testing method includes the steps that coverage rate data of unit testing, integration testing and system testing of target software are collected through a code coverage rate analysis tool, and the coverage rate data are converted into target text files; the coverage rate data comprises execution times and coverage rates of the codes; storing each target text file in a corresponding target directory, and reading and analyzing the target text file in each target directory to obtain corresponding analyzed data; the analyzed data comprises a total row number, a total branch number, a total function number, a total coverage row number, a total coverage branch number and a total coverage function number; and merging and storing the analyzed data into a preset nested dictionary, traversing the preset nested dictionary to determine the code coverage rate of the target software based on the traversed analyzed data, and determining the software defect of the target software by using the code coverage rate. The quality and stability of software can be improved through testing.

Methods, systems, and devices for tuning a set of simulation parameters associated with a design verification environment are described that include: simulating a circuit design according to a set of simulation runs; providing, to a machine learning network, an indication of functional coverage results associated with simulating the circuit design according to the set of simulation runs; receiving an output in response to the machine learning network processing the functional coverage results; and simulating the circuit design based on a recommended set of simulation parameters. The output includes: an indication of a near miss event associated with the functional coverage results; and the recommended set of simulation parameters. Simulating the circuit design based on the recommended set of simulation parameters includes generating a set of component signals associated with triggering the near miss event.

The application discloses a kind of efficient regional fuzzy test methods with vulnerability as guide, including the following steps: S1, the target program with vulnerability as guide is plugged in and is compiled, and the target program after plugging in containing code coverage information and potential vulnerability position information is obtained;S2, the target program after plugging in is run regional fuzzy test by the core link of fuzzy test based on seed selection;S3, according to the corresponding processing of regional fuzzy test running result;S4, after the end of regional fuzzy test running, target seed is screened and deduplicated, and potential vulnerability analysis is carried out to the seed after screening and deduplicating.The application can effectively reduce the number of seeds in seed queue in the process of regional fuzzy test while keeping the coverage basically unchanged, reduce the cost of fuzzy test, and then improve the efficiency of fuzzy test.

This invention relates to the field of chip technology, and more particularly to a method, electronic device, and medium for obtaining large-scale chip code coverage. The method includes step S1: constructing different test clusters; step S2: for G... i q Set the verification configuration information, test parameters, and set of interfaces to be verified; Step S3, Parallel verification based on each A i q Generate the corresponding file list and compile to produce the corresponding executable file F. i q Step S4: Parallel processing of B i q Transmitted to G i q The test cases in the F i q Perform the corresponding verification operation to obtain G. i q The set of interfaces to be verified, E, has been flipped. i q Step S5, when G q After all operations are completed, obtain G. q All corresponding E i q Union of GE i q Step S6: When all G q After all operations are completed, retrieve all GE data. i q The union of GE and GD is used to determine the code coverage of large-scale chips. This invention can accurately and quickly obtain the code coverage of large-scale chips.

The invention discloses a parameter sensitive database fuzzy testing method and system based on combination testing, and the method comprises the steps: obtaining a coverage basic block set of each parameter through static taint analysis, generating a weight value of each parameter, and further determining a priority parameter combination set; training the condition generation probability of each SQL characteristic class under specific parameters through coverage rate feedback, and constructing a test sample generation scheme corresponding to the parameters; and finally, generating parameters and corresponding test samples through the weight data generated in the training stage, and checking execution results of the test samples through an oracle machine. According to the method, the parameter weight and the characteristic generation probability are adjusted through static analysis and the code coverage rate, intelligent scheduling of high-value test paths is achieved, the test efficiency and the coverage rate are improved, meanwhile, the problem of parameter combination space explosion is solved, and an innovative solution is provided for quality assurance and performance optimization of a database system.