261 results about "Code coverage" patented technology

The invention discloses a test case generation method and device, equipment and a medium, and relates to the technical field of software testing, and the test case generation method comprises the following steps: storing request data subjected to structured processing into a seed case library; the request data are various types of request data in the operation process of the service system; determining a cue word according to the target information based on the large model, and generating an initial test case through the cue word and a generation rule; the target information comprises characteristics of request data in the seed case library, an interface document of the tested software and a business logic specification; executing the initial test case according to the test request of the tested software, performing statistical analysis on the code coverage rate of the tested software in the execution process, and screening the initial test case according to an analysis result to obtain a screened test case; and after the execution is finished, filtering the screened test cases according to the first execution result of each test case to obtain a target test case. Therefore, the testing efficiency and quality can be improved, and automatic testing is achieved.

The invention relates to a fuzzy test Kubernete-based three-party component vulnerability mining method, which comprises the following steps of: firstly, automatically identifying a user controllable function by combining a large language model based on an official document, a configuration list and source code information of a three-party component, and constructing a keyword dictionary to assist in large-scale identification of a potential target function; then analyzing context information of the target function and an interaction relation of the target function in a Kubernetes cluster, constructing a front dependency library required by fuzzy testing, and automatically generating a fuzzy testing driving program; integrating a fuzzy test driving program with a three-party component source code, performing code instrumentation, pre-compiling and corpus optimization, generating test input according to a set variation strategy, dynamically monitoring a coverage rate and an abnormal behavior, and continuously optimizing a test corpus; and finally, based on the crash behavior of the fuzzy test record, analyzing a trigger path of the vulnerability, performing vulnerability verification in a local Kubernetes cluster environment, and finally generating a vulnerability analysis report.

The invention provides a method and device for generating a test case based on a large model and electronic equipment, and relates to the technical field of artificial intelligence such as natural language processing, large language models and deep learning. According to the specific implementation scheme, when a test case is executed to test a tested code, assertion error reporting information is obtained; generating a first prompt word based on at least one of the test case, the tested code and the assertion error report information; inputting the first cue word into the large model to obtain a first output result of the large model; the first output result comprises repair scheme information, and the large model is used for outputting the repair scheme information matched with the first cue word based on the first cue word; and performing multiple rounds of interactive dialogues with the large model based on the first output result to generate a test case of the tested code. By implementing the embodiment of the invention, the accuracy and the code coverage rate of the test case can be improved, the problem can be quickly positioned, the repair suggestion can be automatically generated, the manual intervention is reduced, and the test efficiency is improved.

The invention relates to an interactive visualization method, device and equipment for fuzzy test bottleneck breakthrough, and belongs to the field of network security. According to the method, all compiling modules in a tested program are combined into a complete intermediate code, and a global view of the tested program is obtained; generating a unique label for each function by using a hash algorithm; constructing a call graph and a control flow graph, and obtaining function call instruction information by scanning a basic block of each function; carrying out pile insertion on the basic blocks; performing a fuzzy test on the tested program after compiling and instrumentation, and obtaining runtime data in real time; according to the fuzzy test runtime data and the static analysis data, data-driven visualization is carried out, and a call graph, a control flow graph and real-time execution statistical information are displayed in real time; a test engineer is assisted through an interactive chart, and fuzzy test bottleneck constraints are positioned. According to the method, a test engineer can be helped to better understand and intervene the fuzzy test process, and the fuzzy test code coverage rate and the defect detection number are improved.

A system and a method for creating an optimal test suite. The system may receive code coverage data from a set of testing channels. Further, a combined dataset is created by merging the code coverage data received from the set of testing channels. The combined dataset is analyzed to identify a line of code being executed by two or more test cases corresponding to two or more testing channels of the set of testing channels. Further, at least one test case from the two or more test cases having less efficiency is eliminated to create an optimal test suite. The efficiency is determined based on at least one of execution time, execution cost, and resources required to execute the line of code.

The invention discloses a test case generation method and device, a test case test method and device, a medium and a program product, and relates to the technical field of interface test and artificial intelligence, the method comprises the following steps: obtaining flow data of a first interface in a first service and a code corresponding to the first service; based on the traffic data, the code and a target model, a test case is generated, the test case comprises a test scene, test traffic and an assertion rule, and the test scene is used for representing a target field in the traffic data and a combination of values of the target field, the assertion rule is used for representing a target test result of the test case. According to the method, the generation efficiency of the test case can be improved under the condition of ensuring the test coverage and the code coverage.

The invention discloses a prototype verification method of a DDR4 controller in the technical field of chip verification, the method is applied to a prototype verification platform, a DDR controller and a PHY module in a chip to be verified are matched on the prototype verification platform, and the PHY module integrates a DFI to phy only interface module and a standalone PHY only block module through a python script; the prototype verification method comprises the steps that in response to a verification instruction received by a DDR controller, the DDR controller generates a control instruction according to the verification instruction and sends the control instruction to a DFI to phy only interface module; in response to the control instruction received by the DFI to phy only interface module, the DFI to phy only interface module converts the control instruction from a DFI protocol to a target control instruction of a PHY protocol, and sends the target control instruction to the standalone PHY only block module; in response to the control instruction received by the standalone PHY only block module, the standalone PHY only block module sends a target control instruction to a DDR particle externally connected with the prototype verification platform, so that read-write and verification with the DDR particle are realized; according to the method, the DDR memory interface IP prototype verification code coverage rate can be improved.

The invention discloses a full-process automatic unit testing method, device and equipment for an AI chip operator, a medium and a product. The method comprises the following steps: generating an engineering directory and a test framework design document through an architect agent according to operator interface information and a DSL operator design document knowledge base; the method comprises the following steps of: generating a test code for unit test by a software engineer agent according to a test framework design document and a domain knowledge base, and storing the test code in an engineering directory; multiple rounds of interaction are carried out through a software engineer agent and a test engineer agent, a test code is gradually corrected into a target test code which can be successfully compiled, a generated test case can be successfully executed and the generated test case meets the code coverage rate requirement, and a target operator code passing a unit test is obtained; and submitting the target operator code and the target test code which pass the normativity check to a code warehouse through a code auditing engineer agent so as to automatically realize the whole-process unit test of the AI chip operator.

A system for automated software testing and continuous integration in an agile environment, consisting of: a central processing unit (CPU) configured to execute test protocols and manage integration processes; a test engine operationally connected to the CPU, configured to detect code changes, select relevant test cases based on dependency mapping, and execute automated tests across multiple environments, generating logs and coverage reports; a CPU-connected continuous integration server configured to compile and deploy software builds upon successful completion of test protocols, the server including a rollback mechanism to revert to previous builds in case of failure; and a containerization module linked to the test engine and the continuous integration server.The containerization module uses container technology to create isolated test environments for consistent and parallel test execution, thereby optimizing resource allocation; and a feedback reporting unit configured to consolidate test results, build status, and code coverage metrics and present them to development team members in real time via an integrated dashboard, enabling an immediate response to identified issues.

The invention discloses a test case generation method and device, equipment and a medium, and relates to the technical field of software test optimization. According to the scheme, the multiple initial test cases are obtained, and the test reports corresponding to the initial test cases are generated through the first preset test tool, so that the time for manually compiling the test cases is effectively shortened; when it is determined that a to-be-supplemented test case of which the corresponding code coverage rate index does not meet a preset requirement exists according to each test report, code uncovered information of the to-be-supplemented test case is determined, and test case optimization parameters are configured in combination with project requirements; and based on the parameter, calling a second preset test tool and a large language model to supplement the to-be-supplemented test case to obtain a complete test case. According to the scheme, the availability of the test case is improved through combination of multiple tools; workflows of test cases covering complex environments such as a function calling relation and a control flow structure are generated by utilizing the inference capability of a large language model, and the code coverage rate of the test cases is remarkably increased.

The invention relates to the technical field of automatic testing, and discloses an automatic testing scheme generation method and device and a medium, and the method comprises the steps: matching a demand action in a test demand with a code entry name corresponding to a code segment, and determining a code risk level of a current demand code block; analyzing the code change frequency and the code dependency degree of the current demand code block according to historical test records in the test domain knowledge base, and determining the test dynamic priority of the current demand code block; constructing a control flow diagram and a data flow diagram of the current demand code block, and detecting risk nodes in the control flow diagram and the data flow diagram; generating a test scene of the current demand code block according to the risk node, and generating a boundary value test rule according to a key constraint condition in the data flow diagram; and querying an environment simulation rule of the current demand code block, and packaging the test scene, the boundary value test rule and the environment simulation rule into an automatic test scheme. According to the invention, the code coverage when the test scheme is generated can be improved.

The invention relates to the technical field of chips, in particular to a large-scale chip code coverage rate obtaining method, electronic equipment and a medium, and the method comprises the following steps: S1, constructing different test clusters; s2, setting verification configuration information, test parameters and a to-be-verified interface set for the Giq; s3, generating a corresponding file list based on each Aiq in parallel, and compiling to generate a corresponding executable file Fiq; s4, transmitting the Biq to a test case in the Giq in parallel, executing a corresponding verification operation based on the Fiq, and obtaining a set Eiq of the interfaces to be verified which are overturned by the Giq; s5, after the Gq is completely executed, obtaining a union set GEiq of all Eiq corresponding to the Gq; and S6, after all Gq are executed, obtaining a union set GE of all GEiq, and determining the code coverage rate of the large-scale chip based on GE and GD. According to the method, the large-scale chip code coverage rate can be accurately and quickly obtained.

The invention discloses a fuzz testing method and system for code generation and automatic program repair based on a large model, which are used for solving the problems of high code generation error rate and high testing cost in the running process of an existing large model fuzzer. The method comprises four stages of cue word screening, fuzzy circulation, program repairing and vulnerability detection. A large language model is used as a main generator, an operator selection problem in a fuzzy loop stage is modeled as a multi-arm tiger machine problem, and a Thompson sampling algorithm is used to improve the diversity and effectiveness of program generation. The generated program is cyclically repaired, so that program errors caused by lack of API (Application Program Interface) combination constraints are reduced. According to the method, the effectiveness of the program generated by the fuzz test based on the large model is obviously improved, the problem that the error rate of the program generated by an existing fuzzer based on the large model is high is solved, and the code coverage rate is higher.

The invention relates to the technical field of software testing, and discloses a code coverage rate determination method and device, computer equipment and a storage medium, and the method comprises the following steps: obtaining a plurality of source code files of a firmware module of a disk array card, compiling the source code files into execution files, performing instrumentation processing on the plurality of source code files in the compiling process, and obtaining the execution files; the execution information of each source code is updated when the execution file is operated; generating basic block files corresponding to the plurality of source code files, wherein the basic block files comprise pointers pointing to execution information of the corresponding source code files; running the execution file to enable the disk array card to map execution information of the basic block file and the source code file to a host cache region; after the execution file is operated, obtaining execution information of each source code file, and writing the execution information into an execution information file; and analyzing the execution information file and the basic block file to obtain the code coverage rate of each source code file. According to the invention, the coverage rate of the software code of the disk array card can be obtained.

The invention relates to the technical field of computer testing, in particular to an incremental code coverage rate calculation method which comprises the following steps: executing a test case on a current version code, and collecting code test coverage information; comparing the baseline version code with the current version code to obtain a change code; based on a baseline version code, performing semantic equivalence analysis on the change code to obtain a logic change code, the semantic equivalence analysis being used for filtering change codes of non-logic factors; and calculating an incremental code coverage rate according to the logic change code and the code test coverage information, wherein the incremental code coverage rate comprises a change line coverage rate and a change link coverage rate. According to the multi-dimensional analysis method, coverage rate evaluation is more scientific and comprehensive, developers can better find test blind spots and potential defects, and therefore the software quality is improved.

The invention discloses an automatic test case generation and execution method, which comprises the following steps: obtaining input content uploaded by a user, and analyzing the input content uploaded by the user to obtain structured key data; generating a preliminary test case according to the structured key data and a general rule of a knowledge base, optimizing the preliminary test case according to historical data and a code coverage rate, and generating a test case; compiling a test script according to the test case, and executing the test script; analyzing and processing the test execution result, and generating an execution structure and a test case analysis report; and performing optimization processing on the test execution result and the historical data, and dynamically adjusting a test strategy according to an optimization processing result. The invention further discloses a system for realizing the automatic test case generation and execution method. The test efficiency is improved, the test coverage rate is increased, the execution performance is improved, and automatic continuous testing is supported.

The invention discloses an incremental code coverage rate acquisition device based on a Java bytecode dynamic instrumentation technology, and relates to the technical field of software testing and quality control. Comprising a code difference analysis module, a byte code instrumentation module, a coverage rate data acquisition module, a coverage rate data integration module, a coverage rate report generation module and a test trigger and threshold control module, and a syntax tree structure of incremental codes is generated based on a Java syntax analysis tool, so that line level analysis of code differences is realized. According to the method, incremental codes are accurately analyzed through Git and JavaParser, coverage rate data are collected through dynamic instrumentation, a unified report is generated in combination with path analysis, missing scenes are marked in a highlighted mode, and the test efficiency and the code quality control capacity are improved.

The invention provides an automobile electronic control unit fuzzy testing method based on partial code coverage rate feedback and a computer, and belongs to the technical field of automobile electronic control unit code testing. The computer performs static analysis on source codes of the automobile electronic control unit, identifies inevitable execution blocks and conditional execution blocks, performs selective instrumentation on the conditional execution blocks, and inserts coverage rate recording instructions of the conditional execution blocks. And the computer source code is loaded into the automobile electronic control unit, and a test input signal is generated through the fuzzy test engine and is injected into the automobile electronic control unit. In the process of executing the program by the automobile electronic control unit, recording the coverage condition of the condition execution block to a bitmap in the memory; the computer reads the coverage rate data of the condition execution block through the debugger every time a complete execution cycle is completed; and the fuzzy test engine adjusts the input generation strategy according to the coverage rate data feedback of the condition execution block and tests again. According to the method, the automobile electronic control unit source code fuzzy test coverage condition is efficiently collected.

The invention discloses a code testing method, a code testing device, a storage medium and a program product. The method comprises the steps of obtaining target code data and historical code data, and determining a change line according to the target code data and the historical code data; obtaining a plurality of coverage lines corresponding to the target code data, and determining a change line coverage result according to whether the coverage lines are change lines or not; a code coverage report is generated at least according to the line coverage changing result, the code coverage report comprises the line coverage changing rate of the target code data, and the line coverage changing rate is the ratio of the total number of coverage changing lines to the total number of changing lines; and under the condition that the change line coverage rate is greater than a threshold value, determining that the target code data passes the test. According to the method and the device, the technical problem that the coverage condition of the changed content cannot be accurately explained by the incremental code coverage rate in the prior art is solved.

The invention discloses a test method based on code link dynamic tracking. The method comprises the steps of obtaining version difference information of a to-be-tested code from a version library and generating a code test submission list; when a tester initiates a test request, performing flow identification injection on the test request through the front-end agent module and forwarding the test request to the tested application service module; the back-end acquisition module monitors all the tested application service modules in a dynamic code instrumentation mode, and extracts code link calling information of the service modules from all the tested application service modules based on the traffic identifiers; and comparing the code coverage rate of the code link calling information with the code test submission list, determining an abnormal code path based on the code coverage rate and the code link calling information, and generating abnormal information. According to the method, the code coverage rate can be calculated in real time in the process of executing the function test by testers, and the situations that the function test cases are missed and developers carry non-demand codes to be online are avoided.

The invention relates to the technical field of program testing, in particular to a seed scheduling method and system for multi-objective optimization in grey box fuzzy testing, and the method comprises the steps: dividing related indexes of seeds into state related indexes and state independent indexes; modeling a priority ranking problem of the seeds into a multi-objective optimization problem according to state related indexes, calculating Pareto leading edges of the seeds based on a non-dominated ranking algorithm, and screening out the seeds with high priorities; selecting seeds according to a seed selection basic principle; determining the weight of each index by using an analytic hierarchy process according to the state-independent indexes, evaluating the quality of the seeds through an approximate ideal solution algorithm, and distributing reasonable energy for the seeds; and based on the priority and the energy distribution result, selecting the seeds for mutation to generate a new test case. According to the method, seed priority division and energy distribution are optimized, so that the seed scheduling efficiency in grey-box fuzzy testing is remarkably improved, and accurate testing is realized at a higher code coverage rate and a faster vulnerability discovery speed.

The invention relates to a stateful protocol fuzzy test method and system based on response information. The method comprises the following steps: S1, a preprocessing stage; S2, a fuzzy test stage; s3, a state selection stage; and S4, a seed scheduling stage. The system comprises a test preparation module, a fuzzy test module, a state selection module and a seed scheduling module. According to the method, the source code of the protocol entity program to be tested is statically analyzed to capture distribution and use of enumeration type variables in the source code. According to the method, the response result information of the tested program is analyzed, the response header field is extracted, on the basis that the response code represents the state, the state is further subdivided, the states represented by a plurality of same state codes in the same seed are effectively distinguished, and the detection accuracy is improved. And the seed value and the variation position are adjusted by using the response header field information reaching the target state and the coverage rate information, so that the code coverage rate of the stateful protocol fuzz test is remarkably improved, more vulnerabilities are found, and the fuzz test efficiency is greatly improved.

The invention discloses a test case obtaining method and device, equipment and a medium. The method comprises the following steps: generating a test case feature vector and a code branch condition coverage feature vector according to a historically generated code coverage report, and splicing the test case feature vector and the code branch condition coverage feature vector to generate a transaction set; generating a plurality of multi-item sets according to a preset support degree and the transaction set; generating a first result set and a second result set according to a preset confidence coefficient and each multi-item set; and when the incremental code coverage report is generated each time, determining a plurality of target test case feature vectors in the first result set or the second result set according to the incremental code coverage report, and obtaining a test case according to the target test case feature vectors. By adopting the technical scheme, the supplementary test case can be intelligently and accurately provided for the uncovered code, the test efficiency and quality are improved, and the cost is saved.

The invention discloses a chaos test scene supplementing method and device, equipment and a storage medium. The method comprises the steps that a software system is analyzed through a micro-service analysis tool, and a chaos test scene corresponding to the software system is generated in combination with a rule engine tool; executing the chaos test scene on a chaos engineering platform, and obtaining scene data when the chaos test scene is executed in combination with a code coverage rate tool; and when the current code coverage rate of the software system does not reach the expectation, inputting the scene data into a pre-trained machine learning model, and supplementing a new chaos test scene based on the machine learning model. According to the method, when the current code coverage rate of the software system does not reach the expectation, a new chaos test scene is supplemented through the machine learning model, and the code coverage rate of the chaos test scene can be improved.

The invention discloses a method and a system for evaluating a test coverage rate based on a Java call link, and relates to the field of software testing. The method comprises the following steps: identifying a difference function according to a first comparison result, and constructing a call chain tree structure by taking the difference function as a root node based on a code call relation graph; analyzing the difference function to obtain a direct code change line of the difference function, based on a call chain tree structure, identifying a related code line on a call chain where each call point is located as a call point code line, and summarizing the direct code change line and the call point code line; and analyzing the code coverage rate data to obtain an actually covered code line, comparing the to-be-tested code line with the actually covered code line, determining coverage rate index data based on a call chain according to a second comparison result, and determining a test coverage rate evaluation result according to the coverage rate index data. The test coverage rate can be evaluated more comprehensively and accurately.

The invention provides a mobile application GUI automatic testing method and system based on hierarchical reinforcement learning, and belongs to the technical field of mobile application testing. A real hardware device or a virtual machine is used for building a testing environment and configuring an automatic exploration framework, a to-be-tested application program is initialized, GUI layer information and control layer information are extracted respectively, and the GUI layer information and the control layer information are extracted respectively; the method comprises the following steps: acquiring a GUI layer and a control layer, converting the GUI layer and the control layer into a fine-grained state vector convenient for subsequent reinforcement learning processing, exploring the GUI layer and the control layer by using hierarchical reinforcement learning in combination with a reward function, processing interaction between the two layers of networks, and performing conversion by using an FSM when an exception occurs. Respectively obtaining a code coverage rate and a crash detection result by utilizing the code coverage rate detection framework and the log information of Appium; the problem that an existing mobile application GUI automatic testing method does not consider rough GUI information granularity and too single exploration level, and consequently exploration path coverage is not comprehensive is solved.

The invention provides an automatic calculation method, system, equipment and program product for incremental code coverage rate, which are applied to the field of software testing, and the method comprises the following steps: receiving a code version change event, collecting and merging binary coverage rate data, obtaining an incremental code change set, and generating a structured coverage rate report. According to the scheme, the incremental code coverage rate can be accurately calculated, and the code quality measurement efficiency is improved.

The invention relates to a redundant code identification method and device, computer equipment and a readable storage medium. The method comprises the following steps: acquiring a compiled initial hardware description language code, compiling the initial hardware description language code, performing code rule check on the compiled initial hardware description language code, performing simulation analysis and code coverage rate analysis on the compiled hardware description language code, and performing simulation analysis and code coverage rate analysis on the compiled hardware description language code. And identifying and marking the uncovered target hardware description language codes, identifying redundant codes in the target hardware description language codes according to the marking information of the target hardware description language codes, and processing the redundant codes. By adopting the method, the redundant codes can be effectively identified and processed, the code quality and the system performance are improved, and the reliability and maintainability of the system are enhanced.

The invention relates to a simulation modeling system based on a UVM. The system comprises a component library management module, an incentive library management module, a top layer generation module, a graphical modeling module, a script generation module, a coverage rate statistics module and a server calling module, wherein the component library management module is used for managing a UVM component model; the incentive library management module is used for managing the incentive model; the top layer generation module is used for generating a corresponding top layer module according to the top layer file; the graphical modeling module is used for modeling according to the UVM component model; the coverage rate counting module is used for counting coverage rate data in the verification test process; the script generation module is used for generating various modeling files; and the server calling module is used for completing simulation of the modeling file. Therefore, the UVM can be directly used to realize random generation of test vectors, automatic comparison of test results and automatic statistics of code coverage rate and function coverage rate, and the FPGA test coverage rate and quality are greatly improved.

The invention belongs to the related technical field of software engineering, and particularly relates to a directional test case generation method based on a large language model and a symbolic execution tool, which comprises the following steps: generating a cue word p based on a to-be-tested program P and a test object code branch T, and generating a test case i through the large language model; using i to test P, and if T is covered, completing generation; otherwise, the code coverage information of the P in the current test is added to the current p in an accumulated mode, the test cases i are regenerated and tested, when the number of retimes reaches the preset retry upper limit m, T is still not covered, the m test cases i serve as input templates, the program literal quantity in each input template is modified into symbolization variables of the symbolization execution tool, and the program literal quantity in the input templates is changed into the symbolization variables of the symbolization execution tool. Constructing a test entry function f of the symbolic execution tool; and synchronously inputting f, P and T into a symbolic execution tool to generate a corresponding test case j, and testing P to complete the generation of the test case. According to the invention, the software test coverage rate can be improved.