346 results about "Regression testing" patented technology

The invention discloses a test case determination method and device, a computer readable storage medium and a processor. The method comprises the following steps: identifying a source code of software by utilizing a pre-trained large model to obtain a plurality of functional modules in the software and a dependency relationship among the plurality of functional modules; in response to updating of the source code of the software, determining a code updating part in the source code; determining a test case matched with the code updating part from a test case library of the software based on the code updating part and a dependency relationship among the plurality of functional modules, the test case being used for testing the code updating part; based on a test result of the test case, adjusting a selection strategy of the test case; and re-determining the test case for testing the code updating part based on the adjusted selection strategy of the test case. The technical problem that a traditional regression test strategy is low in test efficiency is solved.

A method is provided for optimizing regression testing in a software development environment. The method includes analyzing source code to create a structural dependency graph that maps dependencies between code elements; identifying changes in the source code between a current version and a previous version; mapping the identified changes onto the structural dependency graph to determine affected code elements; selecting a subset of regression tests based on the affected code elements identified in the dependency graph; and executing the selected subset of regression tests to validate the changes in the source code.

The invention discloses a method and a system for realizing automatic code generation by using multiple AI Agents, and relates to the field of electric digital data processing, a test driving agent receives a task transmitted by a previous node, and generates a task number, a task description, test data, a unit test script and a code statement; the code generation agent generates or updates codes according to the received task description and code declaration; the test driving agent returns an integrated test script and test data according to the task number; the continuous integration agent performs integration verification and regression test and feeds back information; the test driving agent returns a function test script, a performance test script and test data according to the task number; and the continuous deployment agent carries out continuous delivery and deployment and feeds back information. By means of mutual conversation and cooperative work of multiple AI Agents and in combination with a feedback mechanism, the problem that a single large model cannot complete complex software development tasks is solved, full-process operation automation can be achieved, and the code generation quality and efficiency can be improved.

The invention relates to the technical field of chip verification, and discloses a chip verification method, test equipment and a chip verification system.The method comprises the steps that a template file is built, a verification environment and a test case are generated based on the template file, a configuration file is obtained, and parameters in the verification environment and the test case are updated through parameters in the configuration file; according to the method, the verification environment and the test case are updated, the updated verification environment and the updated test case are obtained, regression testing is carried out on the chip on the basis of the updated verification environment and the updated test case, the test result is obtained, the verification environment can be rapidly generated on the basis of the template file, parameters can be rapidly replaced, and the chip testing efficiency is improved.

The invention discloses a regression test case determination method and device, a storage medium and electronic equipment, and relates to the field of artificial intelligence. The method comprises the steps of obtaining a target change code of a target program; the target change code is input into a vector machine model, code features of the target change code are extracted through the vector machine model, a potential defect score of the target change code is determined according to the code features, and the potential defect score is used for representing the probability that the target program is abnormal due to the target change code; and determining at least one regression test case for testing the target change code from the M test cases according to the potential defect score of the target change code, the code feature of the target change code and the case feature of each test case in the M test cases. The technical problem that in the prior art, the efficiency of compiling the regression test case is low is solved.

The invention provides a DFT test task management method and device, electronic equipment and a storage medium, and belongs to the technical field of chip design verifier.The DFT test task management method comprises the steps that a data model is constructed on the basis of a design module list and a test step list, the data model is used for indicating testability design DFT test steps of all design modules, and the test steps of all the design modules are stored in the test step list; the data model comprises a plurality of DFT test tasks, attributes of each DFT test task comprise a selection state, and the selection state comprises a selected state and a non-selected state; based on the interactive input, determining at least one DFT test task of which the selection state is selected as an executable DFT regression object; and according to the DFT regression object, driving a DFT test task to be executed. According to the method, the DFT test tasks are normalized through the data model, only the DFT test tasks need to be selected for making the test plan, efficient management of the DFT test tasks is achieved, and the regression test efficiency is improved.

The invention relates to a regression testing method and system, computer equipment and a storage medium, and the method comprises the steps: obtaining a code change record, and carrying out the data preprocessing of the code change record; feature extraction is carried out on the code change records after data preprocessing, change features are obtained, and the change features at least comprise code elements and element relations; analyzing the change features and each basic test case in a test case library by using a risk identification model, and determining a regression risk level of each basic test case; determining a regression test case, wherein the regression test case comprises a basic test case of which the regression risk level is greater than or equal to a preset level threshold; and executing a regression test according to the regression test case. According to the invention, the test efficiency of code change records can be improved, and functional modules with relatively high regression risks are covered as much as possible.

The invention relates to the technical field of software testing, and discloses a computer software performance testing method which comprises the following steps: S1, determining performance testing requirements: determining key performance indexes according to application requirements, and designing a layered load model; s2, constructing a dynamic test environment: realizing elastic adjustment of resources by utilizing a virtualization technology; s3, distributed performance testing: executing concurrent testing at a plurality of nodes, and simulating access of different users; s4, transverse extension testing: adjusting a virtual machine or a container, and evaluating the system extension capability; s5, collecting and analyzing performance data: analyzing and monitoring the performance data through a time sequence, and identifying a bottleneck; and S6, generating an optimization suggestion and a regression test: automatically generating the optimization suggestion, and verifying the effect through the regression test. Through combination of a virtualization technology, Kubernetes and OpenStack and cooperation with a lateral extension test, the stability and the extension capability of the system under a high concurrency condition are verified, and the overall operation efficiency is improved.

The invention relates to the technical field of automatic testing, and discloses an automatic test case generation method and device and a medium, and the method comprises the steps: constructing test case knowledge bases of different fields, and carrying out dynamic and static joint feature analysis on code libraries corresponding to field test data; performing intention recognition on the test demand data, and performing atomization operation on the test demand data according to the test demand intention; identifying a test demand code block associated with the test demand data; generating a basic test case of the test demand code block according to the atomization parameter, and injecting an abnormal stream into the basic test case according to the atomization parameter to obtain a target test case; and selecting a similar test case corresponding to the target test case from the test case knowledge base, performing regression test on the test demand code block by using the regression test case, and optimizing the regression test case according to a test result to obtain an automatic test case. According to the invention, the coverage rate during test case generation can be improved.

The invention discloses a reverse backtracking accurate test method and system, and the method comprises the steps: S1, starting a test task, selecting a test submission development branch according to the test task, and triggering the construction of a test task project according to a preset continuous integration tool; s2, obtaining a code difference between the development branch and the main branch; s3, acquiring an interface influenced by the test task; s4, respectively obtaining a dynamic call chain and a static call chain; and S5, generating a calling report. Based on the combination of static code scanning and request logs, the complete influence range of the application can be obtained, the test comprehensiveness is ensured, the regression test cost in the release period is greatly reduced, transformation and adaptation are all carried out based on due infrastructures in the original application, and the related cost is greatly reduced.

Systems, methods, and machine-readable media may facilitate one or a combination of the following. A software change operation within a deployment pipeline for testing and deploying a software change to a production computing service may be processed. The software change operation may be identified as corresponding to a software change with the deployment pipeline, where the software change may be identified as being configured to make a pipeline change to a configuration of the deployment pipeline itself. Responsive to the identifying, a regression suite configured to run a plurality of test applications on the deployment pipeline to test the deployment pipeline with respect to the software change may be invoked, and the plurality of test applications may be run with the software change. The running the plurality of test applications may include simulating pipeline runs with a plurality of use cases.

The invention discloses a regression testing method and device, equipment and a medium, and relates to the technical field of software testing, and the method comprises the steps: collecting current code change data between a previous version code and a current version code of to-be-tested software, and generating current change details; performing static code analysis and dynamic code analysis on the current version code to obtain an initial dependency relationship graph and a runtime dependency relationship, and obtaining a target dependency relationship graph based on the initial dependency relationship graph, the runtime dependency relationship and the current change details; traversing each dependency relationship in the target dependency relationship graph by using a graph traversal algorithm to obtain a propagation path influenced by the current code change data, and determining a regression test range of the current version code by using the target pre-training model and the propagation path; and continuously integrating and deploying the assembly line to execute the test case set generated based on the regression test range, and completing the regression test to obtain a current regression test result. And the regression test efficiency and timeliness rate are improved.

The invention relates to the technical field of core board testing, in particular to a core board cross-platform function testing and verifying method which comprises the following steps: building a testing environment of a plurality of operating systems and hardware platforms through a virtualization technology or actual hardware, automatically generating a cross-platform compatible testing script based on core board function requirements, supporting multi-platform operation, and verifying the core board cross-platform function. Executing the test scripts in parallel on the platforms, recording and analyzing running logs and outputting results; functional consistency on different platforms is verified through a Hash comparison algorithm, it is ensured that the core board has the same function under the multi-platform environment, performance testing is conducted on all the platforms, performance bottlenecks are recognized, and optimization is conducted through an adjusting and optimizing tool; and finally, verifying the repairing effect through fault positioning and regression testing, and automatically generating a test report. According to the method, the efficiency of cross-platform testing of the core board, the accuracy of function verification and the effect of performance optimization are improved, and the method is suitable for core board testing and optimization scenes in a complex multi-platform environment.

The invention discloses a communication protocol automatic analysis and test data generation method and system, and the method comprises the steps: analyzing an unstructured protocol document, recognizing a fixed field and a variable field in the document, and outputting structured data; automatically generating test data based on the structured data, dynamically calculating a checksum according to a specified check algorithm type in the structured data, and filling the checksum into the original message to form a complete test message; and generating a standardized test data set according to the complete test message. According to the method, manual intervention is not needed from document analysis to test data generation, the analysis efficiency is improved, and most protocol scenes are covered through the boundary value, the abnormal value and the orthogonal combination strategy. The method supports various document formats, data types and verification algorithms, adapts to protocol standards of different industries, facilitates problem positioning and regression testing through standardized output documents, and reduces the maintenance cost.

A method of improving chatbot accuracy includes receiving an input test file containing chatbot interactions data including utterances, expected intents, and expected responses. For each interaction, the method may generate predicted intents and responses using an AI-based chatbot trained on previous interaction data. The method may determine similarity between predicted and expected responses / intents by calculating Levenshtein distances and comparing to predetermined thresholds. Failed interaction keywords may be extracted using natural language processing to identify failing topics. Machine learning decision tree classification may analyze patterns in failed interactions to generate resolution suggestions. The method may generate an interactive dashboard displaying historical performance trends, domain-specific accuracy metrics, visualizations of frequently keywords, and confidence distributions for failed interactions. This automated regression testing approach enables efficient identification and resolution of chatbot performance issues while maintaining response quality.

The invention relates to the technical field of chips, in particular to a chip regression test method based on to-be-tested design configurations, electronic equipment and a medium, and the method comprises the steps: automatically generating a test case corresponding to each to-be-tested design configuration through setting chip regression test starting parameters and pre-constructed test case reconstruction information; recording test case states of a regression test preparation process and an operation process which need to record historical information in a database, and optimizing each to-be-tested design configuration to allocate a corresponding resource configuration based on a user identifier, historical regression test information corresponding to a to-be-tested design identifier and a current machine load; and the chip regression test efficiency and accuracy are improved.

A method includes: predicting a jeopardy associated with an edge server included in the server cluster that communicates with a central server; responsive to predicting the jeopardy, detaching the edge server from the server cluster; determining a patch based on the jeopardy; pushing the patch to the edge server; validating the patch by performing regression testing; and responsive to validating the patch, inducting the edge server into the server cluster.

The invention provides a front-end regression test method, a program product, electronic equipment and a storage medium. The method comprises the following steps: acquiring user behavior data of a user in a to-be-tested application program; based on the element positioning information, performing semantic annotation on the user behavior data through a predefined rule and / or a semantic understanding model to obtain semantic information; based on the network request data, grouping the labeled user behavior data, and screening out a test case corresponding to a single page path for a user behavior data group; restoring the test environment to an initial state; determining a target element corresponding to the interactive operation data in the test case by adopting an element positioning algorithm; and in the initial state, executing a corresponding interaction operation based on the target element, and completing test playback. Therefore, the test script has higher adaptability to local change of the front-end page, the large-scale failure risk of the test case caused by the change of the page structure is reduced, and the stability and reliability of the test are enhanced.

In the DevOps process, testing teams use automated testcases to test a product in a regression testing running daily, which generate thousands of log files per run, in various distributed environment with different formats. Solutions to errors depend on SMEs and the impact of solution leads to rework of defect / errors and high degree of heterogeneity. This leads to huge bottleneck in automation of DevOps process leading to loss of productivity and agility. Present disclosure addresses the challenges by providing systems and methods that auto capture the log files of different formats efficiently in a scalable, extendible, and plug-able way. The system then mines and parses the log files based on given identifiers to standardize and de-duplicate to create unique error records with detail description including cause, position, module, timestamp, etc. The system predicts the solutions leveraging the database containing solutions and errors by using a modified Smooth Inverse Frequency technique.

The invention provides an automatic simulation test system and method for a semiconductor EAP system, and belongs to the field of semiconductor manufacturing, and the method specifically comprises the steps: defining a test scene through test case coding; constructing a test environment by using the equipment simulation module and the external system simulation module; driving a test process of the tested EAP program through an automatic execution engine and generating real-time output data corresponding to the tested EAP program; and comparing the real-time output data generated by the automatic execution engine with an expected result, and generating a test report. According to the processing scheme, behaviors of equipment and an external system are truly simulated in a software simulation mode, an actual production scene is accurately restored in a test link, dependence on a physical environment is reduced, and test coverage is improved; and moreover, the test scene is solidified through codes and configuration files, so that the versioning management and one-key automatic regression test of the test cases are realized, the test efficiency is remarkably improved, and the quality of secondary development is guaranteed.

The invention discloses a test system and method for generating capability evaluation based on a large model, and the method comprises the steps: S1, carrying out threat modeling, and generating a test case, including classifying a threat scene and generating an automatic test case, the generation content of the test case including generation of an adversarial sample and generation of a privacy test case; s2, a multi-dimensional test is executed, the multi-dimensional test comprises a dynamic test engine and real-time defense detection, and test indexes of the dynamic test engine comprise a sensitive information leakage rate, a malicious instruction execution rate and a prejudice index; s3, performing vulnerability diagnosis, including analyzing attention weight and tracing privacy leakage; and S4, performing verification and iterative repair, including collecting vulnerability samples, performing mixed training, adjusting a loss function and performing regression testing. Through threat modeling and attack scene classification, various potential attacks can be identified and covered, test comprehensiveness is ensured, neglected potential safety hazards can be found, and test effectiveness is improved.

One or more computer processors identify one or more similar, historical regression tests and historical builds utilizing a computed similarity measure between a regressed build and one or more historical builds conducted on a same release cycle, wherein the identified one or more similar historical regression tests and historical builds are K closest neighbors to the regressed build; predict an elapsed time of the one or more profiled regression tests utilizing a KNN algorithm comprising the K closest neighbors each weighted by a corresponding average distance from a test point and the elapsed time as a target variable; responsive to the predicted elapsed time exceeding an actual elapsed time associated with the regressed build, determine that the regressed build is an actual regression; responsive to determining that the regressed build is not due to variability, apply one or more mitigation actions to the regressed build.

Methods, systems, and non-transitory processor-readable storage media for a test selection system are provided herein. An example method includes selecting a regression test case from a plurality of regression test cases in a software test lifecycle system. A test selection system calculates scores for regression test cases using weights assigned by an Analytical Hierarchical Process (AHP). Using the score, the test selection system visualizes a relationship between the regression test case and a target associated with the regression test job. The test selection system selects regression test cases for use in the regression test work based on the visualized relationship, and executes the regression test cases on the system.

The invention discloses a full-link traffic playback test method and system for a financial system, and the method comprises the steps: forwarding network traffic from a production server to a pre-release environment server, and carrying out the preprocessing, and then generating real-time traffic; performing full-link playback on the real-time traffic in the pre-release environment server, generating a playback result, and feeding back the playback result to the test platform to generate monitoring data; and converting the real-time traffic into historical traffic, performing full-link playback, and generating monitoring data. And according to the response state and the monitoring data of the pre-release server, analyzing the defect of version change to generate a daily test report. According to the invention, full-link closed-loop testing is realized, and a full-service system is covered. All-time testing is supported, request sending is flexibly configured, and continuous flow playback during the market opening period is ensured. Through testing flow classification, the flow is forwarded and stored in real time, the environmental difference is solved through preprocessing, and the defect discovery rate is improved. The problems of insufficient full-link regression test means, incomplete scene coverage and low test efficiency in the prior art are solved.

The invention relates to a system testing method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: in the process of executing each test case of the distributed system, obtaining a call tree and a coverage rate of the test case, obtaining a case weight corresponding to the test case according to the coverage rate, clustering all the test cases according to the call tree to obtain multiple groups of clusters, and sending the multiple groups of clusters to the distributed system; and determining a test priority corresponding to each test case under each group of clusters according to the case weight, and carrying out regression testing on the distributed system based on the test priorities. By adopting the method, the distributed system can be tested more comprehensively and specifically, and the test time and resources are saved, so that the stability and reliability of the system are ensured.

The invention discloses an SDK (Software Development Kit)-based regression test method, device and equipment and a medium. The method comprises the following steps: integrating a data acquisition SDK on an application side; when a network request is received, intercepting the network request and a request response through the data acquisition SDK, and acquiring corresponding request index data from the intercepted content and storing the request index data in the source database; after the source database is replaced by the target database, responding to the regression test instruction, acquiring request index data of an application in a specified test range from the source database, and replaying and checking the request index data in the target database; and generating a corresponding regression test result according to the replay and verification result of the request index data of the application in the specified test range. According to the method, the request index data is automatically collected based on the SDK, the workload of manual operation is reduced, when the database of the application is changed, request replay and verification can be rapidly carried out to complete the regression test, and the efficiency and reliability of the regression test are improved.

The invention provides a UVM-based instruction set acceleration component verification platform construction method, which comprises the following steps: firstly, generating a required instruction signal according to an input signal of an acceleration component by a verification platform, then generating a floating-point number meeting calculation requirements according to requirements, and meanwhile, ensuring the configurability of various parameters which are random and excited in an effective range of operational data; a C-based soft library is called as a reference model for comparison with a hardware output result, so that the verification accuracy is ensured; then collecting and merging coverage rate files obtained by excitation operation through scripts to realize convergence of the coverage rate and ensure the completeness of verification; and finally, when hardware design finds an error and is modified, a verification platform can be called to carry out a regression test, so that the method has relatively high reusability, and the verification efficiency is improved.

The invention relates to an automobile development test management method based on an ALM system, and belongs to the technical field of automobile development management. The method comprises the steps of integration of an ALM system and an automobile development process, automatic collection and analysis of test data based on the ALM, intelligent generation and management of test cases, multi-project collaborative management based on the ALM, automatic regression testing in the ALM system, a real-time collaboration and communication platform based on the ALM, and ALM configuration management adapted to a complex automobile system. And cross-domain problem tracking and management based on ALM. According to the method, through integrating functional modules such as a development process, intelligent test case management, multi-project collaborative management, automatic regression testing and a real-time collaborative platform, full-life-cycle management and optimization of the automobile development project are realized, the development efficiency can be remarkably improved, the error rate is reduced, product marketing is accelerated, and the development cost is reduced. And meanwhile, the product quality and consistency are ensured.

The invention relates to the technical field of software development and testing, and discloses an automatic testing integrated system in a software development process, which comprises a testing management module used for formulating a testing plan, designing a testing case and managing testing execution; the automatic testing module is used for integrating and executing unit testing, function testing, regression testing, performance testing and safety testing; the continuous integration and continuous delivery module is used for automatically constructing, testing and deploying the process; the environment management module is used for configuring, simulating and virtualizing a test environment; and a reporting and analysis module. Various testing tools such as unit testing, function testing, regression testing, performance testing and safety testing are integrated into one system, so that the problems of diversity and integration difficulty of the testing tools are effectively solved. Different types of testing tools are managed and coordinated in a unified mode, the complexity of the testing process and the compatibility problem between the tools are reduced, and the testing efficiency is improved.

The invention relates to a financial credit creation system architecture deployment method, which comprises the following steps: S1, investigating the current situation, and determining the existing system architecture, business process and technology stack of a financial institution; s2, planning and designing, wherein model selection and configuration are carried out around a host platform, a cloud platform, middleware, a database and related key components; s3, development testing, including demand analysis, design, coding and self-testing, a testing stage including unit testing, integration testing, system testing, acceptance testing and regression testing; s4, platform construction; s5, migration implementation; and S6, operation and maintenance operation. Through the systematic deployment method, the problems of high security risk, high maintenance cost, poor autonomous controllability and the like of the existing financial credit and credential system are effectively solved, and efficient, safe, autonomous and controllable technical support is provided for digital transformation of financial institutions.