2889 results about "Test case" patented technology

The present invention discloses a system and method for performing artificial intelligence (AI) safety red-teaming with integrated policy fuzzing and adversarial prompting to systematically identify, characterize, and mitigate unsafe or non-compliant behaviors in AI models. The disclosed invention automates the process of generating, executing, and analyzing adversarial test cases through coordinated functional units comprising a policy fuzzing unit, an adversarial prompting unit, an execution sandbox, a telemetry processing unit, a scoring and triage processor, and a cryptographic provenance processor. The system applies grammar-driven and reinforcement-based fuzzing techniques to vary policy descriptors, model configuration parameters, and instruction hierarchies, while a learned adversarial prompt generator synthesizes contextually coherent adversarial prompts optimized for maximum policy violation likelihood. The generated prompts and policy vectors are executed in an isolated, instrumented sandbox that records input-output interactions, timing characteristics, and intermediate representations.

The invention particularly relates to a unit test case rapid generation method based on an AI large model. According to the unit test case rapid generation method based on the AI large model, structure information is extracted through a static AST, an execution path is tracked through dynamic instrumentation, and code analysis is achieved; an analysis result is converted into cue words through AI, a multi-scene use case is generated through reasoning, and the multi-scene use case is matched with a language framework; counting row / branch / path coverage, identifying gaps and optimizing loop logic; hot spots and paths are displayed through a visual report, IDE one-key repair and manual correction of a feedback model are supported, intelligent retrieval and reuse of historical cases are realized by relying on FAISS, and the generation accuracy is continuously improved. According to the unit test case rapid generation method based on the AI large model, high-coverage-rate test case generation is achieved through the AI large model, the test case generation efficiency is remarkably improved, the test period is shortened, the software quality is improved, the workload of manually compiling and maintaining the test case is reduced, and the development cost is reduced.

The invention discloses a variation test method and device based on an intelligent automation script. The method comprises the following steps: extracting a statement execution sequence and a branch dependency relationship in an original source code by using a context-aware syntax tree, and generating a control flow diagram and a data flow diagram; performing code semantic analysis on the multi-dimensional code features by using a large language model, identifying potential defect types and variation rules, predicting the test efficiency of variants in combination with a deep Q learning model, and generating to-be-processed variants; performing grammar check and equivalence analysis on the to-be-processed variants to obtain effective variants, and testing the effective variants; variation test indexes are calculated, code weak points are positioned, and test blind areas are identified according to survival variants, so that a visual analysis report is generated; and iteratively generating a new test case according to the current survival variant and the visual analysis report, and testing the current survival variant by using the new test case. According to the invention, the variation test efficiency can be improved.

The embodiment of the invention provides a test case generation method and device.The method comprises the steps that a test case generation task is determined, and the test case generation task carries a target document, a task type and a document type of a to-be-generated test case; analyzing the target document according to the document type by using an information extraction agent to generate an analysis result of the target document; generating an intelligent agent by using a test point, and generating an initial test point according to the task type and the analysis result; and generating a first test case corresponding to the test case generation task by using a test case generation agent according to the initial test point and the analysis result. The analysis logic of a qualification test expert is simulated through a plurality of agents, and the efficiency and integrity of test case output are greatly improved.

The invention discloses an integrated verification and test system and method for complex rules of a substation monitoring system, and the system comprises a rule editing module which provides a visual interface to support a user to edit the complex rules containing various types of variables and time sequence constraints; the analysis and verification module is used for performing grammar, variable conflict and business compliance multi-level verification on the rules; the intelligent test case generation module is used for automatically generating test cases covering normal, boundary and abnormal conditions based on the rule tree structure; the simulation test interface module converts the use case into a standard test script, submits the standard test script to a simulation tool for execution, and outputs the standard test script to a monitoring system through protocol conversion; the result analysis module is used for comparing an execution result with an expected result and generating a structured test report; according to the invention, full-process automation of rule verification and testing is realized, the verification efficiency is remarkably improved, and the test requirements of various transformer substation business scenes are met.

The invention discloses an artificial intelligence robot path planning method and system, and the method comprises the steps: 1, carrying out the comprehensive perception of an environment geometric structure, object semantics and dynamic obstacles, eliminating scene differences, and further constructing the topological graph representation of an environment; 2, pre-training a path planning model, designing a scene context encoder, encoding a scene specific rule into a low-dimensional vector, and outputting a scene context code and updated planning model parameters to provide a planning capability adapted to a new scene for the step 3; 3, dynamically adjusting a track according to real-time sensor data by adopting a hierarchical decision-making architecture; step 2, recording success / failure path segments in the new scene, regularly updating a local planning module, regularly feeding back empirical data in the new scene to the step 2, and triggering a conservative obstacle avoidance mode when the confidence coefficient is lower than a threshold value; and 4, constructing a quantitative evaluation system, building an automatic test platform, simulating diversified scenes and dynamic interference, and automatically generating a test case.

The invention discloses a ship mobile energy storage system CAN communication protocol automatic test system and method, and the system comprises a protocol modeling and test configuration module, a simulation node behavior simulation module, a CAN bus interaction and power closed loop module, and a test analysis and result evaluation module. A CAN communication protocol specification of the ship mobile energy storage system and parameters of tested equipment can be obtained, a protocol analysis model and a test configuration file are constructed for format verification and logic consistency verification, meanwhile, a corresponding test case sequence is automatically generated, and the message sending time is controlled to generate a time sequence simulation message flow; and sending the time sequence simulation message flow to the tested equipment, simulating energy interaction behavior acquisition to generate a power feedback data set, testing to obtain a signal consistency deviation and a power execution error to construct a protocol conformity evaluation matrix, and generating a visual test report. According to the invention, the high coverage rate and automatic closed-loop test of the CAN communication protocol can be realized.

The invention relates to a test case generation method and system based on multi-agent efficient collaboration, belongs to the technical field of software testing, and solves the problems of incomplete scene coverage, logic disorder and the like when a single large model processes a complex task. The method comprises the following steps: constructing a multi-modal professional field knowledge base; the task planning agent module generates a test case generation task based on a project development document and a software source code file of a to-be-tested project and distributes the test case generation task to the test demand analysis agent module; based on the test case generation task, extracting a test demand point related to the tested software configuration item, describing the test demand point, and labeling a corresponding tracking relationship between a test demand point ID and a code snippet or a function in the software source code file to construct a test demand-code snippet / function set; and generating a test case and a test description document based on the test demand-code snippet / function set and the multi-modal professional domain knowledge base. And the ability of generating the test case of the large model is enhanced through organic and efficient cooperation of multiple agents.

The invention discloses an intelligent agent network access evaluation method and system based on automatic label generation and multi-dimensional evaluation, and the method comprises the steps: automatically generating an intelligent agent multi-dimensional label through a large-scale language model, constructing an intelligent agent portrait, and combining automatic test case generation and multi-dimensional evaluation index collection. The problems that in the prior art, agent evaluation standardization is lacked, evaluation efficiency is low, and'black box 'diagnosis is difficult are solved, standardized and automatic quality evaluation is carried out on various heterogeneous agents connected to a platform, and an agent portrait capable of being used for accurate retrieval and scheduling is generated. The method and the system can be widely applied to scenes such as a multi-agent collaboration platform, an agent store and an enterprise-level agent management system, and have the remarkable advantages of remarkably improving the ecological quality of the agent, greatly reducing the manual evaluation cost, accelerating the introduction and commercialization of a new agent and the like.

The invention relates to the technical field of SRAM (Static Random Access Memory) memory anti-radiation testing, and discloses an SRAM memory anti-radiation testing method and system based on running state injection, and the method comprises the following steps: system initialization, mapping preparation and time sequence baseline establishment; carrying out model quantitative compiling, sensitivity analysis and physical bit candidate generation; generating a running state injection plan and loading a test case; performing operation state execution, disturbance injection and synchronous monitoring acquisition; multi-source triggering, weight read-back and fault decoupling judgment are carried out; and performing quantitative evaluation on anti-radiation performance, constructing a degradation curve and outputting a report. The system corresponds to the method. According to the invention, a hardware-in-the-loop operation state injection and online evaluation technology is constructed, and the technical problems of guidance and position limited disturbance / equivalent irradiation injection based on weight bit level sensitivity and logic-physical mapping are solved.

The present application discloses a test code repairing method applied to a code development platform. The method comprises: obtaining a test code corresponding to a source code, and then executing the test code to obtain execution information of the test code, wherein the execution information comprises abnormal stack tracking information output during execution of the test code; on the basis of the execution information, performing fault localization on the test code to obtain location information of a faulty code; on the basis of the location information of the faulty code, extracting context information, wherein the context information comprises at least one of a faulty test case, a fault description, or the faulty content; and inputting a prompt constructed on the basis of the context information into a language model and performing inference, so as to obtain a first repaired code. The method is used to perform fault localization in light of the execution information, extract the context information on the basis of the location information of the faulty code, and, on the basis of the context information, generate accurate and complex repaired code via an advanced language model, thereby adapting to various complex fault scenarios and improving repair efficiency and accuracy.

The invention discloses a graphical user interface test case generation method based on a multi-agent framework, and relates to the field of graphical user interface tests.The graphical user interface test case generation method based on the multi-agent framework comprises the following steps that S1, a user demand document is obtained, and file text content and file format information are analyzed and extracted; s2, performing paragraph segmentation on the file text content to form logic semantic units; s3, carrying out correlation analysis on the segmented paragraphs, and obtaining a ternary file group; s4, performing paragraph annotation addition on the ternary file group, and constructing a semantic annotation result set; s5, extracting the agent framework to generate a graphical user interface test case, performing test recording, and storing a test result; s6, the result is verified, and a test case list and a software test report are generated. By conducting multi-dimensional analysis on the text content and the format structure in the document, the reduction efficiency from natural language description to structural semantic construction is improved.

The invention relates to a test case generation method and system based on an industrial agent. The method comprises the steps that an industrial data set is acquired, and a system dependency model is constructed; generating a path coverage test sequence through the first agent; generating a boundary value test data set through the second agent; generating abnormal test scene information through a third agent; and generating a test case set based on the path coverage test sequence, the boundary value test data set and the abnormal test scene information. In conclusion, by constructing the system dependency model and utilizing the multi-agent collaborative analysis process logic path, boundary condition and dependency relationship, the multi-surface coverage of the industrial control system test scene is realized, the automation of the test case generation is realized, the effects of improving the generation efficiency and enhancing the comprehensiveness of the test coverage are achieved, and the method is suitable for industrial control system test. Especially for the coverage of boundary conditions, abnormal scenes and concurrent paths, the manual dependence is reduced, and the reliability and consistency of the test are improved.

The invention relates to artificial intelligence generation content AIGC, in particular to an AIGC test case self-adaptive generation system based on risk feedback, which comprises a semantic variation generation module for selecting a variation operator from a variation operator library according to a self-adaptive strategy, performing variation processing on a seed case provided by a basic test case library by using the variation operator, and generating a semantic variation result; generating a new test case; the AIGC model takes the test case as model input and performs model output to the risk assessment and quantification module through an AIGC model interface; the risk assessment and quantification module is used for performing multi-dimensional risk assessment on a model output result by utilizing the risk detection model library, calculating a risk level and generating a test report; the risk feedback processing module is used for storing the high-risk test case, performing feature extraction and converting a risk assessment result into an operable risk feedback signal according to extracted features; according to the technical scheme provided by the invention, the defects of low efficiency and difficulty in automatically adapting to environment change can be overcome.

The invention relates to the technical field of wind power, in particular to a dynamic response test method for a wind power variable pitch system. Comprising the steps of building a high-fidelity digital twinborn model, performing virtual testing and case optimization, performing physical self-adaptive testing execution, performing real-time analysis and decision-making driven by machine learning, dynamically adjusting testing stress, performing data feedback and model calibration and generating a comprehensive health report. Compared with the prior art which mainly depends on a fixed physical test process and artificial experience judgment and has the defects of low test efficiency, large resource consumption and difficulty in comprehensively covering extreme working conditions, the method innovatively introduces a high-fidelity digital twinning technology and a virtual test optimization process; according to the method, massive tests are executed in the virtual environment in a risk-free manner, and the enhanced test cases are intelligently generated, so that test forward movement and accurate optimization are realized, the pertinence and efficiency of physical tests are remarkably improved, and the test cost and period are greatly reduced.

The invention discloses a Web automatic testing method, system and device, a medium and a program product, and belongs to the technical field of artificial intelligence. The method comprises the steps that test case abstract representation information is generated according to interactive input of a user and a test case mapping template, and the test case abstract representation information comprises a target test task type indicated by the interactive input and intention natural language description information; based on the test case abstract representation information, obtaining a target screenshot of the tested Web page and attribute information of interaction elements; a multi-mode large language model is called to conduct reasoning based on the target screenshot, the attribute information of the interaction elements and the intention natural language description information, reasoning result information is output, and the reasoning result information represents operation executed on the target interaction elements located at the target position in the tested Web page; and converting the reasoning result information into a machine executable instruction, and executing the machine executable instruction. According to the embodiment of the invention, the stability of Web automatic testing can be improved.

The invention discloses a full-process automatic unit testing method, device and equipment for an AI chip operator, a medium and a product. The method comprises the following steps: generating an engineering directory and a test framework design document through an architect agent according to operator interface information and a DSL operator design document knowledge base; the method comprises the following steps of: generating a test code for unit test by a software engineer agent according to a test framework design document and a domain knowledge base, and storing the test code in an engineering directory; multiple rounds of interaction are carried out through a software engineer agent and a test engineer agent, a test code is gradually corrected into a target test code which can be successfully compiled, a generated test case can be successfully executed and the generated test case meets the code coverage rate requirement, and a target operator code passing a unit test is obtained; and submitting the target operator code and the target test code which pass the normativity check to a code warehouse through a code auditing engineer agent so as to automatically realize the whole-process unit test of the AI chip operator.

The invention provides a business rule automatic processing method and system based on natural language understanding. The method comprises the following steps: extracting text content from an original document containing business rules and preprocessing the text content; utilizing a BERT-based metadata extraction model to extract structured metadata from the preprocessed text content; confirming and perfecting the structured metadata; on the basis of the confirmed metadata, a rule execution flow chart and / or a test case are / is automatically generated and used for verifying the correctness of rule logic; and according to the target format, converting the verified rule into a corresponding symbolic representation through a template engine to obtain a defined rule. According to the invention, the automatic conversion of the business rule from the natural language description to the symbolized executable form is realized, so that business personnel can directly use the natural language to define and maintain the business rule, the manual conversion cost is reduced, and the accuracy and efficiency of rule processing are improved.

The invention discloses a code generation and restoration method and device based on multi-round feedback of a large language model, and the method comprises the following steps: 1, converting problem description into a structured tetrad (target, input, output and constraint) through a two-stage task demand deconstruction mechanism, and generating a pseudo-code frame according to the structured tetrad; 2, generating a plurality of candidate code schemes in parallel based on different implementation strategies; 3, selecting an optimal code implementation scheme through multi-dimensional evaluation; 4, generating an extended test case through boundary condition analysis and public test reasoning, and expanding a verification range; 5, classifying error types in combination with static analysis and dynamic execution information, and applying a special repair strategy; 6, providing detailed repair reasons and ideas by an interpretable repair mechanism; and 7, establishing a multi-round feedback repair verification iteration mechanism composed of testing, analysis, repair and verification. According to the method, the performance of an existing large language model in processing a complex programming task is effectively improved.

The embodiment of the invention provides a test case sample cutting method, device and system and a storage medium, and relates to the technical field of network security testing. The method comprises the following steps: constructing an industrial control system attack tactical library; wherein the tactical library comprises classified and arranged attack techniques and corresponding security attributes; performing information analysis and semantic analysis on the test case sample to generate structured data of the test case sample and / or function points in the test case sample; and cutting the test case sample according to the security attribute and / or the structured data and / or the function point to obtain a test fragment corresponding to the security attribute and / or the function point. According to the method, classification-based attack techniques and security attributes are cut by constructing a tactical library, key information can be accurately extracted and test intentions can be understood through information analysis and semantic analysis, redundant tests are avoided, cut test fragments can concentrate on specific security attributes or function points, the test coverage range is more accurate, and the test efficiency is improved. And the distributed security test effect is improved.

The invention discloses a method and device for automatically generating a Java method unit test case based on AI, and the method comprises the steps: building a structured annotation specification, carrying out the automatic traversal and intelligent analysis of a Java project, extracting a method signature, a parameter type and a parameter constraint condition, constructing a test data generation model, and carrying out the automatic generation of the test case. The model is transmitted to an AI service to analyze business logic and boundary conditions, test case codes are generated, test cases are optimized and integrated to a project test directory, finally, code areas with insufficient coverage are identified through coverage rate analysis, a test completion strategy is generated, and iterative perfection of the test cases is completed. The technical problems that in the prior art, project-level automatic test case generation cannot be achieved, the generated test case cannot fully cover business logic and boundary conditions, and context relation understanding is lacked are solved, full-automatic project-level test generation is achieved, and the test efficiency and quality are improved.

The invention provides an intelligent automobile test case automatic generation and evaluation system, device and product, and relates to the technical field of intelligent automobile test.According to the system, domain knowledge support is provided through a test knowledge base, and a demand understanding module is combined with a fine-tuning large model to deeply analyze demands; function points are extracted, and hidden scenes such as sensor faults and multi-system cooperation are identified; the test case generation module is based on a special prompt template and few-sample learning, a complete case containing elements such as purposes, steps and data is generated by fusing a vehicle model configuration library, and the specialty and the performability are ensured; and the evaluation module realizes objective quality evaluation through multi-dimensional quantitative scoring of demand coverage rate, scene integrity, risk coverage degree, normalization and the like. All the modules cooperate to realize intelligent generation and system evaluation of test cases, and the automation level, coverage range and reliability of intelligent automobile testing are improved.

The invention belongs to the technical field of software development and testing, and discloses an artificial intelligence-based software development automatic test case generation system, which is characterized in that an immune heuristic case self-repairing module is adopted, defects are regarded as antigens, antibody cases capable of being self-updated are generated by using a clone selection algorithm, and a gene rearrangement mechanism is automatically triggered when an interface is changed, so that the test efficiency is improved. The details of the use case are adjusted while the core detection logic is reserved; compared with a traditional method, the mechanism can realize use case dynamic adaptation without manual intervention, the maintenance workload is remarkably reduced, and the method is particularly suitable for a complex software system with frequent iteration; the space-time coupling test scene generation engine fuses dynamic scenes such as interaction and state transition of a module and short-time operation after precise coverage login by using a space-time convolutional network; the cross-dimension holographic use case synthesis module integrates multi-source data such as codes, hardware and user behaviors through tensor decomposition to generate a composite use case; functions and performance of software in a complex scene can be comprehensively verified, and test blind areas are remarkably reduced.

The invention discloses an aviation airborne software test case intelligent generation and closed-loop optimization method, which comprises the following steps of: knowledge graph construction: analyzing a DO-178C standard document and a related field document, extracting entities and relationships defined in the DO-178C standard document and the related field document, and constructing a field knowledge graph fused with DO-178C standard knowledge; initial test case generation: based on the domain knowledge graph, combining a static analysis result of the source code of the tested airborne software, and utilizing a large language model to drive and generate an initial test case set; and closed-loop iterative optimization: executing the test case, evaluating whether the structural coverage rate reaches the standard or not, automatically identifying uncovered codes when the structural coverage rate does not reach the standard, generating a supplementary test case for iterative optimization, and outputting a final test case set until a coverage rate target corresponding to the software security level is met. According to the method, the test quality and efficiency of the aviation airborne software can be improved.

The invention discloses a research and development test bidirectional synchronization method based on artificial intelligence, and particularly relates to the technical field of artificial intelligence and software testing. Deep semantic modeling of research and development task behaviors is realized by constructing a multi-modal causal intention map, a test coverage blind area is inferred and recognized based on a graph neural network, a completion task is reversely generated, a complete state set is formed in combination with an original task set, and a condition control vector is adopted to drive generation of a structured test case. Collecting behavior and operation logs after the test is executed, detecting a mismatch area through modal alignment, generating a repair suggestion by utilizing a deviation correction model, and automatically writing back a task system; meanwhile, a state graph dynamic updating mechanism and a reverse task scheduling engine are introduced, and linkage feedback of test results on research and development tasks is achieved; the method can improve test coverage precision and research and development cooperation efficiency, and is suitable for agile development and continuous integration scenes.

The invention provides a test case library construction method and system based on a large model, and relates to the technical field of intelligent automobile tests.The method comprises the steps that semantic analysis of a tested function document is separated from test scene recognition, and an initial test case is generated in combination with a rule-guided large language model; systematization, intellectualization and standardization of a test case library construction process are realized; formats and content specifications output by the large model are effectively restrained through preset professional rules, and the professionality and structural consistency of the generated use cases are guaranteed; meanwhile, problems are found and fed back in time through a multi-dimensional verification and quality evaluation mechanism, self-adaptive optimization of a construction strategy is driven, and the quality and generation efficiency of the test cases are improved; finally, qualified cases are integrated into standardized records, a high-quality test case library with both manageability and technicality is formed, and efficient and automatic conversion from unstructured documents to reusable and maintainable test assets is achieved on the whole.

The invention relates to the technical field of chip testing, and discloses a clock reset system-level verification method and device based on general verification methodology, and the method comprises the steps: firstly analyzing a clock topological relation defined in a system control unit architecture document, and generating a clock reset information table; on the basis of the information table, an executable verification environment component and a virtual interface component are automatically generated through a script, the verification environment component comprises an excitation forwarding and processing component and can generate clock and reset signals matched with framework definition, and the virtual interface component can generate actual clock and reset waveforms; and finally, constructing a verification platform based on the components, calling the excitation sequence in the parameterized test sequence library, and carrying out system-level clock reset verification on the digital chip. And meanwhile, the parameterized test sequence library supports flexible adjustment of a verification scene and ensures that a test case fits a clock frequency defined by an architecture document, and a reset mechanism can improve the efficiency, accuracy and reliability of digital chip clock reset system-level verification.

The invention provides a communication protocol consistency test method and system. Key function points are extracted by analyzing a target protocol document; based on the key function points, a predefined first prompt template is applied to generate a test case prompt, a large language model is guided to generate a standardized test case corresponding to each key function point, and the first prompt template comprises k few-sample examples; dynamically retrieving a related code context from a pre-constructed long-term memory library through a retrieval enhancement generation mechanism, generating a code generation prompt by applying a predefined second prompt template based on the standardized test case and the related code context, and generating an executable test code based on the code generation prompt; and performing iterative optimization on the executable test code through the large language model, and generating a new code generation prompt based on a code execution result of the previous iteration and the retrieved related code context in each iteration. The test case can be automatically generated and dynamically adapted, and the test coverage rate, efficiency and flexibility are improved.

The invention relates to a test case generation method based on a multi-modal knowledge base and self-adaptive cue words, belongs to the technical field of software testing, and solves the problems of insufficient reuse of historical project data and expert knowledge, lack of knowledge in a large model professional field, prominent illusion problem, low adoption rate of generated test cases, low practicability and the like. The method comprises the steps of generating an original test demand set of a to-be-tested item; forming a test demand-code snippet / function set based on the software source code file and the original test demand set; generating a first-stage test tree graph based on each test demand point and the corresponding code snippet / function; forming a software test outline based on the test items, the test subitems and the corresponding test demand points and code snippets / functions; forming a second-stage test tree graph based on the first-stage test tree graph and the software test outline; and generating a test case based on the second-stage test tree graph and the software test outline. And the specialty, the accuracy and the interpretability of the test case are enhanced.

The invention relates to the field of task queue scheduling of automobile chips, in particular to a test case dynamic priority scheduling method for automobile electronic chips. Comprising the following steps: analyzing standard test data of the automobile electronic chip, and organizing a structured data set associated with the physical layout of the chip; identifying failure clusters and noise points on the structured data set by using a data clustering algorithm; extracting geometric and position features of the failure cluster, classifying the failure cluster into a known failure mode by using a classifier, performing correlation analysis on the failure mode, an upstream key process step and an equipment log, and establishing a causal relationship; calculating a function security risk score for each chip; and when the function security risk score is higher than a preset risk threshold value, generating and executing a dynamic task rearrangement instruction, and dynamically improving the execution priority of the test case. According to the method, the priority is dynamically selected according to the function security risk score through the dynamic task rearrangement instruction, so that the test time is saved, and the coverage depth and quality of the test are improved.