37 results about "Scenario testing" patented technology

The invention provides an intelligent automobile test case automatic generation and evaluation system, device and product, and relates to the technical field of intelligent automobile test.According to the system, domain knowledge support is provided through a test knowledge base, and a demand understanding module is combined with a fine-tuning large model to deeply analyze demands; function points are extracted, and hidden scenes such as sensor faults and multi-system cooperation are identified; the test case generation module is based on a special prompt template and few-sample learning, a complete case containing elements such as purposes, steps and data is generated by fusing a vehicle model configuration library, and the specialty and the performability are ensured; and the evaluation module realizes objective quality evaluation through multi-dimensional quantitative scoring of demand coverage rate, scene integrity, risk coverage degree, normalization and the like. All the modules cooperate to realize intelligent generation and system evaluation of test cases, and the automation level, coverage range and reliability of intelligent automobile testing are improved.

The invention relates to the technical field of software engineering and automatic testing, in particular to an E2E scene test optimization method and system based on target man-machine cooperation. According to the scheme, an optimization target is manually set, an initial test case and a business process are input, and a test resource library is constructed; the system automatically analyzes a service path, generates a use case dependency graph and a key path, and determines a core scene through manual verification; a candidate optimization strategy is generated by the system, and a target strategy is determined through manual screening according to resources and priorities; the system carries out simplification, merging and scheduling optimization on the use cases, and deploys and executes the use cases after manual sampling verification of coverage; the system collects execution data in real time and generates an evaluation report, and whether a use case is supplemented or a strategy is adjusted is determined after manual analysis; and finally updating the resource library and the strategy model, establishing a dynamic feedback mechanism, and triggering continuous optimization during system iteration. According to the method, the E2E test efficiency and the software delivery quality are remarkably improved through man-machine cooperation and closed-loop optimization.

The invention discloses an uninterruptible power supply full-scene test method based on multi-mode simulation, and aims to solve the problems of single test scene, deficiency of composite working conditions, poor collaboration and the like in the prior art. The method comprises the following steps: firstly, constructing a test scene model library containing a multi-mode power grid, a load and an environment simulation model; combining specifications of the UPS to be tested and a test target, selecting a model combination to generate a composite test scene, and defining a rule that parameters change along with time; then, a test platform containing a programmable simulator and a central control unit is built, and the UPS to be tested is connected; the central control unit drives the platform to carry out collaborative testing, and input, output and internal key parameters are collected in real time; and finally, quantitative indexes such as output voltage stabilization precision and THD are calculated to complete evaluation. According to the invention, multi-factor coupling scene simulation is realized, the test authenticity and precision are improved, the period is shortened, and support is provided for UPS research and development optimization and quality detection.

This invention discloses a hardware-in-the-loop automated testing method and system for inverters in smart grids, relating to the field of inverter-specific performance testing technology. The method includes: constructing a grid degradation evolution topology by calling a grid anomaly scenario library; extracting multiple evolution paths and injecting them into a grid simulator; driving inverter testing and collecting response timing records; outputting multi-dimensional defect scores through multi-dimensional defect quantification analysis; constructing a multi-modal quality heatmap; extracting indicator attributes and comparing them against preset safety thresholds; and generating a quality defect vector. This invention solves the technical problems of traditional inverter testing, such as single-scenario testing, static testing not reflecting reality, and one-sided defect evaluation. It achieves accurate quantification of multi-dimensional defects, making inverter test results more comprehensive and reliable, and meeting the technical requirements of smart grids for equipment quality assessment and control.

The application belongs to the technical field of software testing, and provides a vehicle electronic controller scene test method, a system, a storage medium and equipment, the method comprises the following steps: recording the message generated by the whole vehicle under a predetermined scene, and establishing a scene message library; writing and decomposing a scene test case; based on the scene message library, message reconstruction is carried out, and the reconstructed message is obtained; based on the reconstructed message, combined with external equipment, a timing logic is constructed, and scene testing is carried out. The vehicle electronic controller scene test method of the application records the message information of the real scene, and analyzes and normalizes the message information, so that the network signal is completely the same as the real scene, and the simulation of non-signal information is realized by combining with the peripheral equipment, and the high simulation of the scene is realized through effective timing control.

The invention discloses an acquisition terminal test case priority ranking method based on a fuzzy analytic hierarchy process, which comprises the following steps of: applying the fuzzy analytic hierarchy process to the field of acquisition terminal test, and quantizing fuzzy evaluation opinions of experts by triangular fuzzy through constructing a'target-criterion-scheme 'hierarchical structure; fusing a multi-expert judgment matrix by adopting a weighted geometric averaging method, and optimizing a criterion weight and performing defuzzification in combination with consistency check; and comprehensive priority scores of the test cases are calculated through weighted summation, a sorting sequence from high to low is generated, and meanwhile, dynamic adjustment during demand change is supported. According to the method, the fuzzy demand quantification accuracy can be improved by 60%, the expert dispute rate is reduced to 8% or below, the regression test error detection efficiency is improved by 40%, and the method adapts to the multi-scene test demand of the acquisition terminal.

This application discloses a method, apparatus, device, and medium for determining simulation scenarios, relating to the field of autonomous driving technology. The method for determining simulation scenarios includes: acquiring at least one initial scenario corresponding to a target vehicle; performing scenario testing on each initial scenario to obtain test boundary indicators for each initial scenario; using the test boundary indicators as fitness, employing genetic operators of a genetic algorithm to select, crossover, and / or mutate the scenario parameters of the initial scenarios to obtain at least one optimized scenario; updating the initial scenarios to optimized scenarios, and returning to perform scenario testing on each initial scenario to obtain test boundary indicators for each initial scenario, until a preset stopping condition is reached to obtain at least one candidate scenario; and identifying candidate scenarios with fitness greater than a preset threshold as target simulation scenarios that meet performance boundary testing requirements.

This utility model provides a modular, multi-scenario testing device for an insulating rope ladder. The device includes a base with a cover plate that closes to form a storage cavity. Two sets of support cylinders are mounted on either side of the base, installed upside down, with support feet attached to their shaft ends. Two sets of tripods are mounted on the cover plate, with a rotating shaft connecting them. Modular components are mounted on the rotating shaft, each including a mounting block. Two mounting plates are mounted on the rotating shaft, with the mounting block positioned between the mounting plates. Two sets of slide rails are also provided on the cover plate, with support components mounted on them. This device allows for flexible height adjustment via the support components to adapt to different scenarios. The modular components enable rapid assembly, improving test preparation efficiency and reducing preparation time.

This application belongs to the field of intelligent driving and relates to a method and related equipment for generating extreme test cases for automatic parking in parking lots. It solves the technical problems in the existing technology of generating extreme test cases for automatic parking in parking lots, such as parameter combination explosion leading to waste of computing resources and low efficiency, insufficient accuracy of risk quantification making it difficult to guarantee the extremeness of test cases, lack of reasonable timing logic leading to low reference value of test results, and unclear screening criteria making it impossible to accurately obtain key test cases. It can efficiently generate test cases that are extreme, have reasonable timing, and can effectively trigger the system's extreme response, thereby improving the effectiveness and safety verification level of extreme scenario testing of automatic parking systems.

The invention provides a test system and method for inter-system data file transmission, the test system for inter-system data file transmission comprises a test item configuration module, a test plan configuration module and a test execution module, the test item configuration module is used for creating a test item corresponding to each system, and the test plan configuration module is used for configuring the test item corresponding to each system; the test items are isolated from one another; wherein when a test item is created, test environment information is input; the test plan configuration module is used for creating a test plan in a test project and configuring a test scene and a test case corresponding to the test plan; wherein the test scene comprises a data unloading and / or data fetching scene; and the test execution module is used for calling a test case corresponding to the test plan based on the test environment information to carry out unloading and / or access scene test. According to the testing system and method for data file transmission between the systems, the testing efficiency is improved.

The invention discloses a scene testing method and device based on fault injection and electronic equipment. The method comprises the steps that a first safety boundary scene and a second safety boundary scene are acquired; generating a to-be-injected fault, an agent model and an acquisition function, and initializing a fault space; inputting the first security boundary scene and the to-be-injected faults into the agent model, and determining a first key fault in the to-be-injected faults based on the acquisition function; training a dual-channel classifier based on the first safety boundary scene and the first key fault to obtain a trained dual-channel classifier; and performing key fault prediction on the second safety boundary scene and the fault space based on the trained dual-channel classifier to obtain a prediction result. The first key fault is screened out through the proxy model and the acquisition function, the first safety boundary scene and the first key fault are taken as samples, the dual-channel classifier is trained, the second key fault of the second safety boundary scene is quickly predicted, the key fault of the new scene is efficiently identified, and the efficiency is effectively improved.

This invention discloses a method for rapidly generating digital scenarios for data-real fusion testing, belonging to the field of digital testing and verification of high-end equipment. The method includes setting overall testing objectives, the functions and performance indicators of the object to be tested; preparing various basic unit scenario data required for realizing digital test scenarios in data-real fusion testing based on the testing objectives and the characteristics of the object to be tested, combined with the object testing process; when the data is insufficient to meet the requirements for generating high-precision scenario models, data augmentation operations are required; using datasets and two-dimensional diffusion models, a unit scenario generation model based on deep learning is constructed; based on the generated unit scenarios, a multi-element database of test scenarios and a set of test rule constraints are constructed; a comprehensive scenario test model is rapidly generated using deep reinforcement learning, and the complexity and coverage of the generated comprehensive test scenarios are evaluated and verified to meet the requirements of the overall testing objectives.

This disclosure provides a method, apparatus, device, storage medium, and program product for predicting the performance of an application, relating to the application of artificial intelligence technology in the vehicle field. The method includes: acquiring historical driving data of a historical version of a target application that has been enabled; constructing a scenario test set based on the historical driving data; using the target application for active safety functions of the vehicle; running the test version of the target application in a simulation environment based on the scenario test set to obtain test results; and inputting the test results into a preset performance prediction model to determine the performance prediction indicators of the test version under actual operating conditions. This method can acquire historical driving data to construct a scenario test set, test the test version in a simulation environment based on the scenario test set, and then input the test results into a preset performance prediction model, thereby efficiently and accurately predicting the performance of the test version in actual road environments, providing reliable data support for version optimization and deployment decisions.

A testing method and apparatus of a driving control system, a medium, and a device. According to the method, a state transition diagram is input, and then the test coverage of each state transition in the state transition diagram is gradually implemented on the basis of the state transition diagram and by loop iterative variation of a scenario sample. When the loop iterative variation is performed, a simulation output of the scenario sample is used as a reference, so that the iteration process can quickly converge to the corresponding state transition to achieve the goal of coverage testing. The testing method and apparatus can intuitively test the processing capability and level of the driving control system for a driving environment, and exhibits high test efficiency.

This invention discloses a device testing method, apparatus, electronic device, and storage medium. The invention can acquire device status information; retrieve puncture simulation scenarios from a puncture library based on the device status information; simulate punctures according to the puncture simulation scenarios to perform puncture scenario testing on the device; and inspect the device that has completed the puncture scenario testing to obtain the test results of the device's online capability. This invention automates device testing, accurately completing various puncture scenario simulation tests. While ensuring sufficiently large and refined test coverage, it improves testing efficiency. Furthermore, when device failure occurs later, the device testing method of this invention can locate the corresponding fault point based on the corresponding puncture simulation scenario. This invention not only achieves automated testing, reducing labor costs, but also improves testing efficiency and reduces repair costs after device failure.

A computer-implemented method for testing a risk model trained to output a risk determination for open banking transactions that includes: unit testing the risk model implemented in an application programming interface (API) platform; performing manual and automated feature validation of the risk model by comparing feature outputs from the risk model to expected feature output values; performing functional validation of the risk model according to an accuracy metric; benchmark testing the risk model, implemented in the API platform, using simulated scenario test data sets; load testing the risk model; after performing the foregoing, deploying the risk model as a production risk model with a web portal in a production environment; and dog-food testing the production risk model using a plurality of simulated scenario test data sets configured to simulate real production usage.

This invention discloses a method and system for mining processor side-channel attacks based on a performance monitoring unit. The performance monitoring unit records processor behavior at a fine-grained level, uncovering more processor details. It is found that the performance monitoring unit can not only record the impact of normally submitted instructions on the processor using events, but also, for some events, the impact of transient instructions on the processor's microarchitecture behavior, thus expanding the applicability of the performance monitoring unit. Furthermore, methods for mining cache side-channel attacks and transient side-channel attacks are proposed. These two methods treat the processor as a black box, automatically completing the processes of generating test cases, scenario testing, and data analysis, achieving the effect of automatically mining processor side-channel attacks.

The invention relates to the technical field of software testing, and discloses a method and a system for testing compatibility of application self-protection during Java operation. The method comprises the following steps: based on an API (Application Program Interface) of a virtualization management platform ESXI, creating an initial system snapshot for each to-be-tested Linux operating system; a limit test strategy matched with the current operating system to be tested and a corresponding limit environment construction script are pulled from the test management Server; calling an API (Application Program Interface) of the ESXI, and restoring the current test environment to an initial system snapshot state; executing limit scene construction according to the pulled limit environment construction script; based on the limit test strategy and the limit scene, executing the application self-protection test case during Java operation; and determining that all target limit scene tests under the current operating system are completed, switching to the next to-be-tested Linux operating system, and starting execution from calling the API of the ESXI until the tests are completed.

A computer-implemented method for testing a risk model trained to output a risk determination for open banking transactions that includes: unit testing the risk model implemented in an application programming interface (API) platform; performing manual and automated feature validation of the risk model by comparing feature outputs from the risk model to expected feature output values; performing functional validation of the risk model according to an accuracy metric; benchmark testing the risk model, implemented in the API platform, using simulated scenario test data sets; load testing the risk model; after performing the foregoing, deploying the risk model as a production risk model with a web portal in a production environment; and dog-food testing the production risk model using a plurality of simulated scenario test data sets configured to simulate real production usage.

This invention discloses a simulation scenario testing method, apparatus, device, and storage medium. The method includes: during the simulation testing of a target test vehicle in its current mock test scenario, determining the next mock test scenario for the target test vehicle based on a test scenario switching instruction; loading the target mock scenario model of the next mock test scenario; and performing simulation testing on the target test vehicle based on the target mock scenario model to obtain target simulation scenario test data. This invention solves the problem of insufficient simulation testing efficiency caused by the inability to switch simulation test scenarios in real time during the simulation testing of the current scenario. It allows for real-time switching of simulation test scenarios during the simulation testing of the current scenario, improving simulation testing efficiency.

The invention belongs to the technical field of software testing, and discloses an airport operation index comparison testing method and system based on a large language model. The method comprises the following steps: constructing a standard case set in a standard case set construction module on the basis of collected operation index data; preliminary checking of the automatic inquiry test condition is completed; inquiry result acquisition is completed in a result acquisition module; inputting the inquiry result in the result acquisition module and the case set standard result in the standard case set construction module into a result comparison script for comparison; and a visual test report is automatically generated. According to the method, the time consumed by batch scene testing is shortened from the manual hour level to the minute level, automatic execution of daily average ten thousand level inquiry cases is supported, the test comprehensiveness is improved, numerical and text type indexes are covered, numerical error calculation and semantic similarity analysis are combined, the deviation between LLM output and a standard result is quantified, and accurate comparison is achieved.

This application provides a method and apparatus for testing the communication reliability of a TBOX (Telematics Toy Box), relating to the field of vehicle testing. The method includes: determining multiple target areas within a preset area range, and generating at least one test scenario based on the multiple target areas; obtaining the total number of tests corresponding to each of the at least one test scenario; performing multiple communication reliability tests on the TBOX in each test scenario, recording the current number of tests at each test, and including the failure in the total number of failures when the test results indicate a TBOX failure; and ending the test in each test scenario when the current number of tests in each test scenario reaches the corresponding total number of tests. This application can generate all scenarios covering the testing needs, providing more comprehensive and targeted testing, shortening the testing mileage and time, and reducing testing costs. Furthermore, the total number of tests obtained after the TBOX version update is the minimum number of tests, and testing is performed based on this minimum number of tests, further reducing testing costs.

This invention belongs to the field of autonomous driving testing technology, specifically a method for accelerating regression testing of autonomous driving systems based on dynamic compression of a scenario library. It includes: constructing a structured representation of the autonomous driving scenario library and extracting version difference information; constructing a scenario testing benefit prediction model, comprehensively evaluating scenario benefits based on failure history, risk level, version sensitivity, and coverage scarcity; constructing a scenario redundancy and testing cost model, quantifying similarity and resource consumption; dynamically compressing the scenario library under testing resource constraints, aiming to maximize benefits, minimize redundancy, and limit costs, and selecting a subset for regression testing; executing subset testing and updating the benefit prediction model; evaluating the compression effect based on compression ratio, coverage retention rate, failure detection efficiency, and acceleration efficiency, and dynamically adjusting the next round of testing strategy. This invention can effectively compress the scale of the scenario library, retain key test scenarios, and improve regression testing efficiency and resource utilization efficiency.

The present application relates to the technical field of Internet of Vehicles communication test, in particular to a C-V2X application scene test method based on virtual delivery, comprising: acquiring virtual traffic participant types, dynamic behavior trajectories, position information and signal lamp state time sequence input by a test configuration interface, completing space-time logic verification and consistency arrangement through an improved scene arrangement algorithm, and generating a virtual traffic scene description file containing complete space-time information. The file is parsed into a roadside unit broadcast message sequence conforming to the C-V2X protocol and is delivered to a real roadside unit, the roadside unit broadcasts virtual scene messages according to the time sequence to build a wireless virtual test environment, and a to-be-tested vehicle terminal is monitored and its response behavior data is captured. The scheme optimizes the space-time rationality of the scene, builds a test environment relying on real roadside hardware, and improves the authenticity and reliability of C-V2X scene test.

Embodiments of the present application provide a terminal voice quality evaluation system and method. The system comprises a test module, a base station simulator, a virtual terminal and a MOS device. A test script runs on the test module. The test script is used to instruct the base station simulator, the virtual terminal, the MOS device and a terminal to be tested to execute a terminal voice quality test procedure. The base station simulator is used to simulate a base station function when receiving a control instruction sent by the test script. The MOS device is used to transmit a voice file between the virtual terminal and the terminal to be tested. The virtual terminal is used to test the voice quality of the terminal to be tested through the base station simulator and the MOS device based on the control instruction sent by the test script, and generate a voice quality test result based on the voice file. Embodiments of the present application can conveniently complete terminal voice quality testing, reduce the requirements and cost of voice testing, and support rich voice service scenario testing.

To reduce the time required to find failures in scenario creation of a chatbot while reducing overlooking of such failures.SOLUTION: A scenario inspection device 230 for inspecting a scenario of a chatbot is provided. This scenario inspection device includes: a scenario input unit 241 that receives input of the scenario constituted of elements; a policy input unit 242 that receives input of a policy including conditions to be satisfied in the scenario by the elements constituting the scenario; a structural analysis unit 243 that performs structural analysis of the elements included in the received scenario; an inspection unit 244 that inspects whether or not the elements subjected to the structural analysis conform to the conditions of the received policy; and an output unit 245 that outputs the inspection results. By a scenario developer describing a desired state of the scenario as a policy, it is possible to inspect whether or not the scenario conforms to the policy, and reduce the time required to find failures in scenario creation or the like even for the scenario developer who does not have special knowledge.SELECTED DRAWING: Figure 3

The invention discloses an intelligent automatic scene testing method and system based on code change detection, and relates to the technical field of artificial intelligence, and the method comprises the steps: responding to a submission operation of developing branch codes, triggering a code change detection interface, and obtaining code difference details; in response to an operation of deploying the development branch code to a test environment, triggering a code analysis interface, and analyzing the code difference details to obtain a code analysis result; creating a test task based on the code analysis result; and calling an automatic test platform to execute the test task, and returning a test result, so as to solve the problem that the prior art cannot accurately trace the influenced interface based on code change and cannot automatically create and execute the test task in the whole process.

This application relates to the field of intelligent transportation technology and provides a method, device, and system for simulating vehicle wireless communication scenarios. In this method, the on-board unit under test (V2K) first sends trajectory data of the test vehicle to a simulation platform. The simulation platform then performs simulation based on the trajectory data and a preset test scenario. Next, based on the simulation results of the virtual test scenario, the simulation platform sends the required instruction information for the preset test scenario to both the roadside unit and the V2K, followed by simulation testing. The V2K generates scenario test data. Finally, the simulation platform aggregates the scenario test data from the V2K to obtain the test results of the test vehicle under that test scenario. Therefore, through virtual-real fusion scenario testing, complex scenario testing can be achieved in a simulated environment, accurately evaluating the performance of the test vehicle in complex scenarios, while also saving manpower and material costs.

The present application relates to the field of software engineering and automatic test technology, more particularly, to an E2E scene test optimization method and system based on target man-machine cooperation. The scheme sets an optimization target by hand and inputs initial test cases and business processes to build a test resource library; the system automatically analyzes business paths to generate a case dependency graph and a key path, and determines core scenes through manual verification; then the system generates candidate optimization strategies, and determines target strategies according to resource and priority screening by hand; the system optimizes the cases according to this, and deploys and executes after manual sampling verification coverage; the system collects execution data in real time and generates an evaluation report, and decides whether to supplement the cases or adjust the strategies after manual analysis; finally, the resource library and the strategy model are updated, and a dynamic feedback mechanism is established to trigger continuous optimization when the system iterates. This method significantly improves the E2E test efficiency and software delivery quality through man-machine cooperation and closed-loop optimization.

This application discloses a smart card testing method, apparatus, device, storage medium, and product, belonging to the field of the Internet of Things, to improve the accuracy of smart card performance test results. The method includes: acquiring a first test case and performing performance testing on the smart card to be tested based on the first test case to obtain a first performance index; acquiring test environment data of the smart card to be tested and inputting the first performance index and test environment data into a pre-trained performance calibration model to obtain a second performance index, wherein the second performance index is a performance index after environmental factor correction of the first performance index; performing scenario testing on the smart card to be tested based on preset scenario test cases to obtain a first instruction performance; inputting the first instruction performance into a pre-trained instruction suggestion generation model to obtain instruction improvement suggestion information, and generating a test report based on the instruction improvement suggestion information and the second performance index.