Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

38 results about "Metamorphic testing" patented technology

Metamorphic testing (MT) is a property-based software testing technique, which can be an effective approach for addressing the test oracle problem and test case generation problem. The test oracle problem is the difficulty of determining the expected outcomes of selected test cases or to determine whether the actual outputs agree with the expected outcomes.

Embedded software testing method based on AADL (Architecture Analysis and Design Language) mode transformation relationship

The invention relates to an embedded software testing method based on AADL (Architecture Analysis and Design Language) mode transformation relationship, which has the following steps of: constructing a mode transition diagram on the basis of mode information in an AADL model, and converting the diagram into a mode relationship tree required by a transformation test according to the improved depth-first traversing algorithm; constructing a source test case in the mode transformation relationship by traversing the mode relationship tree, generating a subsequent test case by means of the mode transformation relationship in the AADL model, and verifying the mode transformation relationship to obtain the conclusion of the transformation test. The embedded software testing method based on AADL mode transformation relationship solves the 'Oracle' problem existing in the embedded software test, is convenient for a user to test the embedded software at an early stage of software design and ensures the reliability of software at a system architecture level. If the model architecture can not meet corresponding requirements, the architecture of the software can be modified at an early stage of development, thus the development cost is saved, and meanwhile, the development cycle can also be shortened.
Owner:NORTHWESTERN POLYTECHNICAL UNIV

Positioning method for failure test instance in metamorphic testing

The invention belongs to the field of software testing, and particularly discloses a positioning method for a failure test instance in metamorphic testing. The positioning method comprises the following steps of firstly, selecting a testing instance from a testing instance set as an original testing instance; according to the input relation of the metamorphic relation in an metamorphic relation set, enabling the original testing instance to generate an additional testing instance; according to the output result of the tested software, verifying whether the output relation of the metamorphic relation is met or not, and recording the testing instance not meeting the metamorphic relation, and marking by a non-zero value; according to the verification result marking value of the metamorphic relation, calculating the anomaly degree of the testing instance; utilizing the same method to perform gradual traversing verification on other testing instances, and calculating the anomaly degree; finally, determining the testing instance with the maximum anomaly degree as the failure testing instance. The positioning method for the failure test instance in the metamorphic testing has the advantages that the positioning technique is simple and clear, the implementation is easy, and the failure testing instance is accurately and effectively positioned through the quantitative calculating of the anomaly degree.
Owner:PLA UNIV OF SCI & TECH

Metamorphic relation priority ranking method for metamorphic testing of parallel programs

The invention relates to a metamorphic relation priority ranking method for metamorphic testing of parallel programs. A metamorphic testing technology is applied to software testing of the parallel programs, and priority ranking is firstly performed on constructed metamorphic relations, so that errors in the programs are discovered as early as possible, and the solving efficiency of the Oracle problem in software testing is improved. According to a priority ranking strategy, derivative testing examples and original testing examples, generated on the basis of the metamorphic relations, are adopted, and similarity between the examples are taken as the basis, the similarity of paths covered by executive programs of the examples is estimated, the error detecting range of the metamorphic relations based on the existing testing examples is further estimated, and priority ranking is performed based on the metamorphic relations. The method comprises specific steps as follows: (1) evaluating the error detecting capacity of each process of the metamorphic relations; (2) setting a weight value of each process so as to reflect the error detecting capacity of each process of the metamorphic relations, and evaluating weight of the error detecting capacity of each process to the error detecting capacity of the whole program; (3) evaluating the program error detecting capacity of the metamorphic relations, and determining the priority of each metamorphic relation; (4) detecting the programs.
Owner:CHINA UNIV OF MINING & TECH

Formal description and decomposition method for metamorphic relation

The invention discloses a formal description and decomposition method for a metamorphic relation. The method includes the following steps: (1) according to targeted tested software, extracting and designing the metamorphic relation that the software mush satisfy to create the metamorphic relation; (2) performing formal modeling on the obtained metamorphic relation on the basis of symbolic logic, determining constraint conditions under which the metamorphic relation is established, performing formal description, then describing input parameters and output parameters of the metamorphic relation on the basis of the symbolic logic, and establishing a formal description model of the metamorphic relation; (3) on the basis of the formal model, respectively extracting subrelations forming the metamorphic relation and a set description form of a metamorphic relation composition model, and establishing a metamorphic relation decomposition model. The method is simple and clear, description capacity and application range of the formal model are guaranteed through symbolic logic description, the accurate, standard and effective method is provided for description of the metamorphic relation, and the method is more conducive to automated implementation of subsequent metamorphic testing.
Owner:PLA UNIV OF SCI & TECH

Unmanned aerial vehicle intelligent airway planning test method based on metamorphic test technology

ActiveCN110823226ASolve the problem of Oracle in the testValid testNavigational calculation instrumentsSimulationUncrewed vehicle
The invention discloses an unmanned aerial vehicle intelligent airway planning test method based on metamorphic test technology, comprising the following steps: (1) analyzing an unmanned aerial vehicle intelligent airway planning algorithm, defining a metamorphic relationship, and designing a subsequent test case generator and a result comparator; (2) generating an initial test case set by utilizing a random value method under a certain constraint rule and inputting the initial test case set into the algorithm to obtain initial output of test cases; (3) taking the initial test case set and theinitial output as inputs and obtaining a subsequent test case set and a corresponding subsequent output through a subsequent test case generator; and (4) inputting an initial output result and a subsequent output result into a result comparator. If a corresponding metamorphic relation is met, the test is passed, and no defect is found; otherwise, an unmanned aerial vehicle intelligent route planning algorithm has defects. According to the invention, the problem of lack of Oracle in unmanned aerial vehicle intelligent route algorithm testing can be alleviated, the generation of test cases canbe guided, and the utilization rate of the test cases can be improved.
Owner:BEIHANG UNIV

Program testing method, program testing device, electronic equipment and storage medium

ActiveCN111679978AImprove test accuracySolving the Test Prediction Problem of RandomnessSoftware testing/debuggingStochastic algorithmsRandom seed
The embodiment of the invention provides a program testing method, a program testing device, electronic equipment and a storage medium. The program testing method specifically comprises the steps of acquiring a block generation node random algorithm program, wherein the block generation node random algorithm program comprises a random function and a random seed; running a block generation node random algorithm program to obtain a first test result; generating a test program according to the random function and the random seed, and running the test program to obtain a second test result; and determining the program performance of the block generation node random algorithm program according to the first test result and the second test result. The embodiment of the invention provides a program testing method. According to the method, a metamorphic test idea is adopted, an automatic framework is introduced, random functions and random seeds in a blockchain project program are automaticallymined, a corresponding test program is automatically generated, and the problem of test prediction of randomness of a block generation node selection algorithm is solved, so that the randomness and reliability of the metamorphic test node selection algorithm are improved.
Owner:TENCENT TECH (SHENZHEN) CO LTD

Metamorphic testing system of primary-secondary peak ratio calculation algorithm

ActiveCN111124896ASolving the problem of test decision uncertaintySoftware testing/debuggingImage extractionAlgorithm
The invention belongs to the field of primary and secondary peak value ratio calculation algorithm testing, and particularly relates to a metamorphic testing system of a primary and secondary peak value ratio calculation algorithm. The system comprises a metamorphic relation extraction module, an additional test case generation module and a verification module. The metamorphic relation extractionmodule is used for extracting a metamorphic relation according to a regional image and a neighborhood image input by a primary-secondary peak ratio calculation algorithm; the additional test case generation module is used for combining the original test case with the metamorphic relationship to generate an additional test case, and outputting the additional test case to the verification module; and the verification module is used for inputting the original test case and the additional test case into the tested program and verifying whether the tested program has defects or not. Compared with the prior art, the metamorphic testing system is derived from geometric attributes, numerical attributes and algorithm characteristics in the algorithm, so that an absolutely accurate expected result does not need to be obtained, and the problem of test judgment uncertainty of a reconstructed standard model can be well solved.
Owner:北京京航计算通讯研究所

Method of utilizing metamorphic testing to evaluate correctness of commodity searching system

ActiveCN107766229AEfficient Search Correctness EvaluationThe indicators are comprehensive and accurateSoftware testing/debuggingBuying/selling/leasing transactionsWeb siteChinese characters
The invention discloses a method of utilizing metamorphic testing to evaluate correctness of a commodity searching system. The method includes the following steps: initializing a searching keyword A,wherein A is a commodity bought on a shopping platform; utilizing the keyword A for searching in the to-be-evaluated commodity searching system, and denoting a searching result set by FR1; constructing subsequent querying keywords B according to construction methods of carrying out position exchange on the keyword, associating the keyword with titles, prices, locations of consignment and filterable attributes to carry out filtering together, and carrying out operations of repetition, adhesion, simplified/traditional Chinese characters, wrongly written characters, partial deletion and useless-symbol doping on the keyword; utilizing the keywords B for searching, and denoting searching result sets as FR2; and carrying out result comparison and calculation on FR1 and FR2 under use of the different construction methods to obtain an index result of evaluating commodity searching function quality. The method can effectively carry out searching correctness evaluation on a shopping website searching engine through processing on the commodity attributes, commodity rankings and the commonly used commodity keyword.
Owner:NANJING UNIV OF SCI & TECH

Unsupervised machine learning system selection method based on metamorphic testing

The invention discloses a method for selecting an unsupervised machine learning system based on metamorphic testing. According to the method, 11 universal metamorphic relations suitable for most application scenes are defined on the basis of general expectation of a user on a clustering system by taking dynamic characteristics of measurement data as a purpose, so that the oracle problem in the field of unsupervised machine learning is effectively relieved, and the purpose of verifying the unsupervised machine learning system is achieved; secondly, a system characteristic-oriented sufficiency criterion based on the metamorphic relationship is defined, the metamorphic relationship is endowed with different weights by a user according to importance and severity of a failure clustering mode, and a final weighted score is calculated; according to the invention, a set of complete unsupervised machine learning system verification and evaluation system is finally formed; a user is allowed to select a part of universal metamorphic relations according to own requirements or define a new specific metamorphic relation according to domain related knowledge, and finally the user is helped to deeply understand algorithm characteristics and select an unsupervised machine learning system suitable for a specific scene.
Owner:WUHAN UNIV

A Formal Description and Decomposition Method of Metamorphic Relationship

The invention discloses a formal description and decomposition method for a metamorphic relation. The method includes the following steps: (1) according to targeted tested software, extracting and designing the metamorphic relation that the software mush satisfy to create the metamorphic relation; (2) performing formal modeling on the obtained metamorphic relation on the basis of symbolic logic, determining constraint conditions under which the metamorphic relation is established, performing formal description, then describing input parameters and output parameters of the metamorphic relation on the basis of the symbolic logic, and establishing a formal description model of the metamorphic relation; (3) on the basis of the formal model, respectively extracting subrelations forming the metamorphic relation and a set description form of a metamorphic relation composition model, and establishing a metamorphic relation decomposition model. The method is simple and clear, description capacity and application range of the formal model are guaranteed through symbolic logic description, the accurate, standard and effective method is provided for description of the metamorphic relation, and the method is more conducive to automated implementation of subsequent metamorphic testing.
Owner:PLA UNIV OF SCI & TECH

Neural machine translation system-oriented sentence granularity metamorphic test method

The invention discloses a sentence granularity metamorphic testing method oriented to a neural machine translation system, and belongs to the field of metamorphic testing, aiming at the translation robustness evaluation problem existing in the neural machine translation system. The method comprises the following steps: firstly, carrying out data preprocessing operation on two groups of texts which need to be subjected to similarity calculation to generate two groups of word lists; then, using a TF-IDF-based word bag model to construct text vectors for the two groups of word lists, and calculating an included angle cosine value of the two groups of text vectors; meanwhile, calculating a Jaccard similarity coefficient and an editing distance of the two groups of word lists; and finally, calculating the similarity between the sentences and the metamorphic relationship satisfaction rate according to the defined similarity calculation formula and the metamorphic relationship. According to the method, the problem that a single cosine similarity method is difficult to reflect semantic changes caused by different word sequences of the sentences is solved, the capability of distinguishing the semantic changes caused by the word sequence changes of the sentences is enhanced, and the sentence similarity calculation accuracy and the translation quality evaluation accuracy are improved.
Owner:XIAN UNIV OF POSTS & TELECOMM

Block chain smart contract test method based on metamorphic test

The invention discloses a block chain smart contract test method based on a metamorphic test, and belongs to the field of software engineering. Comprising the following steps: step 1, analyzing a called function and a code of a parameter thereof based on a smart contract; 2, analyzing necessary attributes among the intelligent contract parameters according to the called function and the corresponding parameters; step 3, determining a metamorphic relationship (MRs) according to a relationship between input and output in the necessary attributes, wherein the metamorphic relationship comprises an input metamorphic relationship and an output metamorphic relationship; and step 4, generating an original test case by using a random test method, generating a subsequent test case according to input relationship, respectively running the two groups of test cases in the smart contract, and verifying the correctness of the result by judging whether the output result meets the corresponding output relationship. According to the method, the oracle problem in the smart contract test is relieved while the security defect of the smart contract is tested, and the effectiveness and advantages of the method are verified by performing a test experiment on the existing smart contract vulnerability.
Owner:JIANGSU UNIV

Embedded software testing method based on AADL (Architecture Analysis and Design Language) mode transformation relationship

The invention relates to an embedded software testing method based on AADL (Architecture Analysis and Design Language) mode transformation relationship, which has the following steps of: constructing a mode transition diagram on the basis of mode information in an AADL model, and converting the diagram into a mode relationship tree required by a transformation test according to the improved depth-first traversing algorithm; constructing a source test case in the mode transformation relationship by traversing the mode relationship tree, generating a subsequent test case by means of the mode transformation relationship in the AADL model, and verifying the mode transformation relationship to obtain the conclusion of the transformation test. The embedded software testing method based on AADL mode transformation relationship solves the 'Oracle' problem existing in the embedded software test, is convenient for a user to test the embedded software at an early stage of software design and ensures the reliability of software at a system architecture level. If the model architecture can not meet corresponding requirements, the architecture of the software can be modified at an early stage of development, thus the development cost is saved, and meanwhile, the development cycle can also be shortened.
Owner:NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products