A test management platform and management method

Abstract

The application discloses a kind of test management platform and management method, it is related to computer technical field, interface automation management unit includes case library, scene library, test report generation module;UI automation management unit is based on functional test case, completes element positioning, in platform batch import test case;Full-link stress test unit;Timing execution unit is used to configure the execution time of interface automation, UI automation, performance test;Project test report unit is used to summarize test report;The test report is sent uniformly by platform, realizes interface automation test, UI function automation test, performance test, full-link stress test, test data statistics, function test management and departmental daily work management, the basic test of test department and automation test, performance test set one, meet the test demand of different products, one platform realizes whole process management, work clarity is high, reusability is high, to reach the purpose of high efficiency.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of computer, and particularly relates to a test management platform and a management method. BACKGROUND

[0002] As for the test platform, there are many interface automatic test platforms and performance test platforms on the market, such as the automatic test management method and system provided by Chinese patent CN108628748A. The automatic test management method includes the following steps performed on a use case test platform: obtaining a first editing format of an original test case, the original test case including at least one original element; obtaining a test request, the test request including a test type; determining at least one target element corresponding to the test type; if all target elements are contained in the at least one original element of the original test case, performing format conversion on the original test case to obtain an XML format of a target test case; importing the target test case into a test framework for testing to obtain a test report. The automatic test management method does not require manual creation of an XML format file, and is completely automatically generated by the use case test platform, which can effectively reduce labor costs and improve efficiency.

[0003] Also, the data test method and system of the interface management platform provided by Chinese patent CN113791985A, the intelligent networked vehicle test monitoring and management platform based on a broadband mobile Internet provided by Chinese patent CN109218409A, and the like, but as mentioned above, most of the test platforms are interface test platforms and performance test platforms, which satisfy single type testing; there is a lack of platforms that can realize UI function automatic test and test management type work, and there is a lack of overall test management.

[0004] Therefore, the present application provides a test management platform and a management method. SUMMARY

[0005] The present application aims to at least solve one of the technical problems existing in the prior art; for this purpose, the present application provides a test management platform and a management method, which are used to solve the technical problems of a lack of platforms that can realize UI function automatic test and test management type work, and a lack of overall test management. The present application integrates basic test and automatic test, performance test of the test department into one through interface automatic test, UI function automatic test, performance test, full link stress test, test data statistics, function test management and daily work management in the department, meets various test requirements of different products, realizes whole process management by one platform, has high work clarity and reusability, and thus can achieve the purpose of high efficiency.

[0006] To achieve the above objectives, according to an embodiment of the first aspect of the present invention, a test management platform is provided, comprising:

[0007] The interface automation management unit includes a use case library, a scenario library, and a test report generation module. The use case library in the interface automation management unit is used to write automated test cases, supports multiple protocols such as HTTP and TCP, and encapsulates multiple encryption methods, such as SM2 RAS and Base64. The scenario library in the interface automation management unit is used to combine multiple test scenarios according to actual business and execute tests. The test report generation module in the interface automation management unit is used to generate current automated test reports and review historical test reports.

[0008] The UI automation management unit is used to locate elements based on functional test cases and import test cases in batches on the platform. The UI automation management unit also includes a use case library, a scenario library, and a test report generation module. The use case library in the UI automation management unit is used to locate elements based on functional test cases and import test cases in batches on the platform. The scenario library in the UI automation management unit is used to combine multiple test scenarios based on actual business and execute tests. The test report generation module in the UI automation management unit is used to generate automated test reports and store historical test reports.

[0009] The full-link stress testing unit is used to manage scripts, configure tests, execute tests, and display test results.

[0010] The timed execution unit is used to configure the execution time of interface automation, UI automation, and performance testing;

[0011] The project test report unit is used to summarize the test reports. The project test report unit is also used to analyze and summarize the bug situations in the test reports, and count the number of bugs and the number of remaining bugs; the test reports are sent uniformly through the platform.

[0012] Furthermore, when the project test report unit analyzes and summarizes the BUG situation, it executes the following algorithm:

[0013] S1: Obtain the project developer corresponding to the test report and mark the project developer as the target source;

[0014] S2: Select all test reports corresponding to the same target source, summarize the bug situations in all test reports, extract various bug causes, and build a bug distribution tree;

[0015] S3: Count the probability of the bug corresponding to each cause in the bug distribution tree, and mark them as the original probability Y;

[0016] S4: combining the logical relationship of the BUG distribution tree, the probability of the modified intermediate layer BUG and the upper layer BUG is calculated according to the probability of the occurrence of each bottom layer BUG;

[0017] S5: according to the probability of the occurrence of each reason corresponding to the BUG, the BUG rating is performed.

[0018] Further, the method for calculating the probability of the occurrence of the modified intermediate layer BUG and the upper layer BUG is:

[0019] S01: the intermediate layer BUG and the upper layer BUG are marked as to-be-modified BUG nodes;

[0020] S02: an optional to-be-modified BUG node is selected, the number of all nodes located at the bottom layer thereof and the probability of the occurrence of each node corresponding to the BUG are obtained, Pijk represents the probability of the occurrence of the kth BUG corresponding to the ith layer and the jth node located below the to-be-modified BUG node, wherein, i=1~n, j=1~m, k=1~f; and Pijk is sorted in descending order;

[0021] S03: when n>X1, the first X2 probabilities in Pijk are selected, and the mean value of the X2 probabilities is calculated, which is marked as the first modified value Z; and the probability of the to-be-modified BUG node after modification is Y+Z*α;

[0022] When 0<n≤X1, the maximum probability in Pijk is selected and marked as the second modified value E, and the probability of the to-be-modified BUG node after modification is Y+E*β;

[0023] Wherein, α, β, X1 are preset values, represents rounding φ to the nearest integer.

[0024] Further, when calculating the probability of the occurrence of the modified intermediate layer BUG and the upper layer BUG, a comprehensive probability evaluation intervention step is further performed, which specifically includes:

[0025] An optional BUG is marked as a unified BUG;

[0026] The number of times of the occurrence of the BUG with the same reason as the unified BUG when the platform is tested is obtained, and the number of times is marked as a unified number;

[0027] A unified proportion is obtained, the unified proportion=the unified number / total unified number, and the total unified number is the number of times of the occurrence of all BUGs when the platform is tested;

[0028] The BUG rating is: the comprehensive probability is arranged in order of size, and the BUGs are classified according to the arrangement order, and there are X2 levels in total; X2 is a preset value; ​​

[0029] Wherein, the comprehensive probability = (the probability of the corrected BUG occurrence + the overall proportion) / 2.

[0030] Further, it also includes planning the test report corresponding to the target source in an overall manner, and the planning manner is:

[0031] The probability of all BUG occurrences corresponding to the target source is obtained, and the maximum value of the probability is marked as a target probability;

[0032] The super-probability score D is calculated, D = target probability - overall target value, and the overall target value is the maximum value of the probability corresponding to all BUGs occurring when testing on the platform;

[0033] If the super-probability score D is greater than or equal to X3, the test report corresponding to the target source is manually evaluated;

[0034] Otherwise, no processing is performed.

[0035] To achieve the above-mentioned purpose, according to the second aspect of the embodiment of the application, a test management method is provided, which is realized based on the management platform provided in the first aspect, and the method comprises:

[0036] The test personnel writes interface test cases on the management platform according to the interface specification on the API DOC, saves the cases after writing, and if the interface debugging is different, relevant information is prompted, and the case saving fails;

[0037] According to the specific business scenario, a test scene is combined and tested, and after the test passes, the production interface automatic test report is generated.

[0038] Compared with the prior art, the application has the following beneficial effects:

[0039] 0Code realizes interface automation and supports multiple protocol types of interfaces, supports interfaces with different encryption methods, realizes UI function automation testing, and completes UI function automation element positioning in the product function test stage. After the function test is completed, the test management platform directly imports the cases, which is equivalent to one workload and two outputs. Interface automation testing, UI function automation testing, performance testing, full-link stress testing, test data statistics, function test management and daily work management in the department are realized. The basic test and automation test of the test department and the performance test are integrated, different product test requirements are met, one platform realizes whole-process management, the work clarity is high, the reusability is high, and the purpose of high efficiency is achieved. BRIEF DESCRIPTION OF DRAWINGS

[0040] Figure 1 It is a schematic diagram of the test management platform of the application. DETAILED DESCRIPTION

[0041] The technical solutions of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0042] Example 1:

[0043] like Figure 1 As shown, this embodiment proposes a test management platform that implements interface automation through zero code, supports interfaces of multiple protocol types, and supports interfaces with different encryption methods; implements UI function automation testing with zero code, and can complete element positioning of UI function automation during the product function testing phase. After the function test is completed, the test management platform directly imports the use case, which is equivalent to one workload and two outputs; implements full-link stress testing of the product, and unified management of stress testing scripts and resource monitoring; at the same time, supports single performance automation testing work, which is a one-click performance test execution monitoring; although there are test reports and outputs, they are sent through the platform, and the test report situation is analyzed as a whole, multiple test tasks are managed in a unified manner, and the test results are clear at a glance; based on the above points, energy and efficiency are improved. Specifically, the platform includes:

[0044] The interface automation management unit includes a use case library, a scenario library, and a test report generation module; the use case library in the interface automation management unit is used to write automated test cases, supports multiple protocols such as HTTP and TCP, and encapsulates multiple encryption methods, such as SM2 RAS and Base64; the scenario library in the interface automation management unit is used to combine multiple test scenarios according to actual business and execute tests; the test report generation module in the interface automation management unit is used to generate current automated test reports and review historical test reports; it is the implementation of the test management system. The construction of the entire platform combines tooling and manualization, avoiding the rigor of testing caused by pure tooling, solving the problem of slow efficiency of manual testing, and extracting and encapsulating the originally complex interface process separately to improve reusability;

[0045] A UI automation management unit is configured to complete element positioning based on a function test case and to import test cases in batches on a platform; the UI automation management unit also includes a test case library, a scenario library, and a test report generation module; the test case library in the UI automation management unit is configured to complete element positioning based on a function test case and to import test cases in batches on a platform; the scenario library in the UI automation management unit is configured to combine various test scenarios according to actual business and to perform testing; and the test report generation module in the UI automation management unit is configured to generate an automated test report and to store historical test reports.

[0046] A full-link stress testing unit is configured to manage scripts, to configure testing, to perform testing, and to display testing results; that is, the full-link stress testing unit can meet testing requirements of different business fields, can be personalized for self-developed products, and has high compatibility and expansibility; and a timing execution unit is configured to configure execution times of interface automation, UI automation, and performance testing; specifically,

[0047] Script configuration: responsible for script management and testing configuration;

[0048] Test execution: according to actual stress testing scenarios, the tested end is stressed;

[0049] Test report: performance test result display, resource monitoring display, database resource and link time consumption monitoring;

[0050] A project test report unit is configured to summarize test reports; the project test report unit is also configured to analyze and summarize BUG conditions of test reports, to count the number of BUGs, and to count the number of remaining BUGs; and the test reports are sent uniformly by a platform.

[0051] As an embodiment provided by the present application, preferably, test report summary: analyze and summarize the BUG conditions of test reports, count the number of BUGs, and count the number of remaining BUGs; test report: iterative test report is filled in and sent on a platform, other test reports are sent by uploading attachments, and all reports are sent uniformly by a platform.

[0052] As an embodiment provided by the present application, preferably, when the project test report unit analyzes and summarizes the BUG conditions, the following algorithm is executed:

[0053] S1: obtain a project developer corresponding to a test report, and mark the project developer as a target source;

[0054] S2: select all test reports corresponding to the same target source, summarize the BUG conditions of all test reports, extract various BUG reasons, and establish a BUG distribution tree;

[0055] S3: Statistically calculate the probability of occurrence of BUGs corresponding to each cause in the BUG distribution tree, and mark them as the original probability Y;

[0056] S4: Combine the logical relationships of the BUG distribution tree, and calculate the probabilities of occurrence of the corrected intermediate-level BUGs and upper-level BUGs based on the probabilities of occurrence of the underlying BUGs;

[0057] S5: Perform BUG rating based on the probabilities of occurrence of the corrected BUGs corresponding to each cause.

[0058] As an embodiment provided by the present invention, preferably, the method for calculating the probabilities of occurrence of the corrected intermediate-level BUGs and upper-level BUGs is as follows:

[0059] S01: Mark the intermediate-level BUGs and upper-level BUGs as BUG nodes to be corrected;

[0060] S02: Arbitrarily select a BUG node to be corrected, obtain the number of all nodes at its bottom layer and the probability of occurrence of the BUG corresponding to each node. Let Pijk represent the probability of occurrence of the k-th BUG corresponding to the j-th node at the i-th layer under the BUG node to be corrected, where i = 1~n, j = 1~m, k = 1~f; and sort Pijk from largest to smallest;

[0061] S03: When n>X1, select the top ones from Pijk, and calculate the mean value of the probabilities, and mark the mean value as the correction value one Z; then the corrected probability of the BUG node to be corrected is: Y + Z*α;

[0062] When 0 < n ≤ X1, select the largest probability from Pijk and mark it as the correction value two E, then the corrected probability of the BUG node to be corrected is: Y + E*β;

[0063] Among them, α, β, and X1 are all preset values, indicating rounding the φ value.

[0064] As an embodiment provided by the present invention, preferably, when calculating the probabilities of occurrence of the corrected intermediate-level BUGs and upper-level BUGs, a comprehensive probability evaluation intervention step is also performed, which specifically includes:

[0065] Arbitrarily select a BUG and mark it as the overall BUG;

[0066] Obtain the number of BUGs with the same cause as the overall BUG that occur during testing on the platform, and mark the number as the overall number;

[0067] Obtaining the proportion of the overall planning, the proportion of the overall planning = the second overall planning / the total number of the overall planning, the total number of the overall planning is the number of all BUGs appearing when testing on the platform;

[0068] The BUG rating is: arranging the comprehensive probability in order of size, and grading the BUGs according to the order of arrangement, and there are X2 levels in total; X2 is a preset value;

[0069] Among them, the comprehensive probability = (the probability of the BUG appearing after correction + the proportion of the overall planning) / 2.

[0070] As an embodiment provided by the application, preferably, it further comprises overall planning of the test report corresponding to the target source; the overall planning mode is:

[0071] Obtaining the probability of all BUGs appearing after correction corresponding to the target source, and obtaining the maximum value of the probability as the target probability;

[0072] Calculating the super-probability score D, D = target probability - overall target value, the overall target value is the maximum value of the probability corresponding to all BUGs appearing when testing on the platform;

[0073] If the super-probability score D >= X3, then manually evaluating the test report corresponding to the target source;

[0074] Otherwise, no processing is performed.

[0075] 0Code implementation interface automation, and supports multiple protocol types of interfaces, supports interfaces of different encryption methods, realizes UI function automation testing, and can complete UI function automation element positioning in the product function test stage. After the function test is completed, the test management platform directly imports the test case, which is equivalent to one workload and two outputs. Interface automation testing, UI function automation testing, performance testing, full-link stress testing, test data statistics, function test management and departmental daily work management are realized. The basic test and automation test of the test department, performance test are integrated, different product testing requirements are met, one platform realizes whole process management, the work clarity is high, the reusability is high, so that the purpose of high efficiency can be achieved.

[0076] Embodiment two:

[0077] The embodiment provides a test management method, and the method is realized based on the management platform provided in the first aspect, and the method comprises the following steps:

[0078] A test personnel writes an interface test case on the management platform according to the interface specification on the API DOC, saves the test case after writing, and if the interface debugging is different, relevant information is prompted, and the test case fails to be saved;

[0079] According to the specific business scenario combination test scene, and execute test, test pass, production interface automatic test report;

[0080] Specifically, such as business scenarios: industry payment platform interface automatic test, UI function automatic test, iteration test report management;

[0081] Embodiment: industry payment platform interface automatic test:

[0082] The tester writes interface test cases on the platform according to the interface specification on API DOC. If the interface debugging is different, the relevant information will be prompted, and the case saving will fail.

[0083] Test case test pass, according to the specific business scenario combination test scene, and execute test, test pass, production interface automatic test report;

[0084] The platform has completed all interface tests of the industry payment platform and is used in the regression test of the industry payment platform, which can meet the test needs of different business fields, and also develop personalized products, with high compatibility and expansibility.

[0085] Example three:

[0086] Industry payment platform UI function automatic test:

[0087] In the function test, the main process case will be imported into the platform in batches after the function test is completed, and the UI function will be automatically tested after the test platform test is passed. At present, all the main process cases of the industry payment platform iteration test have been imported into the platform for regression test. The test management platform is the landing of the test management system. The whole platform is built by combining tooling and manual operation, which avoids the rigorousness of pure tooling and solves the slow efficiency of manual test. Moreover, the originally complex interface process is extracted and encapsulated separately to improve the reusability.

[0088] Example four:

[0089] Iteration test report management:

[0090] The weekly iteration test report is managed and sent on the platform. The test platform will count the number of BUGs and the number of repaired BUGs in the test report.

[0091] Some data in the above formula are calculated by removing the dimension and taking their numerical values. The formula is obtained by software simulation of a large amount of data to get a formula closest to the real situation. The preset parameters and preset thresholds in the formula are set by the technicians in the field according to the actual situation or obtained by a large amount of data simulation.

[0092] The above examples are only used to illustrate the technical method of the present application but not to limit the present application. Although the present application is described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present application can be modified or equivalently replaced without departing from the spirit and scope of the technical method of the present application.

Claims

1. A test management platform, characterized by, Comprise: Interface automation management unit, including use case library, scene library, test report generation module; UI automation management unit is used to complete element positioning on the basis of functional test case, and import test case in batches on the platform; Full-link stress testing unit, for script management and test configuration, and execute test, show test results; Timing execution unit, for configuring the execution time of interface automation, UI automation and performance testing; Project test report unit, for summarizing test reports; The test report is sent uniformly through the platform; The project test report unit is also used for analyzing and summarizing the BUG situation, specifically: S1: obtaining the project developer corresponding to the test report, and marking the project developer as the target source; S2: selecting all test reports corresponding to the same target source, summarizing the BUG situation of all test reports, and extracting various BUG reasons to establish a BUG distribution tree; S3: statistics the probability of occurrence of each kind of reason corresponding to the BUG in the BUG distribution tree, and mark it as the original probability Y respectively; S4: combining the logical relationship of the BUG distribution tree, calculating the probability of occurrence of the corrected intermediate layer BUG and upper layer BUG through the probability of occurrence of each bottom layer BUG; S5: according to the probability of occurrence of each kind of reason corresponding to the BUG after correction, the BUG is rated.

2. The test management platform of claim 1, wherein, The UI automation management unit also includes use case library, scene library, test report generation module.

3. The test management platform of claim 2, wherein, The use case library in the interface automation management unit is used to write automated test cases, support multiple protocols, and encapsulate multiple encryption methods; The scene library in the interface automation management unit is used to combine multiple test scenarios according to actual business, and execute test; The test report generation module in the interface automation management unit is used to generate current automated test report and check historical test report.

4. The test management platform of claim 2, wherein, The use case library in the UI automation management unit is used to complete element positioning on the basis of functional test case, and import test case in batches on the platform; The scene library in the UI automation management unit is used to combine multiple test scenarios according to actual business, and execute test; The test report generation module in the UI automation management unit is used to generate automated test report and store historical test report.

5. The test management platform of claim 1, wherein, The method for calculating the probability of occurrence of the corrected intermediate layer BUG and upper layer BUG is: S01: mark the intermediate layer BUG and upper layer BUG as the to-be-corrected BUG node; S02: select a to-be-corrected BUG node, get the number of all nodes located at the bottom layer and the probability of occurrence of each node corresponding to the BUG, represented as Pijk, which represents the probability of occurrence of the kth BUG corresponding to the ith layer and jth node located below the to-be-corrected BUG node, wherein i=1~n, j=1~m, k=1~f; and sort Pijk from large to small; S03: When n>X1, select the one that ranks first from Pijk and calculate The mean of the probabilities is marked as the correction value - Z; then the probability of the BUG node to be corrected after correction is: Y+Z*α; When 0 wherein α, β, X1are all preset values, represents rounding off the value of φ.

6. The test management platform of claim 5, wherein, When the probabilities of the corrected intermediate layer BUG and the upper layer BUG are calculated, a comprehensive probability evaluation intervention step is further performed, specifically including: Optionally, a BUG is marked as a unified BUG; The number of times of the same BUG as the unified BUG is obtained when the platform is tested, and the number of times is marked as a unified time; A unified proportion is obtained, the unified proportion = the unified time / the total unified number, and the total unified number is the number of times of all the BUGs when the platform is tested; The BUG rating is: the comprehensive probability is arranged in order of size, and the BUG is classified according to the arrangement order, and is divided into X2 levels; X2 is a preset value; Wherein, the comprehensive probability = (the probability of the corrected BUG + the unified proportion) / 2.

7. The test management platform of claim 6, wherein, Further comprising unified planning of the test report corresponding to the target source; the unified planning manner is: The probability of all the BUGs corresponding to the target source is obtained after correction, and the maximum value of the probability is marked as a target probability; The super probability score D is calculated, D = target probability - unified target value, and the unified target value is the maximum value of the probability corresponding to all the BUGs when the platform is tested; If the super probability score D >= X3, the test report corresponding to the target source is manually evaluated; Otherwise, no processing is performed.

8. A test management method characterized by, The method is implemented based on the management platform of any one of claims 1-7, and the method comprises: A tester performs interface test case writing on the management platform according to the interface specification on the API DOC, saves the test case after writing, and if the interface debugging is not successful, relevant information is prompted, and the test case saving fails; According to a specific business scenario, a test scene is combined and tested, and an automatic interface test report is generated after the test is passed.

Images