Automated test platform benchmark library architecture and method of use

Abstract

This invention provides an automated testing platform benchmark library architecture and usage method, including an automated testing platform; the automated testing platform parses code and displays it on a webpage, enabling project team automated testing code sharing, with team members making real-time modifications and saving; the automated testing platform generates a layered automated testing framework and executes it via distributed nodes. This invention greatly simplifies user operations and reduces the cost for testers to build automated testing frameworks.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of test platforms, in particular to an automatic test platform benchmark library architecture and a use method. BACKGROUND

[0002] In today's test industry, various test platforms are prevalent, such as interface automation platforms, UI automation platforms, Mock platforms, and number generation platforms. In terms of performance, there are stress testing platforms and monitoring platforms. Automatic test platforms are currently widely used in Devops tool chains.

[0003] The Chinese patent document with the publication number CN111416755A discloses a SONiC automatic test platform building method, device, system and server. The method includes: setting network configuration and installing platform software in the Linux system; updating the network configuration of the server and the configuration of the virtual machine and the PDF docker according to the preset platform information; wherein the server is connected with the root switch, the root switch is connected with the fan switch, each fan switch is used to be connected with one corresponding test device one-to-one; configuring the VLAN of each fan switch; updating the configuration file of the automatic test platform according to the preset configuration information.

[0004] According to the related technology in the above, the inventors believe that the current automatic test framework is developed locally, and lacks an online development environment. The automatic generation of the automatic test framework has not yet been realized by related products. SUMMARY

[0005] In view of the defects in the prior art, the purpose of the present application is to provide an automatic test platform benchmark library architecture and a use method.

[0006] According to the automatic test platform benchmark library architecture provided by the present application, the automatic test platform comprises:

[0007] The automatic test platform parses the code and displays the page, performs project group automatic test code sharing, and saves the real-time modification of the group members.

[0008] The automatic test platform generates a layered automatic test framework and performs distributed node execution.

[0009] Preferably, the automatic test platform comprises a load balancing application server.

[0010] The load balancing application server comprises an automatic test framework integrated development environment, an automatic test framework generation module, and an automatic test framework triggering module.

[0011] The automatic test framework integrated development environment parses project framework specifications, displays platforms for different project frameworks, and has an interface style and use mode similar to desktop terminals. The automatic test framework integrated development environment detects the use state of project source code files in real time, and allows project group automatic test code group members to modify, save, and share in real time.

[0012] The automatic test framework generation module parses online interface documents and generates project automatic test frameworks using a custom automatic test framework template. Users fill in input data to perform automatic tests.

[0013] The automatic test framework triggering module triggers distributed node machines to perform automatic tests and records automatic test results.

[0014] Preferably, the automatic test platform includes a node execution server.

[0015] The node execution server includes an automatic test framework execution module.

[0016] The automatic test framework execution module performs automatic test framework distributed execution by executing distributed node machines, generates test reports for the actual execution process of automatic tests.

[0017] Preferably, the automatic test platform includes a database server.

[0018] The database server includes a user information storage and execution information storage module.

[0019] The user information storage and execution information storage module stores project information, user information in the project, user permissions, and project execution record information.

[0020] Preferably, the automatic test framework integrated development environment includes an automatic test framework import submodule, an automatic test framework analysis submodule, and an automatic test framework display submodule.

[0021] The automatic test framework import submodule stores project frameworks imported by users, supports synchronous updates, and allows project group users to directly write code on the interface and share code for real-time modification.

[0022] The automatic test framework analysis submodule analyzes project source code and displays project source code on the page.

[0023] The automatic test framework display submodule supports project group automatic test code sharing, real-time modification and saving of group members, and debugging.

[0024] Preferably, the generated automatic test framework includes five layers, namely a data-driven layer, a configuration file layer, a test case layer, a keyword layer, and a test result layer.

[0025] The interface information is filled into the test case layer by the automatic test framework generation module; the data in the data driving layer is filled or modified by the user and is referenced in the test case layer; the global variable is placed in the configuration file layer and is referenced in the test case layer; the sending keyword is placed in the keyword layer and is referenced in the test case layer; and the test result layer stores the test execution result report.

[0026] Preferably, the automatic test framework triggering module has three triggering modes: manual triggering, timing triggering and frequency triggering.

[0027] According to the application, the automatic test platform benchmark library architecture is used, and the method comprises the following steps:

[0028] The test project is newly created by the user logging in the automatic test platform.

[0029] The execution node is added by clicking the node management in the automatic test framework integrated development environment, inputting the execution node information and adding multiple execution nodes.

[0030] The Agent is started on the execution node machine, and the Agent is connected with the load balancing application server.

[0031] The user selects the automatic test project and the node, checks the test case and clicks the run.

[0032] Preferably, the test project is newly created by the user logging in the automatic test platform.

[0033] The interface document is saved by the load balancing application server newly creating a project folder and saving the interface document.

[0034] The automatic test framework is generated by the load balancing application server analyzing the interface document, filling the interface information into the test case layer and generating the automatic test framework.

[0035] Preferably, the test project is newly created by the user logging in the automatic test platform.

[0036] The automatic test project is downloaded from the load balancing application server by the execution node machine.

[0037] The command is executed by the automatic test framework.

[0038] The data is uploaded by the test result layer data being packed and uploaded to the load balancing application server.

[0039] Compared with the prior art, the application has the following beneficial effects:

[0040] 1. This invention greatly simplifies user operations and reduces the cost for testers to build automated testing frameworks;

[0041] 2. This invention uses an automated testing framework IDE to parse Robot Framework and JMeter code and display it on a web page, enabling automated testing code sharing within the project team and allowing team members to modify and save the code in real time.

[0042] 3. This invention generates a complete layered automated testing framework through an automated testing framework generation module and performs distributed node execution. Attached Figure Description

[0043] Other features, objects, and advantages of the present invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings:

[0044] Figure 1 This is a framework diagram of the present invention. Detailed Implementation

[0045] The present invention will now be described in detail with reference to specific embodiments. These embodiments will help those skilled in the art to further understand the present invention, but do not limit the invention in any way. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all fall within the protection scope of the present invention.

[0046] This invention discloses an automated testing platform benchmark library architecture, such as... Figure 1 As shown, this includes an automated testing platform. The platform parses the code and displays it on a webpage, enabling code sharing among project team members and allowing them to save changes in real time. The platform generates a layered automated testing framework and executes it across distributed nodes.

[0047] The automated testing platform includes a load-balanced application server, a node execution server, and a database server.

[0048] The load balancing application server includes an integrated development environment (IDE) for an automated testing framework, an automated testing framework generation module, and an automated testing framework triggering module. IDE stands for Integrated Development Environment.

[0049] The node execution server includes an automated testing framework execution module.

[0050] The database server includes modules for storing user information and storing execution information (user information storage and execution information storage).

[0051] The automatic test framework integrated development environment parses the project framework specification, and displays the platform for different project frameworks. The interface style and use mode are compared with the desktop end. The use state of the project source code file is detected in real time. The members in the project group automatically test code group are modified, saved, and shared in real time.

[0052] Specifically, the automatic test framework IDE parses the Robotframework and Jmeter framework specification through XML and robot files. The web platform displays different frameworks through Html and Js. The interface style and use mode are compared with the desktop end. The use state of the project source code file is detected in real time through the web front and back end. The members in the project group automatically test code group are modified, saved, and shared in real time (real-time modification and saving of the members in the project group automatically test code group are realized).

[0053] The automatic test framework generation module parses the online interface document and generates a complete project automatic test framework using a custom automatic test framework template. The user fills in the input data to perform automatic testing.

[0054] Specifically, the automatic test framework IDE provides a user interface for importing swagger interface documents. The swagger interface document is a json format file. The swagger interface document is parsed through the json file to obtain the interface module, interface path, interface input field, field type, etc. The obtained interface information is filled into a custom automatic test framework template (the custom framework is a public automatic test framework template built in advance). A complete project automatic test framework is generated. The user only needs to fill in or modify the input data in the data-driven layer to complete the automatic test execution.

[0055] The automatic test framework triggering module triggers the distributed node machine to perform automatic testing and records the automatic test results. The automatic test framework triggering module has three triggering modes: manual triggering, timing triggering, and frequency triggering.

[0056] Specifically, the manual triggering, timing triggering, and frequency triggering trigger the distributed node machine to perform automatic testing and record the automatic test results, including reports, logs, and provide download functions; the distributed node machine belongs to the automatic test framework execution module.

[0057] The automatic test framework execution module performs automatic testing through the execution of the distributed node machine, and generates a test report for the actual execution process of the automatic test.

[0058] Specifically, the automatic test framework execution module is used for actual execution of the automatic test, generates a test report, and can shorten execution time and improve execution efficiency through a distributed node mode.

[0059] The user information storage and the execution information storage module store project information, user information in the project, user permissions, and project execution record information.

[0060] The automatic test framework integrated development environment includes an automatic test framework import submodule, an automatic test framework analysis submodule, and an automatic test framework display submodule.

[0061] The automatic test framework import submodule stores the project framework imported by the user, supports synchronous updating, and supports project group users to directly write code on the interface and share real-time code modification.

[0062] Specifically, the automatic test framework import submodule stores the Robotframework or Jmeter project framework imported by the user to the load balancing application server, the module supports gitlab synchronous updating, and also supports project group users to directly write code on the interface and share real-time code modification.

[0063] The automatic test framework analysis submodule analyzes the project source code and displays the project source code on the page.

[0064] Specifically, the automatic test framework analysis submodule analyzes the Robotframework or Jmeter project source code and displays the Robotframework or Jmeter project source code on the web page, and the display effect is the same as that of the desktop client.

[0065] The automatic test framework display submodule supports project group automatic test code sharing, real-time modification and saving of group members, and debugging.

[0066] The generated automatic test framework includes five layers, namely, a data-driven layer, a configuration file layer, a test case layer, a keyword layer, and a test result layer. The interface information is filled into the test case layer through the automatic test framework generation module; the data in the data-driven layer is filled or modified by the user and is referenced in the test case layer; the global variable is placed in the configuration file layer and is referenced in the test case layer; the sending keyword is placed in the keyword layer and is referenced in the test case layer; and the test execution result report is stored in the test result layer.

[0067] Specifically, the automatic test framework is automatically generated, and currently there is no related product that can realize it. The Robotframework automatic test framework generated by the platform contains five layers, which are data driven layer, configuration file layer, test case layer, keyword layer and test result layer. The five-layer automatic test framework belongs to a public automatic test framework template built in advance. The interface information is filled into the test case layer through the automatic test framework generation module. The user mainly fills in or modifies the data in the data driven layer, which will be referenced in the test case layer. The configuration file layer places global variables, generally using yaml file configuration, such as data driven layer file path, which is referenced in the test case layer. The keyword layer places the keywords of sending json, xml and other request format message interfaces, which are referenced in the test case layer. The test result layer stores the test execution result report.

[0068] That is, the user imports the Swagger file to generate the test case layer; the user configures the data driven layer; the configuration file layer and the keyword layer belong to the fixed template of the framework; and the test result layer generates the test execution result report according to the data driven layer, the configuration file layer, the test case layer and the keyword layer.

[0069] The embodiment of the application further discloses a use method of the automatic test platform benchmark library architecture.

[0070] The test project new creation step is that the user logs in the automatic test platform and creates a new automatic test project.

[0071] Specifically, the user logs in the automatic test platform, creates a new automatic test project, and includes filling in the project name and description, selecting the project type, uploading the swagger file, and uploading the swagger interface document.

[0072] The test project new creation step includes the following steps.

[0073] The interface document saving step is that the load balancing application server creates a new project folder and saves the swagger interface document.

[0074] The automatic test framework generation step is that the load balancing application server parses the swagger interface document, fills the interface information into the test case layer, and generates the automatic test framework.

[0075] The project member selection step is that the user clicks the member management in the automatic test framework integrated development environment and selects the project member.

[0076] The execution node adding step is that the user clicks the node management in the automatic test framework integrated development environment, inputs the execution node information including the node IP and the node execution path, and can add multiple execution nodes.

[0077] Starting Agent step: starting Agent on the execution node machine, and the Agent is connected with the load balancing application server. Specifically, starting Agent on the execution node machine; the Agent is connected with the load balancing application server, downloads the automatic test project and executes, and then uploads the execution result.

[0078] Running step: the user selects the automatic test project and the node, checks the test case, and clicks to run. The user selects the automatic test project in the test project new step, checks the test case, and clicks to run.

[0079] The running step includes the following steps:

[0080] Test project downloading step: the execution node machine downloads the automatic test project from the load balancing application server.

[0081] Command execution step: executing the automatic test framework command. The command is contained in the automatic test project framework.

[0082] Data uploading step: packaging and uploading the test result layer data to the load balancing application server.

[0083] As an important part of the Devops tool chain, the user should quickly respond to the test after submitting the code. The automatic test platform is opened to all project group users through the web mode, and can automatically generate the Robotframework interface automatic test framework, the project group automatically test code sharing, the real-time modification and saving of the group members, the debugging and execution of the automatic test code, and the saving of the automatic test execution result (test report).

[0084] The automatic test platform is currently widely used in the Devops tool chain, but the automatic test framework is currently developed locally, and lacks an online development environment. The automatic test framework IDE supports not only the local development and import, but also the online editing of the Robotframework code. The IDE environment is realistic to RIDE (Robotframework local development environment), the project group automatic test code sharing, the real-time modification and saving of the group members. Meanwhile, the Jmeter code online viewing code and execution are supported.

[0085] The automatic test platform of the present application parses the Robotframework and Jmeter code, and displays the web page, realizes the project group automatic test code sharing, and the real-time modification and saving of the group members; the automatic test platform of the present application generates a complete layered automatic test framework and performs distributed node execution.

[0086] The application realizes the mainstream open source automation test framework Robotframework, Jmeter web page viewing and editing, realizes project group automation test code sharing, and real-time modification and saving of group members.

[0087] The application realizes the mainstream open source automation test framework Robotframework, Jmeter web page viewing and editing, realizes project group automation test code sharing, and real-time modification and saving of group members.

[0088] Those skilled in the art know that, in addition to implementing the system provided by the application and each device, module and unit thereof in the form of pure computer readable program code, the system provided by the application and each device, module and unit thereof can also be implemented in the form of logic gate, switch, special integrated circuit, programmable logic controller and embedded microcontroller by logically programming the method steps to achieve the same function. Therefore, the system provided by the application and each device, module and unit thereof can be considered as a hardware component, and the devices, modules and units included therein for achieving various functions can also be considered as structures in the hardware component; the devices, modules and units for achieving various functions can also be considered as both software modules for achieving the method and structures in the hardware component.

[0089] The specific embodiments of the application are described above. It needs to be understood that the application is not limited to the specific embodiments described above, and those skilled in the art can make various changes or modifications within the scope of the claims, which does not affect the essential content of the application. The embodiments of the application and the features in the embodiments can be combined with each other in any way without conflict.

Claims

1. An automated test platform baseline library architecture, comprising: The automation test platform comprises an automatic test platform; The automatic test platform parses codes and displays pages, and shares project group automatic test codes, and members in the group modify and save in real time; The automatic test platform generates a hierarchical automatic test framework and performs distributed node execution; The automatic test platform comprises a load balancing application server; The load balancing application server comprises an automatic test framework integrated development environment, an automatic test framework generation module and an automatic test framework triggering module; The automatic test framework integrated development environment parses project framework specifications, displays platforms for different project frameworks, and detects project source file usage in real time, and modifies, saves and shares project group automatic test codes in real time; The automatic test framework generation module parses online interface documents, and generates project automatic test frameworks by using a self-defined automatic test framework template, and executes automatic tests by filling in input data; The automatic test framework triggering module triggers distributed node machines to execute automatic tests, and records automatic test results; The automatic test platform comprises a node execution server; The node execution server comprises an automatic test framework execution module; The automatic test framework execution module executes distributed node machines, performs distributed execution of automatic test frameworks, and generates test reports for actual automatic test execution processes; The automatic test framework integrated development environment comprises an automatic test framework import submodule, an automatic test framework analysis submodule and an automatic test framework display submodule; The automatic test framework import submodule stores project frameworks imported by users, supports synchronous updates, and supports project group users to directly write codes on the interface and share codes for real-time modification; The automatic test framework analysis submodule analyzes project source codes and displays project source codes on pages; The automatic test framework display submodule supports project group automatic test code sharing, real-time modification and saving of members in the group, and debugging.

2. The automated test platform reference library architecture of claim 1, wherein, The automatic test platform comprises a database server; The database server comprises a user information storage and an execution information storage module; The user information storage and the execution information storage module store project information, user information in the project, user permissions and project execution record information.

3. The automated test platform reference library architecture of claim 1, wherein, The generated automatic test framework comprises five layers, namely a data driving layer, a configuration file layer, a test case layer, a keyword layer and a test result layer; The interface information is filled into the test case layer by the automatic test framework generation module; The user fills in or modifies data in the data driving layer, which is referenced in the test case layer; The configuration file layer stores global variables, which are referenced in the test case layer; The keyword layer stores sending keywords, which are referenced in the test case layer; The test result layer stores test execution result reports.

4. The automated test platform reference library architecture of claim 1, wherein, The automatic test framework triggering module has three triggering modes: manual triggering, timing triggering and frequency triggering.

5. A method of using a benchmark library architecture for an automated test platform, the method comprising: The automatic test platform benchmark library architecture of any one of claims 1-4 comprises the following steps: The test project new creation step includes the following steps: Interface document saving step: the load balancing application server newly creates a project folder and saves the interface document; The automation test framework generation step includes the following steps: The running step includes the following steps:

6. The automated test platform reference library architecture use method of claim 5, wherein, Test project downloading step: the execution node machine downloads the automation test project from the load balancing application server; Command execution step: the automation test framework command is executed; Data uploading step: the test result layer data is packaged and uploaded to the load balancing application server.

7. The automated test platform reference library architecture use method of claim 5, wherein, ​ ​ ​ ​

Images