Automatic integration test system and method

Abstract

The invention discloses an automatic integrated testing system and method, and relates to the technical field of automatic testing, and the system comprises a management terminal which is used for managing an automatic testing system and a code integrated management server through a user UI interface, and comprises configuration modification, compiling triggering and automatic testing tasks; the code integrated management server is used for managing code submission, storage, code compilation and software version release, and comprises a code management service based on GIT, a code compilation release service based on LINUX and an integrated management service based on JENKIS; the automatic test system is used for realizing automation of software function test, and comprises automatic updating of equipment software versions, automatic configuration of network equipment in a test environment, automatic execution of test cases and statistics of test results. The problem that the efficiency of code obtaining, compiling, publishing and automatic testing in the software testing process is not high can be solved.

Description

Technical Field

[0001] The present application relates to the field of automated testing technology, and more specifically, to an automated integrated testing system and an automated integrated testing method. Background Art

[0002] Currently, the functional testing of device software is carried out manually. The specific process includes: (1) When the tester receives the test task, the tester needs to contact the R&D personnel to update the code, compile and release the software version; (2) After obtaining the software version, the tester sets up the test environment and updates the software version of the device; (3) According to the test case, each test case is manually tested to confirm the execution of each test case. The entire testing process has problems such as communication waiting, duplication of work and low efficiency of manual testing. Even if the R&D personnel make minor changes, the tester needs to repeat the above complete testing process, which is time-consuming, labor-intensive and inefficient. Especially when faced with the testing needs of batch equipment, the current manual testing process seems to be unable to cope with it. Summary of the invention

[0003] In view of at least one defect or improvement need in the prior art, the present invention provides an automated integrated testing system and method, aiming to solve the problem of low efficiency in code acquisition, compilation, publishing and automated testing during software testing.

[0004] To achieve the above-mentioned purpose, according to the first aspect of the present invention, there is provided an automated integrated testing system, comprising: a management terminal, used to manage the automated testing system and the code integration management server through the user UI interface, including modifying configuration, triggering compilation and automated testing tasks; a code integration management server, used to manage code submission, storage, code compilation and software version release, including GIT-based code management services, LINUX-based code compilation and release services, and JENKIS-based integration management services; an automated testing system, used to realize the automation of software functional testing, including automated updating of device software versions, automated configuration of network equipment in the test environment, automated execution of test cases and statistics of test results.

[0005] In one embodiment of the present invention, the management terminal includes: a UI interface for configuring and triggering automated testing tasks; and a control module for managing the configuration and task execution of the automated testing system and the code integration management server.

[0006] In one embodiment of the present invention, the code integration management server includes: a GIT-based code management service for implementing storage and version management of the code version library; a LINUX-based code compilation and publishing service for compiling C language code pulled from the GIT code library and generating an executable software version; a JENKIS-based integrated management service for implementing the integration of the GIT code management service and the code compilation and publishing service, and completing integrated services such as code update, code compilation and code publishing.

[0007] In one embodiment of the present invention, the automated testing system includes: a test environment configuration module for automatically configuring devices and network devices in the test environment; a test case execution module for automatically executing test cases; and a test result statistics module for generating a test report.

[0008] In one embodiment of the present invention, the automated testing system uses a technical combination of Selenium+Python+WEBDriver to implement automated functional testing of WEB-based software.

[0009] In one embodiment of the present invention, the code integration management server automatically performs code comparison, code compilation and software version release according to a scheduled task manually triggered or configured by a manager.

[0010] In one embodiment of the present invention, the automated testing system is triggered by scheduled tasks to implement software upgrades for batch devices, configuration of test devices and network devices, automatic execution of test cases, and generation of test reports.

[0011] According to the second aspect of the present invention, an automated integrated testing method is also provided, which includes: a management terminal manages an automated testing system and a code integration management server through a UI, including modifying configurations, triggering compilation and automated testing tasks; the code integration management server automatically compares codes, compiles codes and releases software versions according to scheduled tasks manually triggered or configured by management personnel; the automated testing system automatically executes test cases and generates test reports according to the established scheduled tasks.

[0012] According to the third aspect of the present invention, an electronic device is also proposed, comprising: a memory and one or more processors connected to the memory, the memory storing a computer program, and the processor being used to execute the computer program to implement a method for using an automated integrated testing system as described in any one of the above embodiments.

[0013] According to a fourth aspect of the present invention, a computer-readable storage medium is further provided, wherein the computer-readable storage medium stores computer-executable instructions for executing a method for using an automated integrated testing system as described in any one of the above embodiments.

[0014] In general, the above technical solutions conceived by the present invention can achieve the following beneficial effects compared with the prior art:

[0015] 1) For the communication and time costs caused by testers waiting for the software version, the integrated test system automatically compares and compiles the code and releases the software version through the code integration management server according to the scheduled tasks manually triggered or configured by the management personnel, thus reducing unnecessary communication and time costs and improving efficiency;

[0016] 2) GIT-based code management services can use GIT services to store and manage code version libraries; LINUX-based code compilation and release services can compile C language codes pulled from the GIT code library and generate executable software versions; JENKIS-based integrated management services can integrate GIT code management services and code compilation and release services by using JENKIS services, completing integrated services such as code updates, code compilation, and code release. Managers configure scheduled tasks to automate code updates, code compilation, and code release;

[0017] 3) In order to solve the problems of repetitive work such as setting up the test environment and updating the software version, as well as the low efficiency of manual testing, the integrated testing system uses the automated testing system to complete the software upgrade of batch equipment, the configuration of test equipment and network equipment, the automatic execution of test cases and the generation of test reports; the automated testing system uses the technical combination of Selenium+Python+WEBDriver to realize the automated functional testing of WEB-based software. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 A schematic diagram of the structure of the automated integrated test system provided in the embodiment of the present application;

[0020] Figure 2 A schematic diagram of the structure of the automated testing system provided in the embodiment of the present application;

[0021] Figure 3 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention;

[0022] Figure 4 A schematic diagram of the structure of a computer-readable storage medium provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0024] The terms "first", "second", "third", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0025] like Figure 1 The figure shows a schematic diagram of the composition architecture of the automated integrated testing system provided by the first embodiment of the present invention, and the system includes: a management terminal, a code integration management server, and an automated testing system. The management terminal mainly manages the automated testing system and the code integration management server through the user UI interface, such as modifying configurations, triggering compilation and automated testing tasks, etc. The code integration management server mainly manages code submission, storage, code compilation, and software version release, including GIT-based code management services, LINUX-based code compilation and release services, and JENKIS-based integrated management services. The automated testing system mainly realizes the automation of software functional testing, including automated updates of device software versions, automated configuration of network equipment in the test environment, automated execution of test cases, and statistics of test results.

[0026] Specifically, the management terminal includes a UI interface and a control module. The UI interface is used to configure and trigger automated test tasks; the control module is used to manage the configuration and task execution of the automated test system and the code integration management server.

[0027] Furthermore, in order to reduce the communication and time costs caused by testers waiting for software versions, the integrated testing system automatically compares and compiles codes and releases software versions through the code integration management server according to the scheduled tasks manually triggered or configured by the administrator, thereby reducing unnecessary communication and time costs and improving efficiency.

[0028] Furthermore, the GIT-based code management service can use the GIT service to store and manage the code version library; the LINUX-based code compilation and release service can compile the C language code pulled from the GIT code library and generate an executable software version; the JENKIS-based integrated management service can integrate the GIT code management service and the code compilation and release service by using the JENKIS service, and complete integrated services such as code update, code compilation and code release. Managers configure scheduled tasks to realize the automation of code update, code compilation and code release.

[0029] In order to solve the problems of repetitive labor such as setting up the test environment and updating the software version, as well as the low efficiency of manual testing, the integrated test system uses the automated test system to complete the software upgrade of batch equipment, the configuration of test equipment and network equipment, the automatic execution of test cases and the generation of test reports. Figure 2 As shown, the automated testing system includes a test environment configuration module, a test case execution module, and a test result statistics module. The test environment configuration module is used to automatically configure the devices and network devices in the test environment; the test case execution module is used to automatically execute the test cases; and the test result statistics module is used to generate a test report.

[0030] Furthermore, the automated testing system uses the technical combination of Selenium+Python+WEBDriver to achieve automated functional testing of WEB-based software.

[0031] The following is a detailed description of the workflow of the automated integrated testing system:

[0032] (1) R&D personnel update and submit code by calling GIT services in their daily work. GIT services manage submitted code in the form of a version library.

[0033] (2) The administrator or user of the automated integrated test system executes the integrated configuration by calling the JENKIS service. The configuration includes: code acquisition path, code compilation environment, code release path and scheduled tasks, etc. After the configuration is completed, the administrator can manually trigger or schedule tasks to trigger the comparison and acquisition of code versions, compilation and release of the code. The comparison and acquisition of the code is implemented by calling the GIT service according to the GIT path and parameters configured in JENKIS; the compilation and release of the code is implemented by calling the compiler and LINUX commands according to the compilation environment variables, compilation tool chain and release address in the configured LINUX environment. After executing the code update, compilation and version release, the software version will be automatically sent to the corresponding directory of the automated test system, which is convenient for the subsequent operation of the automated test system.

[0034] (3) The management personnel can control and configure the automated test system through the UI, and trigger the execution of the automated test system manually or by scheduled tasks. After the scheduled test task is set, the automated test system will start the automated test according to the time of the scheduled task. The automated test program first logs in to the device using the serial port dial-up, copies the software version generated in step (2) to the device, and automatically performs software upgrades and updates. After the software update is completed, the automated test program automatically configures the device, switch, and network tester according to the test case, and executes each test case in turn. After the case is executed, a test report is generated to facilitate subsequent testers to find problems.

[0035] Managers manage automated integration and testing by setting up scheduled tasks, and schedule the scheduled tasks of code acquisition and update, code compilation and release before the scheduled tasks of automated testing to ensure that the automated testing system uses the latest software version. In this way, managers only need to perform a small amount of configuration in the early stage to achieve complete automation of the entire integrated testing system, saving manpower and communication and improving testing efficiency. When faced with batch testing, it can work non-stop 24 hours a day, 7 days a week.

[0036] In this way, the automated integrated testing system proposed in the first embodiment of the present invention realizes the automated updating of codes, code compilation and the release of software versions through the code integration management service based on LINUX, GIT and JENKIS; the developed automated testing system can realize the automated execution of test cases, reduce manual intervention and improve testing efficiency; for the testing of batch equipment, since no manual intervention is required, it can run uninterruptedly 24 hours a day.

[0037] In addition, the second embodiment of the present invention also proposes a method for using an automated integrated testing system, including: step S1, the management terminal manages the automated testing system and the code integration management server through the UI, including modifying the configuration, triggering compilation and automated testing tasks; step S2, the code integration management server automatically compares the code, compiles the code and releases the software version according to the scheduled tasks manually triggered or configured by the administrator; step S3, the automated testing system automatically executes the test cases and generates a test report according to the established scheduled tasks.

[0038] In one embodiment, the code integration management server includes a GIT-based code management service, a LINUX-based code compilation and publishing service, and a JENKIS-based integration management service.

[0039] In one embodiment, the automated testing system uses a technical combination of Selenium+Python+WEBDriver to implement automated functional testing of WEB-based software.

[0040] In one embodiment, the automated testing system is triggered by scheduled tasks to implement software upgrades for batch devices, configuration of test devices and network devices, automatic execution of test cases, and generation of test reports.

[0041] In one embodiment, the code integration management server automatically compares and compiles codes and publishes software versions according to scheduled tasks manually triggered or configured by managers, thereby reducing unnecessary communication costs and time costs and improving efficiency.

[0042] It should be noted that the method for using the automated integrated test system provided in the second embodiment of the present invention is applicable to the automated integrated test system disclosed in the first embodiment, and the specific structure and function of the automated integrated test system are as described in the first embodiment, so they will not be described in detail here. The beneficial effects of this embodiment are the same as those of the first embodiment, and for the sake of brevity, they will not be repeated here.

[0043] like Figure 3 As shown, the third embodiment of the present invention further proposes an electronic device 30, for example, comprising: a memory 32 and one or more processors 31 connected to the memory 32, wherein the memory 32 stores a computer program, and when the computer program is executed by the processing unit, the processor 31 executes the method described in the second embodiment, and the beneficial effects of the electronic device 30 provided in this embodiment are the same as the beneficial effects of the method for using the automated integrated testing system provided in the second embodiment.

[0044] like Figure 4As shown, the fourth embodiment of the present invention further provides a computer-readable storage medium 40 on which a computer program is stored, and the program implements the steps of the above method when executed by a processor, and the beneficial effects of the computer-readable storage medium 40 provided by this embodiment are the same as the beneficial effects of the method for using the automated integrated testing system provided by the second embodiment.

[0045] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0046] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0047] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0048] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0049] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0050] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, disk or optical disk and other media that can store program code.

[0051] A person skilled in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by entering a program to instruct the relevant hardware. The program may be stored in a computer-readable memory, and the memory may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0052] The above is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure cannot be limited thereto. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the specification and practicing the disclosure here, those skilled in the art will easily think of the implementation scheme of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field not recorded in the present disclosure. The description and examples are regarded as exemplary only, and the scope and spirit of the present disclosure are defined by the claims.

[0053] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0054] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An automated integrated testing system, characterized in that: include: Management terminal, used to manage the automated test system and code integration management server through the user UI interface, including modifying configurations, triggering compilation and automated test tasks; Code integration management server, used to manage code submission, storage, code compilation and software version release, including GIT-based code management services, LINUX-based code compilation and release services, and JENKIS-based integrated management services; The automated testing system is used to automate software functional testing, including automated updates of device software versions, automated configuration of network devices in the test environment, automated execution of test cases, and statistics of test results.

2. The automated integrated testing system according to claim 1, characterized in that: The management terminal comprises: UI interface, used to configure and trigger automated testing tasks; The control module is used to manage the configuration and task execution of the automated test system and code integration management server.

3. The automated integrated testing system according to claim 1, characterized in that: The code integration management server includes: GIT-based code management service, used to implement code repository storage and version management; LINUX-based code compilation and publishing service, used to compile C language code pulled from the GIT code library and generate executable software versions; The integrated management service based on JENKIS is used to integrate GIT code management services and code compilation and release services, and complete integrated services such as code update, code compilation and code release.

4. The automated integrated testing system according to claim 1, characterized in that: The automated testing system comprises: Test environment configuration module, used to automatically configure devices and network devices in the test environment; Test case execution module, used to automatically execute test cases; Test result statistics module, used to generate test reports.

5. The automated integrated testing system according to claim 1, characterized in that: The automated testing system uses the technical combination of Selenium+Python+WEBDriver to implement automated functional testing of WEB-based software.

6. The automated integrated testing system according to claim 1, characterized in that: The code integration management server automatically performs code comparison, code compilation and software version release according to the scheduled tasks manually triggered or configured by the management personnel.

7. The automated integrated testing system according to claim 1, characterized in that: The automated testing system is triggered by scheduled tasks to achieve software upgrades for batch devices, configuration of test devices and network devices, automatic execution of test cases, and generation of test reports.

8. A method for using an automated integrated testing system, characterized in that: include: The management terminal manages the automated testing system and code integration management server through the UI, including modifying configurations, triggering compilation and automated testing tasks; The code integration management server automatically compares and compiles codes and releases software versions according to the scheduled tasks manually triggered or configured by the administrator; The automated testing system automatically executes test cases and generates test reports based on the set scheduled tasks.

9. An electronic device, characterized in that: include: A memory and one or more processors connected to the memory, the memory storing a computer program, and the processor being used to execute the computer program to implement the method for using the automated integrated testing system as claimed in claim 8. 10 . A computer-readable storage medium storing computer-executable instructions for executing the method for using the automated integrated test system according to claim 8 .

Images