Method for displaying detection result in real time in gridding manner for functional automation inspection system

Abstract

The invention relates to the technical field of function automation inspection, and discloses a method for displaying a detection result in real time in a gridding manner for a function automation inspection system. The system is composed of a function test subsystem, a communication control and data exchange control module, a function test engine and test machine group, a Web service subsystem, an inspection monitoring panel and the like. According to the scheme, the situation that various states / results in the inspection process can only be reflected through text description in a traditional test is changed. According to the scheme, the real inspection process can be displayed in real time, a user can see the real picture of each scene and function point in the inspection process in real time, what you see is what you get, errors occurring in the inspection process can be mastered in time, and the situation that in traditional inspection, written inspection results can be displayed only after inspection is completed is avoided; the problem that the function inspection process is monotonous, abstract and non-visual after the large software system is online is solved, and the whole-process display requirement of function inspection of the large software system is met.

Description

Technical Field

[0001] The present application relates to the technical field of automated functional inspection, and in particular to a method for displaying detection results of an automated functional inspection system in a grid-based real-time manner. Background Art

[0002] Currently, software systems put into operation, especially those with B / C / S (browser / client / server) structure, have many factors that may affect the normal operation of the system in the operating environment after deployment. These factors appear after the software system is delivered and deployed, and cannot be accurately predicted before release. Therefore, it is necessary to conduct regular or irregular functional inspections on the software systems put into operation after deployment, timely detect the working status of the system operation, discover potential problems before users encounter problems, and ensure normal use of the system. This requires a practical end-to-end automated testing method.

[0003] However, in actual applications, most conventional automated tests are interface tests based on API calls. Users can only see the text result description after the corresponding interface test is completed, such as success or failure. The test process and the actual UI changes during the process are not visible. This testing method is boring and abstract for users. Secondly, some UI-based automated testing frameworks can usually only display the test process and results of a single test job, and cannot centrally display the test process and results of multiple test jobs running concurrently.

[0004] Therefore, those skilled in the art provide a method for displaying detection results of a functional automated inspection system in a grid-like manner in real time to solve the problems raised in the above-mentioned background technology. Summary of the invention

[0005] In order to solve the problem proposed in the above background technology that users can only see the text result description after the corresponding interface test is completed, such as success or failure, and cannot see the test process and the actual UI changes in the process, this testing method is boring and abstract for users. Secondly, some UI-based automated testing frameworks can usually only display the test process and results of a single test job, and cannot centrally display the test process and results of multiple test jobs concurrently. This application provides a method for gridding and real-time display of detection results of a functional automated inspection system.

[0006] The present application provides a method for real-time display of test results in a grid-based automated inspection system, which adopts the following technical solution: the entire system is composed of a test scheduling control module, a functional test subsystem, a communication control and data exchange control module, a functional test engine and a test machine group, a Web service subsystem, an inspection monitoring panel, etc.;

[0007] S1: Test scheduling control: mainly performs operation scheduling control on application inspection jobs, loads test resources at specified time intervals, allocates functional test engines and test machine groups, and notifies relevant personnel based on inspection results and settings to achieve the test objectives set by the inspection system;

[0008] S2: Functional test subsystem: mainly completes the operation of various functional automation test scripts, is responsible for accepting various test automation scripts (such as Python scripts, Java programs, keyword scripts or executable programs / files with specific functions, etc.), completes the compilation work such as syntax and semantic checking of the corresponding protocol according to the script type, and converts it into an executable command sequence. According to the setting of the execution role, it is distributed to the corresponding test engine / test machine through the communication control and data exchange control module for execution, and the execution results are monitored in real time; the functional test module decides the next step to continue to execute the command sequence according to the test results and result settings, or returns the results to the test scheduling control to decide whether to trigger the recovery system action; all the results and execution logs of the functional test are transmitted to the Web subsystem for storage, and the report system generates various test data reports;

[0009] S3: Communication control and data exchange bus: It is the command and data transmission channel of each module. It is always in the monitoring state and receives various data (such as test commands, various events, etc.) forwarded to the bus by the latter;

[0010] S4: Functional test engine and test machine group: It consists of a group of test machines (or virtual machines) with different operating systems and different test engines installed. Each test machine (or virtual machine) is assigned an atvmuuid by the system. The test machine receives the test command, executes it locally, and transmits the execution result and execution log back to the upper control module through the data bus. Typically, this group of test machines (or virtual machines) are installed with various operating systems including Windows, Mac, Android, iOS, Linux, etc. and corresponding test support systems to complete specific test instructions.

[0011] S5: Web service submodule: provides Web services to users, which consists of inspection job management module, inspection monitoring panel, inspection report system and other modules;

[0012] S6: Inspection monitoring panel: Based on the functional test result data of the functional test subsystem completing the test job and the test process data returned by each functional test machine to the Web service submodule, the test process data is matched with the test machine scheduling data one by one, and the inspection process is displayed in a unified and centralized manner.

[0013] Preferably, the test scheduling control module notifies the functional test subsystem to start the test job, and the test scheduling control allocates automated test virtual machine resources to the functional test subsystem according to the test requirements.

[0014] Preferably, the functional testing subsystem starts the functional testing job and distributes the functional testing script to each automated testing machine under the functional testing machine group through the communication control and data exchange control module.

[0015] Preferably, each automated test machine executes the assigned functional test script to complete the test required by the functional inspection. Each test machine has a unique identification number atvmuuid. The test machine group returns the process data of each test machine executing the test script together with the atvmuuid of the test machine to the test scheduling control module and the Web service subsystem through the communication control and data exchange bus; its typical data format is designed as follows (expressed in json format):

[0016] {

[0017] "atvmuuid":"atvmUuid1",

[0018] "errorCode":0,

[0019] "keywordMessage":"The expected_attribute is valid.",

[0020] "executeDuration":6533,

[0021] "keywordType":"functionpoint",

[0022] "method":"click",

[0023] "parameter":"name=Homepage test,timeout=20",

[0024] "renderTime":2180,

[0025]

[0026] Preferably, the monitoring panel initializes the sub-panel according to the list of the returned test machine groups, and the sub-panel corresponds to the test machines of the test machine group one by one through atvmuuid.

[0027] Preferably, each monitoring sub-panel completes the one-to-one correspondence with the test process data returned by each test machine through atvmuuid, and completes the process display of the test scripts run by different test machines. Its typical data format is designed as follows (expressed in json format):

[0028]

[0029] In summary, this application includes the following beneficial technical effects:

[0030] 1. This solution changes the traditional test that can only use text descriptions to reflect the various states / results of the inspection process. This solution can display the real inspection process in real time. Users can see the real pictures of each scene and function point in the inspection process in real time. What you see is what you get. Errors that occur during the inspection process can be grasped in time, instead of the traditional inspection that can only be presented after the inspection is completed.

[0031] 2. This solution focuses on the fact that inspections of large software systems require multiple automated test virtual machines to perform inspections simultaneously, and displays multiple test operations in a centralized manner. Through the unified management of automated test virtual machines, the test processes of multiple automated test virtual machines can be centralized in one interface for unified display, allowing for more effective global monitoring of the inspection process.

[0032] 3. This solution solves the problem that the functional inspection process of large-scale software systems after they are put into operation is monotonous, abstract and non-intuitive, and is used to realize the full process display requirements of functional inspection of large-scale software systems.

[0033] 4. The inspection process is visualized, making it easy for users to monitor the inspection results.

[0034] 5. Effective organization and management of inspection process display, grid display.

[0035] 6. The inspection process is presented in various forms, including pictures and videos. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 It is a schematic diagram of the main functional components of a method for real-time display of detection results in a grid-based functional automation inspection system in an embodiment of the present application (for a B / C / S structure);

[0037] Figure 2 It is a schematic diagram of the functional composition of a monitoring panel of a method for grid-based real-time display of detection results of a functional automated inspection system in an embodiment of the present application. DETAILED DESCRIPTION

[0038] The following will be combined with the attached Figure 1-2The technical solution of the present invention is described clearly and completely. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0039] The present application embodiment discloses a method for displaying detection results of a functional automated inspection system in a grid-based real-time manner, referring to Figure 1-2 ,The whole system is composed of test scheduling control module, ,functional test subsystem, communication control and data exchange control module, ,functional test engine and test machine group, Web service subsystem, ,inspection monitoring panel, etc.;

[0040] S1: Test scheduling control: mainly performs operation scheduling control on application inspection jobs, loads test resources at specified time intervals, allocates functional test engines and test machine groups, and notifies relevant personnel based on inspection results and settings to achieve the test objectives set by the inspection system;

[0041] S2: Functional test subsystem: mainly completes the operation of various functional automation test scripts, is responsible for accepting various test automation scripts (such as Python scripts, Java programs, keyword scripts or executable programs / files with specific functions, etc.), completes the compilation work such as syntax and semantic checking of the corresponding protocol according to the script type, and converts it into an executable command sequence. According to the setting of the execution role, it is distributed to the corresponding test engine / test machine through the communication control and data exchange control module for execution, and the execution results are monitored in real time; the functional test module decides the next step to continue to execute the command sequence according to the test results and result settings, or returns the results to the test scheduling control to decide whether to trigger the recovery system action; all the results and execution logs of the functional test are transmitted to the Web subsystem for storage, and the report system generates various test data reports;

[0042] S3: Communication control and data exchange bus: It is the command and data transmission channel of each module. It is always in the monitoring state and receives various data (such as test commands, various events, etc.) forwarded to the bus by the latter;

[0043] S4: Functional test engine and test machine group: It consists of a group of test machines (or virtual machines) with different operating systems and different test engines installed. Each test machine (or virtual machine) is assigned an atvmuuid by the system. The test machine receives the test command, executes it locally, and transmits the execution result and execution log back to the upper control module through the data bus. Typically, this group of test machines (or virtual machines) are installed with various operating systems including Windows, Mac, Android, iOS, Linux, etc. and corresponding test support systems to complete specific test instructions.

[0044] S5: Web service submodule: provides Web services to users, which consists of inspection job management module, inspection monitoring panel, inspection report system and other modules;

[0045] S6: Inspection monitoring panel: Based on the functional test result data of the functional test subsystem completing the test job and the test process data returned by each functional test machine to the Web service submodule, the test process data is matched with the test machine scheduling data one by one, and the inspection process is displayed in a unified and centralized manner.

[0046] In the present application, the test scheduling control module notifies the functional test subsystem to start the test job, and the test scheduling control allocates automated test virtual machine resources to the functional test subsystem according to the test requirements.

[0047] In the present application, the functional test subsystem starts the functional test job and distributes the functional test script to each automated test machine under the functional test machine group through the communication control and data exchange control module.

[0048] In this application, each automated test machine executes the assigned functional test script to complete the test required by the functional inspection. Each test machine has a unique identification number atvmuuid. The test machine group returns the process data of each test machine executing the test script together with the atvmuuid of the test machine to the test scheduling control module and the Web service subsystem through the communication control and data exchange bus; its typical data format design is as follows (expressed in json format):

[0049] {

[0050] "atvmuuid":"atvmUuid1",

[0051] "errorCode":0,

[0052] "keywordMessage":"The expected_attribute is valid.",

[0053] "executeDuration":6533,

[0054] "keywordType":"functionpoint",

[0055] "method":"click",

[0056] "parameter":"name=Homepage test,timeout=20",

[0057] "renderTime":2180,

[0058] "screen":true,

[0059] "screenPath":

[0060] " / pic / 2023 / 12 / 27 / ac27a26fe13e4d9cac51f521fdcc39ff / ea464c8a-a468-11ee-a56a-0242c0a8027b.png",

[0061]

[0062] In the present application, the monitoring panel initializes the sub-panel according to the list of the returned test groups, and the sub-panel corresponds to the test machines of the test group one by one through atvmuuid.

[0063] In this application, each monitoring sub-panel completes the one-to-one correspondence with the test process data returned by each test machine through atvmuuid, and completes the process display of the test scripts run by different test machines. Its typical data format is designed as follows (expressed in json format):

[0064]

[0065] The implementation principle of the method for gridding and real-time display of detection results of a functional automated inspection system in the embodiment of the present application is as follows: it uses end-to-end automated testing technology and automated testing virtual machine technology, and through the combination of the two to work together, a complete and general software system function inspection process grid display is constructed to achieve the visualization, diversification and integration of the inspection process after the large-scale software system is put into operation; due to the complexity of its functions, large-scale software systems will bring about problems such as a large number of test cases, complexity, and long testing time. During the inspection process, multiple test jobs are run at the same time, and traditional test frameworks and manual testing methods cannot guarantee a comprehensive and intuitive control of the process and results of the functional detection of each software system module. There is currently no mature technical solution or product on the market for the solution of the functional automated inspection system. There are only some software automated testing frameworks that perform some basic functional verification based on user interface (API) calls. This kind of test is very unintuitive for users. Users can only see the textual description of the test results of the test job, such as success / failure, and some brief textual descriptions returned by the interface; or some UI-based test frameworks that can display the test process and results of a single test job. This technical solution focuses on solving the process and result display of functional inspection of large software systems in the operation and maintenance stage. Its purpose is to provide an intuitive display of the inspection process and a centralized display of the inspection process.

[0066] Finally, a few points should be explained: First, in the description of this application, it should be noted that, unless otherwise specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, which may refer to mechanical connection or electrical connection, or internal communication between two components, or direct connection. "upper", "lower", "left", "right", etc. are only used to indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may change;

[0067] Secondly: In the drawings of the embodiments disclosed in the present invention, only the structures involved in the embodiments disclosed in the present invention are involved, and other structures can refer to the usual design. In the absence of conflict, the same embodiment and different embodiments of the present invention can be combined with each other.

Claims

1. A method for displaying detection results of a functional automated inspection system in real time in a grid-based manner, characterized in that: The whole system consists of test scheduling control module, functional test subsystem, communication control and data exchange control module, functional test engine and test machine group, Web service subsystem, inspection monitoring panel, etc. S1: Test scheduling control: mainly performs operation scheduling control on application inspection jobs, loads test resources at specified time intervals, allocates functional test engines and test machine groups, and notifies relevant personnel based on inspection results and settings; S2: Functional test subsystem: mainly completes the operation of various functional automation test scripts, is responsible for accepting various test automation scripts (such as Python scripts, Java programs, keyword scripts or executable programs / files with specific functions, etc.), completes the compilation work such as syntax and semantic checking of the corresponding protocol according to the script type, and converts it into an executable command sequence. According to the setting of the execution role, it is distributed to the corresponding test engine / test machine through the communication control and data exchange control module for execution, and the execution results are monitored in real time; the functional test module decides the next step to continue to execute the command sequence according to the test results and result settings, or returns the results to the test scheduling control to decide whether to trigger the recovery system action; all the results and execution logs of the functional test are transmitted to the Web subsystem for storage, and the report system generates various test data reports; S3: Communication control and data exchange bus: It is the command and data transmission channel of each module. It is always in the monitoring state and receives various data (such as test commands, various events, etc.) forwarded to the bus by the latter; S4: Functional test engine and test machine group: It consists of a group of test machines (or virtual machines) with different operating systems and different test engines installed. Each test machine (or virtual machine) is assigned an atvmuuid by the system. The test machine receives the test command, executes it locally, and transmits the execution result and execution log back to the upper control module through the data bus. Typically, this group of test machines (or virtual machines) are installed with various operating systems including Windows, Mac, Android, iOS, Linux, etc. and corresponding test support systems to complete specific test instructions; S5: Web service submodule: provides Web services to users, which consists of inspection job management module, inspection monitoring panel, inspection report system and other modules; S6: Inspection monitoring panel: Based on the functional test result data of the functional test subsystem completing the test job and the test process data returned by each functional test machine to the Web service submodule, the test process data is matched with the test machine scheduling data one by one, and the inspection process is displayed in a unified and centralized manner.

2. The method for displaying detection results of a functional automation inspection system in a grid-based real-time manner according to claim 1, characterized in that: The test scheduling control module notifies the functional test subsystem to start the test job, and the test scheduling control allocates automated test virtual machine resources to the functional test subsystem according to the test requirements.

3. The method for displaying detection results of a functional automation inspection system in a grid-based real-time manner according to claim 1, characterized in that: The functional test subsystem starts the functional test job and distributes the functional test script to each automated test machine under the functional test machine group through the communication control and data exchange control module.

4. The method for displaying detection results of a functional automation inspection system in a grid-based real-time manner according to claim 1, characterized in that: Each automated test machine executes the assigned functional test script to complete the test required by the functional inspection. Each test machine has a unique identification number atvmuuid. The test machine group returns the process data of each test machine executing the test script together with the atvmuuid of the test machine to the test scheduling control module and the Web service subsystem through the communication control and data exchange bus; its typical data format is designed as follows (expressed in json format): { "atvmuuid":"atvmUuid1", "errorCode":0, "keywordMessage":"The expected_attribute is valid.", "executeDuration":6533, "keywordType":"functionpoint", "method":"click", "parameter":"name=Homepage test,timeout=20", "renderTime":2180, "screen":true, "screenPath": " / pic / 2023 / 12 / 27 / ac27a26fe13e4d9cac51f521fdcc39ff / ea464c8a-a468-11ee-a56a-0242c0a8027b.png", "testObject":"HZJL", "timeStamp":1703648097641846548 }。 5. The method for displaying detection results of a functional automation inspection system in a grid-based real-time manner according to claim 1, characterized in that: The monitoring panel initializes the sub-panel according to the list of the returned test machine groups, and the sub-panel corresponds to the test machines of the test machine group one by one through atvmuuid.

6. The method for displaying detection results of a functional automation inspection system in a grid-based real-time manner according to claim 1, characterized in that: Each monitoring sub-panel completes the one-to-one correspondence with the test process data returned by each test machine through atvmuuid, and completes the process display of the test scripts run by different test machines. Its typical data format is designed as follows (expressed in json format): { atvmuuid:"atvmUuid1", screenPath: " / pic / 2023 / 12 / 27 / ac27a26fe13e4d9cac51f521fdcc39ff / ea464c8a-a468-11ee-a56a-0242c0a8027b.png", status:0 }。

Images