Function test implementation and monitoring method and device, equipment and medium

Abstract

The invention provides a function test implementation and monitoring method which can be applied to the field of information security or the field of big data. The method comprises the following steps: in response to change of functions of a business system, identifying and acquiring a corresponding transaction code to be tested in a test range; establishing a test domain, and importing the transaction code to be tested into the test domain; responding to the modification of the interface related to the change content, associating a corresponding transaction line and a data line according to the to-be-tested transaction code to obtain test data of the test domain, and compiling a test case according to the test data; the test case is executed in an automatic test framework, manual testing is synchronously carried out, a test result is obtained, and the automatic test framework is deeply integrated with a case library and a defect library; and generating a test report according to the test result. The invention further provides a function test implementation and monitoring device, equipment, a storage medium and a program product.

Description

Technical Field

[0001] The present disclosure relates to the field of information security or big data, and more specifically to a method, device, equipment, medium and program product for implementing and monitoring functional testing. Background Art

[0002] With the rapid development of technology, enterprises are constantly upgrading their networks, applications, and terminals to improve efficiency and security. However, such projects often face challenges due to technical complexity, unclear requirements, and the diversity of software and hardware infrastructure. In particular, it is difficult to accurately assess the impact on business continuity at the beginning of the project, which requires comprehensive regression testing to ensure system stability and reliability. However, full regression testing not only has a wide range of testing, covering all the main bodies and important functions of the system, but also has a considerable testing workload, which leads to the need to consume a large amount of testing resources. The acquisition, configuration, and maintenance of these resources require a lot of time and cost. Summary of the invention

[0003] In view of the above problems, embodiments of the present disclosure provide a method, apparatus, device, medium and program product for implementing and monitoring a functional test.

[0004] According to a first aspect of the present disclosure, a method for implementing and monitoring functional testing is provided, the method comprising: in response to a change to a function of a business system, identifying and acquiring a corresponding transaction code to be tested within a test scope; establishing a test domain, and importing the transaction code to be tested into the test domain; in response to the change involving modification of an interface, associating corresponding transaction lines and data lines according to the transaction code to be tested, obtaining test data for the test domain, and writing test cases according to the test data; executing the test cases in an automated testing framework, and simultaneously performing manual testing to obtain test results, wherein the automated testing framework is deeply integrated with a case library and a defect library; and generating a test report based on the test results.

[0005] According to an embodiment of the present disclosure, the method further includes: in response to the change content not involving modification of the interface, using the transaction code to be tested as test data of the test domain.

[0006] According to an embodiment of the present disclosure, in response to a change in the function of a business system, identifying and obtaining the corresponding transaction code to be tested within the test range includes: in response to a change in the function of the business system, identifying the full amount of transaction codes stored on the server of the business system and analyzing and screening them to determine the range of the transaction code to be tested; judging whether the change in the function of the business system involves an interface change of the server; and when it involves an interface change of the server, automatically determining the range of the transaction line and the data line based on the range of the transaction code to be tested, and incorporating the range of the transaction line and the data line into the test range to obtain the updated transaction code to be tested within the test range.

[0007] According to an embodiment of the present disclosure, the method also includes: selecting at least one test environment in the test domain, and determining the time and frequency of executing the test, and the time period for monitoring the test; and configuring the test environment according to the determined time and frequency of executing the test, and monitoring the execution process of the test in real time during the monitoring time period.

[0008] According to an embodiment of the present disclosure, in response to the change content involving the modification of the interface, the transaction line and the data line corresponding to the transaction code to be tested are associated to obtain the test data of the test domain, and the test case is written according to the test data, including: in response to the change content involving the modification of the interface, the transaction line and the data line associated with the transaction code to be tested are automatically identified and determined; based on the transaction line, the interface to be modified is obtained; and the transaction line, the data line and the interface to be modified are verified to obtain the test data of the test domain, and a test case is written according to the test data.

[0009] According to an embodiment of the present disclosure, the test case is executed in an automated testing framework, and manual testing is performed simultaneously to obtain test results, wherein the automated testing framework is deeply integrated with a case library and a defect library to include: checking the coverage of the transaction code to be tested for the test case, and determining that the coverage reaches a preset test coverage; in response to automated testing of the test case, automated testing is performed in an automated testing framework using an integrated testing tool, and automated testing results are saved; in response to manual testing of the test case, a test page is screenshotted and identified, and manual testing results are recorded; and the automated testing results and the manual testing results are merged to obtain the final test results.

[0010] According to an embodiment of the present disclosure, the test case is executed in an automated testing framework, and manual testing is performed simultaneously to obtain test results, wherein the automated testing framework is deeply integrated with a case library and a defect library and further includes: calling predefined test cases in the case library to execute the test cases in the automated testing framework; and in response to defect information being discovered when executing the test case in the automated testing framework, automatically submitting the defect information to the defect library and associating it with the corresponding test case.

[0011] According to an embodiment of the present disclosure, the method further includes: determining whether the test result meets a preset test standard; and when the test result does not meet the preset test standard, providing a corresponding early warning prompt based on the test result.

[0012] The second aspect of the present disclosure provides an implementation and monitoring device for functional testing, the device comprising: an acquisition module, for identifying and acquiring a corresponding transaction code to be tested within a test scope in response to a change to a function of a business system; an import module, for establishing a test domain, and importing the transaction code to be tested into the test domain; an association module, for associating corresponding transaction lines and data lines according to the transaction code to be tested in response to a change involving modification of an interface, obtaining test data for the test domain, and writing test cases according to the test data; a test module, for executing the test case in an automated test framework, and performing manual testing simultaneously to obtain test results, wherein the automated test framework is deeply integrated with a case library and a defect library; and a generation module, for generating a test report according to the test results.

[0013] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.

[0014] The fourth aspect of the present disclosure further provides a computer-readable storage medium having a computer program or instructions stored thereon, which implements the steps of the above method when the above computer program or instructions are executed by a processor.

[0015] The fifth aspect of the present disclosure further provides a computer program product, including a computer program or instructions, which implement the steps of the above method when the above computer program or instructions are executed by a processor.

[0016] According to the implementation and monitoring methods, devices, equipment, media and program products of functional testing provided by the embodiments of the present disclosure, by integrating the case library and defect library in the automated testing framework and deeply integrating with the common functions, it is possible to carry out process-based and complete test management from the early stage of the project, ensuring the automation and orderliness of the test activities and reducing the test risks caused by process confusion or omissions. Automated testing significantly reduces the burden on testers and improves testing efficiency, while manual testing can supplement scenarios that cannot be covered by automated testing, improving the comprehensiveness and accuracy of the test. In addition, the test results are reflected in the test report in real time, allowing testers to obtain immediate feedback and quickly adjust the test strategy. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above contents and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0018] Figure 1 A diagram schematically illustrates an application scenario of a method, apparatus, device, medium, and program product for implementing and monitoring a functional test according to an embodiment of the present disclosure;

[0019] Figure 2 A flowchart schematically shows a method for implementing and monitoring a functional test according to an embodiment of the present disclosure;

[0020] Figure 3 Another flow chart schematically illustrates a method for implementing and monitoring a functional test according to an embodiment of the present disclosure;

[0021] Figure 4 A block diagram schematically shows a structure of a device for implementing and monitoring a functional test according to an embodiment of the present disclosure; and

[0022] Figure 5 A block diagram of an electronic device suitable for implementing a method for implementing and monitoring a functional test according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0023] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0024] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0025] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0026] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0027] It should be noted that the implementation and monitoring methods and devices of the functional tests determined in the present invention can be used in the financial field, information security or big data field, and can also be used in any field other than the financial field. The application field of the implementation and monitoring methods and devices of the functional tests disclosed in the present invention is not limited.

[0028] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.

[0029] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0030] In the scenario of using personal information for automated decision-making, the methods, devices, and systems provided by the embodiments of the present disclosure provide users with corresponding operation portals for users to choose to agree or reject the automated decision-making results; if the user chooses to reject, the expert decision-making process will be entered. The expression "automated decision-making" here refers to the activity of automatically analyzing and evaluating a person's behavioral habits, interests and hobbies, or economic, health, credit status, etc. through computer programs, and making decisions. The expression "expert decision-making" here refers to the activity of making decisions by people who specialize in a certain field, have specialized experience, knowledge and skills, and have reached a certain level of professionalism.

[0031] Embodiments of the present disclosure provide a method, apparatus, device, medium, and program product for implementing and monitoring a functional test.

[0032] Figure 1 The application scenario diagram of the implementation and monitoring method, apparatus, device, medium and program product of the functional test according to the embodiment of the present disclosure is schematically shown.

[0033] like Figure 1 As shown, the application scenario 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used to provide a medium for communication links between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0034] The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).

[0035] The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0036] The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.

[0037] It should be noted that the implementation and monitoring method of the functional test provided in the embodiment of the present disclosure can generally be performed by the server 105. Accordingly, the implementation and monitoring device of the functional test provided in the embodiment of the present disclosure can generally be set in the server 105. The implementation and monitoring method of the functional test provided in the embodiment of the present disclosure can also be performed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Accordingly, the implementation and monitoring device of the functional test provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105.

[0038] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0039] The following will be based on Figure 1 The scene described by Figure 2 and Figure 3 The implementation and monitoring method of the functional test of the embodiment of the present disclosure is described in detail.

[0040] Figure 2 The flowchart schematically shows a method for implementing and monitoring a functional test according to an embodiment of the present disclosure.

[0041] like Figure 2 As shown, the method for implementing and monitoring the functional test of this embodiment includes operations S210 to S250.

[0042] In operation S210, in response to a change in a function of the business system, a corresponding transaction code to be tested within a test range is identified and acquired.

[0043] In an embodiment of the present disclosure, before obtaining the corresponding transaction code to be tested within the test range, the user's consent or authorization may be obtained. For example, before operation S210, a request to obtain the corresponding transaction code to be tested within the test range may be issued to the user. When the user agrees or authorizes that the corresponding transaction code to be tested within the test range can be obtained, the operation S210 is performed.

[0044] In operation S220, a test domain is established, and the transaction code to be tested is imported into the test domain.

[0045] In operation S230, in response to the change content involving the modification of the interface, the transaction line and the data line corresponding to the transaction code to be tested are associated, the test data of the test domain is obtained, and a test case is written according to the test data.

[0046] In operation S240, the test case is executed in an automated testing framework, and manual testing is performed simultaneously to obtain a test result, wherein the automated testing framework is deeply integrated with a case library and a defect library.

[0047] In the embodiments of the present disclosure, a corresponding operation entry may be provided for the user to choose to agree or reject the automated decision result. That is, before the automated test and manual test processing / decision are performed, the user may obtain the instruction of agreeing or rejecting the processing / decision input through the corresponding operation entry. If the user agrees to perform the processing / decision, the automated test and manual test processing / decision are performed, that is, step S240 is executed. If the user rejects the processing / decision, the expert decision process is entered.

[0048] In operation S250, a test report is generated according to the test result.

[0049] Figure 3 Another flow chart of a method for implementing and monitoring a functional test according to an embodiment of the present disclosure is schematically shown.

[0050] In some exemplary embodiments, Figure 3 As shown, first formulate the test standard, then determine the transaction code range after manual analysis based on the full transaction code on the upgrade server, the system automatically determines the transaction line and data line range to obtain the transaction code to be tested within the test range, and then establish the test domain according to the task, import the determined transaction code, and the system associates the transaction line and data line to form the monitoring basic data (test data), and then write test cases based on the test data to perform automated testing and manual testing. When a cycle of testing work is completed, it supports the issuance of a test report and reviews whether the test report can pass according to the test standards. The passed test report is signed by the relevant personnel and sent to the software and network upgrade implementation personnel as the basis for implementation.

[0051] Exemplarily, the test standards are as follows: the transaction code test coverage reaches 100%; the test case execution rate covering the transaction line is 100%, and the pass rate is 100%; the test case execution rate covering the data line is 100%, and the pass rate is 100%.

[0052] It is understandable that by automatically responding to functional changes in the business system and immediately obtaining the relevant transaction codes to be tested, the workload of manual identification and screening is reduced, and work efficiency is significantly improved. At the same time, the process of automated testing in the automated testing framework reduces human errors, improves the accuracy and repeatability of the test, and combined with manual testing, in-depth verification can be performed for complex scenarios or special situations to supplement the scenarios that cannot be covered by automated testing, ensuring that the test results are more reliable.

[0053] In an embodiment of the present disclosure, the method further includes: in response to the change content not involving modification of the interface, using the transaction code to be tested as test data of the test domain.

[0054] Specifically, when the changes do not involve modification of the interface, it means that the changes are mainly concentrated on business logic or internal processing flow, and do not directly affect the data interaction with the external system. In this case, a more direct and efficient data processing method is adopted, and the transaction code to be tested is directly used as the test data of the test domain.

[0055] It is understandable that when the change does not involve interface modification, the transaction code to be tested is directly used as test data, that is, the test strategy is automatically adjusted according to different change types. While ensuring the test effect, it can further optimize the test process, improve the test efficiency, and make the test more flexible and adaptable.

[0056] Furthermore, in response to a change in the function of the business system, identifying and obtaining the corresponding transaction code to be tested within the test range includes: in response to the change in the function of the business system, identifying the full amount of transaction codes stored on the server of the business system and analyzing and screening them to determine the range of the transaction code to be tested; judging whether the change in the function of the business system involves an interface change of the server; and when it involves an interface change of the server, automatically determining the range of the transaction line and the data line based on the range of the transaction code to be tested, and incorporating the range of the transaction line and the data line into the test range to obtain the updated transaction code to be tested within the test range.

[0057] Specifically, at the beginning of the project, a meeting is organized to determine the scope of transaction codes involved in software, network, etc. upgrades, which are issued by the project team, and after joint review, a text document is formed and imported into the test management system as the basic data of the test scope (transaction code to be tested). Then, based on the upgrade content, it is evaluated whether the interface modification is involved. If it is involved, the interface standardization assets are used to evaluate whether it involves the modification of the external system, and finally the scope and content of the interface modification are determined. According to the scope of the interface modification, the data line test scope is determined through the data line assets as the standard for data line test monitoring. At the same time, if the interface modification is involved after the evaluation, the transaction line assets are selected, and according to the determined transaction code, the upstream and downstream transactions are found through the transaction line architecture assets, and the transaction line scope involved in this modification is determined as the standard for transaction line test monitoring, and finally the transaction code to be tested within the updated test scope is obtained. In addition, if the interface modification is not involved after the evaluation, the test scope of the project only includes the transaction code.

[0058] It is understandable that, according to whether the interface has been changed or not, the scope of transaction lines and data lines is automatically determined and included in the test scope, so as to comprehensively evaluate the scope and content of the interface modification, ensure that the test covers all relevant data lines and transaction lines, and make the test work more focused on the actual affected system components, thereby improving the pertinence and effectiveness of the test. For projects that do not involve interface changes, the test scope is directly limited to the transaction code, further simplifying the test process.

[0059] In an embodiment of the present disclosure, the method also includes: selecting at least one test environment in the test domain, and determining the time and frequency of executing the test, and the time period for monitoring the test; and configuring the test environment according to the determined time and frequency of executing the test, and monitoring the execution process of the test in real time during the monitoring time period.

[0060] Specifically, first, according to the specific content and scope of the upgrade, a comprehensive evaluation of each candidate test environment is conducted, taking into account factors including but not limited to the stability of the environment, resource adequacy, similarity with the production environment, and security of data isolation. If the upgrade involves multiple interrelated systems or components, and these systems or components are deployed in different environments, it may be necessary to select multiple environments for testing at the same time to more comprehensively simulate the actual operation scenario, ensure the comprehensiveness and accuracy of the test results, and display the results by environment when analyzing the test results. After determining the test environment, the execution time and frequency of the test are reasonably arranged according to the urgency of the upgrade and the availability of test resources. For example, for urgent and important upgrades, overtime testing is arranged or the test frequency is increased to ensure that problems can be discovered and resolved in a timely manner. At the same time, it is also necessary to avoid testing too frequently to affect the normal operation of the business. In addition, in order to ensure the validity and comparability of the test results, a clear test and monitoring time period needs to be set, during which all relevant test activities will be recorded and analyzed, and the monitoring system should also be kept open during this time period to promptly discover and handle problems that arise during the test process.

[0061] It is understandable that by selecting the test environment, it is possible to ensure that the testing work is carried out directly on the core areas of the upgrade and renovation, avoiding ineffective testing in irrelevant or low-priority environments. At the same time, the test environment is configured so that the testing work can be carried out in an orderly manner, without wasting resources due to too frequent testing, and without missing problems due to too long test intervals. In addition, real-time monitoring of the test execution process during the monitoring time period helps to quickly locate the root cause of the problem, improve the accuracy and reliability of the test, and ensure the integrity and consistency of the test data to avoid test failures due to data loss or damage.

[0062] Furthermore, in response to the change content involving the modification of the interface, obtaining the test data of the test domain according to the transaction line and data line corresponding to the transaction code to be tested includes: in response to the change content involving the modification of the interface, automatically identifying and determining the transaction line and data line associated with the transaction code to be tested; based on the transaction line, obtaining the interface to be modified; and verifying the transaction line, the data line and the interface to be modified to obtain the test data of the test domain, and writing a test case based on the test data.

[0063] Specifically, first clarify the name, purpose, scope and expected results of the test domain, establish the test domain, and then enter the test plan in detail in the test domain, including test objectives, test strategies, test methods and test resource allocation. At the same time, set a clear test cycle, including start time, end time and key milestones. Then closely associate the test domain with the development center involved to ensure that the test requirements can be accurately conveyed to the development team, and the development team can respond to test feedback in a timely manner. After the test domain is established and initialized, the transaction code baseline (the transaction code to be tested and its related information) is imported, and then the imported transaction code is automatically matched to the corresponding development center and functional component using the system's built-in matching algorithm. Then, according to the project requirements and upgrade content, evaluate whether interface modification is involved. If it is involved, enter the next step of detailed analysis, that is, according to the flow direction and logical relationship of the transaction line, determine which subsequent interfaces may be affected; if it is not involved, skip this step directly. In order to cover the test scope more comprehensively, the system automatically determines the scope of the transaction line and data line based on the imported transaction code. Specifically, based on the dependencies and call chains between transaction codes, the system automatically identifies all relevant transaction lines, analyzes the data flows involved in the transaction process, and determines which data lines (such as database tables, files, message queues, etc.) need to be included in the test scope. Finally, the project team verifies and confirms the transaction lines, data lines, and interfaces automatically determined by the system, obtains the test data within the entire scope of this test monitoring, and writes test cases based on the test data obtained.

[0064] It is understandable that by automatically identifying and determining the transaction lines and data lines associated with the transaction code to be tested, the business process and data flow path that the test needs to focus on can be accurately located, which helps reduce human errors and improve the accuracy and reliability of the test. At the same time, based on these accurate transaction lines and data lines, it is possible to more accurately identify which interfaces need to be modified, thereby ensuring the comprehensiveness of the test.

[0065] Furthermore, the test case is executed in the automated testing framework, and manual testing is performed simultaneously to obtain test results, wherein the automated testing framework is deeply integrated with the case library and the defect library to include: checking the coverage of the transaction code to be tested for the test case, and determining that the coverage reaches a preset test coverage; in response to automated testing of the test case, automated testing is performed in the automated testing framework through an integrated testing tool, and automated testing results are saved; in response to manual testing of the test case, a test page is screenshotted and identified, and manual testing results are recorded; and the automated testing results and the manual testing results are merged to obtain the final test results.

[0066] In some exemplary embodiments, for interface modification, transaction line and data line testing, test cases are written for the transaction line and data line range. Specifically, the test case template is downloaded on the test case page, and the case is written and imported into the test domain. Then, the test case review is initiated online, that is, the system verifies the coverage of the test case on the transaction code. After the verification is passed, a passing result is given, and the tester sends the case review process to the relevant review experts. At the same time, the review experts conduct parallel reviews, and initiate online meetings to review the cases when necessary. The review experts give feedback on the review opinions within the specified date. The system summarizes the opinions to the initiator, and the initiator modifies the case according to the opinions. At this time, the case review status is incomplete and the test cannot be initiated. Finally, after the case is modified, it is sent to the review expert for confirmation again. After the confirmation is passed, the system verifies the coverage of the test case on the transaction code again. After the verification is passed, the review status is completed, and the tester can start to execute the test case.

[0067] In the process of executing test cases, the system supports automated testing and manual testing. The actual execution case status includes pass, fail and other status. Among them, the automated testing framework integrates automated testing tools. After debugging the script, the automated testing execution can be called up through the test management platform, and the automated testing results can be saved at the same time. The automated testing results can be merged with the manual testing results to issue the final test report. In addition, the system supports the historical test tool recording function, that is, according to the different component development languages ​​recorded in the background, the test tool type is automatically prompted. The background can also set and view the test components, test equipment, language type and historical test results. At the same time, the system supports the scheduled batch execution function. For historical failed test scenarios, the automatic execution time and tool type can be set in the system. In addition, the system supports batch export of test results, real-time synchronization, and provides similar scenario recommendations and error result optimization suggestions. In manual testing, the tester takes a screenshot of the test page, the test management platform recognizes the screenshot, and records the test results. The manual test results are merged with the automated test results to issue a test report. Manual testing can supplement scenarios and transactions that cannot be covered by automated testing. On the manual test result supplement page, upload the test screenshot. The screenshot should include the test time, test environment, transaction code or transaction scenario and test results. After the tester uploads the results, the test management platform verifies and reviews the test results, and updates the test results after the review is passed. If the review fails, the tester re-tests and submits. The system also provides a test screenshot tool. Click the test screenshot button to directly take a screenshot of the test results on the desktop, save it, and upload it to the system.

[0068] Optionally, based on the component identification, the system supports merging the automatic test results with the manual test results. In this process, the manual test results are automatically merged with the automatic test results, that is, for tests that are manually tested and recorded using screenshots, the system can automatically write a test record and submit it for verification. If the verification passes, the system automatically merges the record with the automated test results to form an overall test result report.

[0069] It should be noted that the tools involved in the test phase include integrated screenshot tools and optical character recognition technology. The integrated screenshot tool can directly take screenshots in the manual test environment and upload them to the manual test result supplement page. The screenshot tool automatically generates a watermark of the test time and the current test environment. Optical character recognition technology can automatically identify the content of the screenshot and extract key information, that is, through a matching algorithm, automatically identify the test time, test environment, transaction code, transaction scenario and transaction result information in the screenshot and substitute it into the page field. For fields that the system cannot recognize, the page provides a manual filling method.

[0070] It is understandable that automated testing can significantly reduce the time and cost of manual operations and improve the efficiency of test execution by automatically executing test cases through integrated test tools. At the same time, manual testing can supplement the results of automated testing through manual judgment and operation. The combination of the two effectively improves the comprehensiveness and reliability of testing.

[0071] Furthermore, the test cases are executed in the automated testing framework, and manual testing is performed simultaneously to obtain test results, wherein the automated testing framework is deeply integrated with the case library and the defect library and further includes: calling predefined test cases in the case library to execute the test cases in the automated testing framework; and in response to defect information being discovered when executing the test cases in the automated testing framework, automatically submitting the defect information to the defect library and associating it with the corresponding test cases.

[0072] Specifically, during the automated testing phase, the automated testing framework is deeply integrated with the case library (including historical test cases and predefined test scenarios). The test case library provides a wealth of test scenarios and data for automated testing, making the testing more comprehensive and efficient. At the same time, the automated testing framework also integrates a defect library to automatically capture and record the defects found during the test process, so that testers do not need to manually record defect information. The system will automatically submit the found defects to the defect library based on the test results, which is convenient for subsequent tracking and management. In the process of submitting defect information to the defect library to enter the defect transfer process, first add defects to the failed test cases, such as software defects or defects caused by the test environment, data or other external factors. After identifying and recording the defects, the defect transfer process is started, that is, the defects are submitted to the defect tracking system, and the development team conducts preliminary confirmation to verify the authenticity and reproducibility of the defects. Confirmed defects will be assigned to the corresponding developers for processing. The developers will further analyze the causes of the defects and develop repair plans. After the developers complete the repair, they submit the repaired version to the test team for verification. The test team re-executes the relevant test cases to confirm whether the defects have been successfully repaired. After verification and confirmation that the defect has been fixed, the tester closes the defect in the defect tracking system and may provide feedback to the development team to optimize the subsequent development process.

[0073] It is understandable that by integrating common functions such as case libraries and defect libraries into the automated testing framework, not only can the management and execution of test cases become more efficient, but defects found during the testing process can also be recorded and tracked in real time, which helps to shorten the time cycle for problem discovery and resolution, avoid problems from being magnified in subsequent stages or causing more serious consequences, and reduce the cost and risk of software maintenance.

[0074] Furthermore, the system accumulates test scenarios and forms a test scenario library, providing an automatic test scenario recommendation function. The system can automatically identify and classify various test scenarios, using key fields such as development language and test channel as the basis for classification to form a test scenario library. Each test scenario is stored in the test scenario library in a labeled form, and the test scenario information can be modified and saved through manual editing. In addition, through the association rule algorithm, the newly input test scenario can be automatically identified and relevant test scenario recommendations can be formed. At the same time, through a feedback calibration mechanism, that is, manually evaluating and scoring the relevance of the recommended test scenarios, the accuracy of the test scenario recommendation can be continuously improved.

[0075] In an embodiment of the present disclosure, the method further includes: determining whether the test result meets a preset test standard; and when the test result does not meet the preset test standard, providing a corresponding warning prompt according to the test result.

[0076] Specifically, to monitor the test results, first select the test domain, which contains the transaction codes, transaction lines and data lines involved in this upgrade. The system will automatically monitor the test status of the transaction codes, transaction lines and data lines in the test domain. By monitoring the transaction codes, the transaction code test results (passed, failed and not tested) are generated. Then, the test results are analyzed and counted. The system supports daily statistics, weekly statistics, monthly statistics and selected period statistics, etc. At the same time, daily, weekly and monthly reports can be issued according to the situation. The test report shows the test time, the number of transaction codes, transaction lines and data lines to be tested within the test range, the number of actual tests, the completion percentage, the pass percentage and the failure percentage. In addition, the daily completion number warning can be set according to the test domain implementation cycle. If the set number is not reached, the warning level prompt will be given according to the completion number. For example, a warning will be issued in the daily report to remind the corresponding implementation personnel to speed up the implementation progress. After the test cycle of the selected test domain is completed, the system provides the test report issuance function. The content of the test report supports user customization. The basic content includes test domain, implementation cycle, test environment, server address, server software versions, transaction code, transaction line range, data line range, test execution rate, pass rate, number and proportion of defects, defect repair rate, execution unit, executor, reviewer, risks and suggestions, test conclusion, reasons for failure of test conclusion and remarks, etc.

[0077] It is understandable that judging whether the test results meet the pre-set test standards can help reduce the omission of software defects and improve the overall quality of the software.

[0078] The implementation and monitoring method of the functional test provided by the embodiment of the present disclosure provides a customized system module for the functional test management in the context of network application, terminal and other upgrades, which facilitates the process-based and complete test management in the early stage of project establishment in a complex software and hardware infrastructure environment. In addition, it integrates common functions such as automated testing, case library, and defect library, and reflects the results of the integrated module in real time in the test results. The tester only needs to perform the prefabricated operation of the test execution, and the subsequent operations are automatically completed by the system, which reduces the burden on the tester and improves work efficiency. In addition, it supports manual testing to supplement the scenes that cannot be covered by the automatic test. During the manual testing process, the tester takes screenshots to identify the system, record the test process and results, and does not need the tester to manually change the case status and upload the test results. All of them are supplemented by recording asset data during the implementation process. At the same time, the test management platform provides the test case with an automatic verification function for the test scope coverage. Before the expert review of the test case and after the modification according to the review opinions, the coverage is automatically verified, realizing the online process operation of the entire test case review process.

[0079] Based on the above functional test implementation and monitoring method, the present disclosure also provides a functional test implementation and monitoring device. Figure 4 The device is described in detail.

[0080] Figure 4 The structure block diagram of the implementation and monitoring device of the functional test according to the embodiment of the present disclosure is schematically shown.

[0081] like Figure 4 As shown, the functional test implementation and monitoring device 400 of this embodiment includes an acquisition module 410 , an import module 420 , an association module 430 , a test module 440 and a generation module 450 .

[0082] The acquisition module 410 is used to identify and acquire the corresponding transaction code to be tested within the test range in response to the change of the function of the business system. In one embodiment, the acquisition module 410 can be used to perform the operation S210 described above, which will not be repeated here.

[0083] The import module 420 is used to establish a test domain and import the transaction code to be tested into the test domain. In one embodiment, the import module 420 can be used to perform the operation S220 described above, which will not be described in detail here.

[0084] The association module 430 is used to respond to the modification of the interface involved in the change content, associate the corresponding transaction line and data line according to the transaction code to be tested, obtain the test data of the test domain, and write a test case according to the test data. In one embodiment, the association module 430 can be used to perform the operation S230 described above, which will not be repeated here.

[0085] The test module 440 is used to execute the test case in the automated test framework and perform manual testing simultaneously to obtain test results, wherein the automated test framework is deeply integrated with the case library and the defect library. In one embodiment, the test module 440 can be used to perform the operation S240 described above, which will not be repeated here.

[0086] The generating module 450 is used to generate a test report according to the test result. In one embodiment, the generating module 450 can be used to perform the operation S250 described above, which will not be described in detail here.

[0087] According to an embodiment of the present disclosure, the association module 430 may also be used to: in response to the change content not involving modification of the interface, use the transaction code to be tested as test data of the test domain.

[0088] According to an embodiment of the present disclosure, the acquisition module 410 is specifically used for: in response to a change in the function of the business system, identifying the full amount of transaction codes stored on the server of the business system and analyzing and screening them to determine the range of the transaction codes to be tested; judging whether the functional change of the business system involves an interface change of the server; and when it involves an interface change of the server, automatically determining the range of the transaction line and the data line based on the range of the transaction code to be tested, and incorporating the range of the transaction line and the data line into the test range to obtain the transaction code to be tested within the updated test range.

[0089] According to an embodiment of the present disclosure, the test module 440 can also be used to: select at least one test environment in the test domain, and determine the time and frequency of executing the test, and the time period for monitoring the test; and configure the test environment according to the determined time and frequency of executing the test, and monitor the execution process of the test in real time during the monitoring time period.

[0090] According to an embodiment of the present disclosure, the association module 430 is specifically used to: in response to the change content involving the modification of the interface, automatically identify and determine the transaction line and data line associated with the transaction code to be tested; based on the transaction line, obtain the interface to be modified; and verify the transaction line, the data line and the interface to be modified, obtain the test data of the test domain, and write a test case based on the test data.

[0091] According to an embodiment of the present disclosure, the test module 440 is specifically used to: check the coverage of the transaction code to be tested for the test case to determine whether the coverage reaches a preset test coverage; in response to performing automated testing on the test case, perform automated testing through an integrated testing tool in an automated testing framework, and save automated testing results; in response to performing manual testing on the test case, take a screenshot of the test page and identify it, and record the manual testing results; and merge the automated testing results and the manual testing results to obtain the final test results.

[0092] According to an embodiment of the present disclosure, the test module 440 can also be used to: call predefined test cases in the case library to execute the test cases in the automated testing framework; and in response to defect information being discovered when executing the test cases in the automated testing framework, automatically submit the defect information to the defect library and associate it with the corresponding test cases.

[0093] According to an embodiment of the present disclosure, the generation module 450 can also be used to: determine whether the test results meet the pre-set test standards; when the test results do not meet the pre-set test standards, provide corresponding early warning prompts based on the test results; and add defects to the failed test cases based on the test results, and enter the defect transfer process.

[0094] According to an embodiment of the present disclosure, any multiple modules of the acquisition module 410, the import module 420, the association module 430, the test module 440 and the generation module 450 can be combined in one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the acquisition module 410, the import module 420, the association module 430, the test module 440 and the generation module 450 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in a suitable combination of any of them. Alternatively, at least one of the acquisition module 410 , the import module 420 , the association module 430 , the test module 440 , and the generation module 450 may be at least partially implemented as a computer program module, which may perform a corresponding function when executed.

[0095] Figure 5 A block diagram of an electronic device suitable for implementing a method for implementing and monitoring a functional test according to an embodiment of the present disclosure is schematically shown.

[0096] like Figure 5 As shown, the electronic device 500 according to an embodiment of the present disclosure includes a processor 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage part 508 to a random access memory (RAM) 503. The processor 501 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 501 may also include an onboard memory for caching purposes. The processor 501 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0097] In RAM 503, various programs and data required for the operation of electronic device 500 are stored. Processor 501, ROM 502 and RAM 503 are connected to each other via bus 504. Processor 501 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 502 and / or RAM 503. It should be noted that the program can also be stored in one or more memories other than ROM 502 and RAM 503. Processor 501 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0098] According to an embodiment of the present disclosure, the electronic device 500 may further include an input / output (I / O) interface 505, which is also connected to the bus 504. The electronic device 500 may further include one or more of the following components connected to the input / output (I / O) interface 505: an input portion 506 including a keyboard, a mouse, etc.; an output portion 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 508 including a hard disk, etc.; and a communication portion 509 including a network interface card such as a LAN card, a modem, etc. The communication portion 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the input / output (I / O) interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed, so that a computer program read therefrom is installed into the storage portion 508 as needed.

[0099] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0100] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 502 and / or RAM 503 described above and / or one or more memories other than ROM 502 and RAM 503.

[0101] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the implementation and monitoring method of the functional test provided by the embodiment of the present disclosure.

[0102] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 501. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0103] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 509, and / or installed from the removable medium 511. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0104] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 509, and / or installed from the removable medium 511. When the computer program is executed by the processor 501, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0105] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0106] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0107] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0108] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A method for implementing and monitoring a functional test, characterized in that: The method comprises: In response to a change to a function of a business system, identifying and obtaining a corresponding transaction code to be tested within a test scope; Establishing a test domain, and importing the transaction code to be tested into the test domain; In response to the modification of the interface involved in the change, the test data of the test domain is obtained according to the transaction line and data line corresponding to the transaction code to be tested, and a test case is written according to the test data; Executing the test cases in an automated testing framework and performing manual testing simultaneously to obtain test results, wherein the automated testing framework is deeply integrated with a case library and a defect library; and A test report is generated according to the test results.

2. The method according to claim 1, characterized in that The method further comprises: In response to the fact that the changed content does not involve modification of the interface, the transaction code to be tested is used as test data of the test domain.

3. The method according to claim 1 or 2, characterized in that: In response to changing the function of the business system, identifying and obtaining the corresponding transaction code to be tested within the test range includes: In response to the change in the function of the business system, identifying the full amount of transaction codes stored on the server of the business system and analyzing and screening them to determine the range of the transaction codes to be tested; Determining whether the functional change of the business system involves an interface change of the server; and When the interface of the server is changed, the range of the transaction line and the data line is automatically determined according to the range of the transaction code to be tested, and the range of the transaction line and the data line is included in the test range to obtain the transaction code to be tested within the updated test range.

4. The method according to claim 1, characterized in that: The method further comprises: Selecting at least one test environment in the test domain, and determining a time and frequency for executing the test, and a time period for monitoring the test; and The test environment is configured according to the determined time and frequency of executing the test, and the execution process of the test is monitored in real time during the monitoring time period.

5. The method according to claim 1 or 2, characterized in that: In response to the modification of the interface involved in the change, the test data of the test domain is obtained according to the transaction code to be tested and the test case is written according to the test data, including: In response to the change involving modification of the interface, automatically identifying and determining the transaction line and data line associated with the transaction code to be tested; Based on the transaction line, obtaining an interface to be modified; and The transaction line, the data line and the interface to be modified are verified, the test data of the test domain is obtained, and a test case is written according to the test data.

6. The method according to claim 1, characterized in that The test case is executed in the automated test framework, and manual testing is performed simultaneously to obtain test results, wherein the automated test framework is deeply integrated with the case library and the defect library, including: Checking the coverage of the transaction code to be tested according to the test case to determine whether the coverage reaches a preset test coverage; In response to performing automated testing on the test case, performing automated testing in an automated testing framework using an integrated testing tool, and saving automated testing results; In response to manually testing the test case, taking a screenshot of the test page and identifying it, and recording the manual test result; and The automated test results and the manual test results are combined to obtain the final test results.

7. The method according to claim 6, characterized in that The test case is executed in the automated test framework, and manual testing is performed simultaneously to obtain test results, wherein the automated test framework is deeply integrated with the case library and the defect library and further includes: Calling a predefined test case in the case library to execute the test case in the automated testing framework; and In response to defect information being discovered when executing a test case in the automated testing framework, the defect information is automatically submitted to the defect repository and associated with the corresponding test case.

8. The method according to claim 1, 2 or 4, characterized in that: The method further comprises: Determining whether the test result meets a preset test standard; and When the test result does not meet the preset test standard, a corresponding early warning prompt is given according to the test result.

9. A functional test implementation and monitoring device, characterized in that: The device comprises: An acquisition module, for responding to changes to the functions of the business system, identifying and acquiring the corresponding transaction code to be tested within the test scope; An import module, used for establishing a test domain and importing the transaction code to be tested into the test domain; An association module, configured to, in response to the modification of the interface involved in the change content, associate the corresponding transaction line and data line according to the transaction code to be tested, obtain the test data of the test domain, and write a test case according to the test data; A test module, used to execute the test cases in an automated test framework and perform manual testing simultaneously to obtain test results, wherein the automated test framework is deeply integrated with a case library and a defect library; and A generating module is used to generate a test report according to the test results.

10. An electronic device comprising: one or more processors; a storage device for storing one or more computer programs, It is characterized in that when the one or more programs are executed by the one or more processors, the one or more processors execute the method according to any one of claims 1 to 8.

11. A computer-readable storage medium having executable instructions stored thereon, characterized in that: When the instruction is executed by a processor, the processor executes the method according to any one of claims 1 to 8.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images