Batch verification method and device based on hierarchical classification rule base, equipment and medium

Abstract

The invention relates to the technical field of rule base processing, in particular to a batch verification method and device based on a hierarchical classification rule base, equipment and a medium. According to the method, a test requirement corresponding to a target event is obtained, a test case set is screened from a plurality of candidate test cases according to the test requirement, and the test case set comprises a plurality of test cases associated with the test requirement; executing the test case set to obtain a test result set, and determining corresponding test rule information according to the test result set; obtaining hierarchical classification information corresponding to the test case set from a hierarchical classification rule base, wherein the hierarchical classification rule base is used for indicating an association relationship between the plurality of test requirements and the plurality of test rules; and performing batch verification processing on the test rule information and the grading and classification information to obtain a verification result. According to the method, manual verification of each grading and classification rule is avoided, the test efficiency is greatly improved, and manpower, time and cost are saved.

Description

Technical Field

[0001] This application relates to the field of rule base processing technology, and in particular to a batch verification method, apparatus, device and medium based on a hierarchical classification rule base. Background Technology

[0002] Currently, when conducting intelligent reporting tests for emergency management systems, it is typically necessary to verify the accuracy of the intelligent identification results. For example, after an event is reported, the intelligent component needs to identify the event's time, location, stakeholders, and impact based on the reported information to determine the severity of the event and provide corresponding response plans. This requires testers to simulate reporting various emergencies and compare the results returned by the intelligent identification with the expected results obtained from the emergency event classification and handling rules. When the emergency management system is applied to different industries or regions, the event classification or handling rules need to be localized. The tests require simulating numerous event scenarios and need to provide rapid feedback on the test results to assist the intelligent tools in model optimization.

[0003] In existing technologies, due to the diversity of emergencies and the different ways and habits of different users in describing events, the commonly used interface tests for the intelligent reporting function of emergency management systems cannot simulate different event reporting scenarios. Therefore, manual intervention is still required to generate event descriptions and set expected results.

[0004] However, the existing technologies described above require significant manpower and time to maintain scripts for handling emergencies. Furthermore, due to the diversity of emergencies, testers need to simulate numerous input scenarios. Additionally, when projects are applied to different regions or industries, the classification rules and handling methods for the same event will differ, requiring adjustments to expectations. If different projects have customized development requirements and interface parameters change, the scripts also need further maintenance. Moreover, different projects may have different event types of concern to users, necessitating adjustments to the test case set based on actual project needs. Therefore, test results cannot adequately support test analysis and cannot provide a basis for optimizing intelligent recognition models. Thus, the aforementioned problems in handling emergencies urgently need to be addressed. Summary of the Invention

[0005] This application provides a batch verification method, apparatus, device, and medium based on a hierarchical classification rule base to solve the aforementioned problems existing in the prior art. Specifically, the prior art requires significant manpower and time to maintain scripts for handling emergencies, and due to the diversity of emergencies, testers need to simulate numerous input scenarios. Furthermore, when projects are applied to different regions or industries, the hierarchical classification rules and handling methods for the same event will differ, requiring adjustments to expectations. If different projects have customized development requirements and interface parameters change, the scripts also need further maintenance. In different projects, users focus on different event types, necessitating adjustments to the test case set according to actual project requirements.

[0006] Firstly, this application provides a batch verification method based on a hierarchical classification rule base, the method comprising:

[0007] Obtain the test requirements corresponding to the target event, and based on the test requirements, filter a set of test cases from multiple candidate test cases. The set of test cases includes multiple test cases that are related to the test requirements.

[0008] Execute the set of test cases to obtain a set of test results, and determine the corresponding test rule information based on the set of test results;

[0009] Obtain the hierarchical classification information corresponding to the test case set from the hierarchical classification rule base, which is used to indicate the relationship between multiple test requirements and multiple test rules;

[0010] The test rule information and the hierarchical classification information are subjected to batch verification processing to obtain the verification results.

[0011] Optionally, before obtaining the hierarchical classification information corresponding to the test case set from the hierarchical classification rule base, the method further includes:

[0012] Determine the hierarchical classification rules for multiple industries in each of the multiple regions, and generate hierarchical classification information for the corresponding regions and industries based on the hierarchical classification rules;

[0013] Multiple hierarchical and categorized information are divided according to regional and industry attributes to obtain hierarchical and categorized information sets for each region;

[0014] Based on the hierarchical classification information sets of multiple regions, corresponding hierarchical classification rule bases are constructed respectively.

[0015] Optionally, the testing requirements include: target region and target industry, and the step of selecting a set of test cases from multiple candidate test cases based on the testing requirements includes:

[0016] From the plurality of candidate test cases, determine a plurality of target test cases that match the target region and the target industry;

[0017] The test case set is created based on the multiple target test cases.

[0018] Optionally, determining the corresponding test rule information based on the test result set includes:

[0019] The test result set is analyzed and processed by calling the event interface corresponding to the target event, and the test rule information returned by the event interface is obtained.

[0020] Optionally, after performing batch verification processing on the test rule information and the hierarchical classification information to obtain the verification result, the method further includes:

[0021] Based on the verification results, a verification report and a visualization analysis chart corresponding to the target event are generated. The verification report is used to indicate whether the batch verification results of the target event are accurate, and the visualization analysis chart includes: a visualization statistical chart with multiple dimensions.

[0022] Secondly, this application provides a batch verification device based on a hierarchical classification rule base, the device comprising:

[0023] The acquisition module is used to acquire the test requirements corresponding to the target event, and to filter a set of test cases from multiple candidate test cases according to the test requirements. The set of test cases includes multiple test cases that are related to the test requirements.

[0024] The determination module is used to execute the set of test cases, obtain a set of test results, and determine the corresponding test rule information based on the set of test results.

[0025] The acquisition module is further configured to acquire hierarchical classification information corresponding to the test case set from the hierarchical classification rule base, wherein the hierarchical classification rule base is used to indicate the association between multiple test requirements and multiple test rules;

[0026] The processing module is used to perform batch verification processing on the test rule information and the hierarchical classification information to obtain the verification results.

[0027] Optionally, the device further includes: a construction module;

[0028] The determining module is also used to determine the hierarchical classification rules for multiple industries corresponding to each region in multiple regions, and generate hierarchical classification information for the corresponding region and the corresponding industry according to the hierarchical classification rules;

[0029] The processing module is also used to divide and process multiple hierarchical and classification information according to regional attributes and industry attributes to obtain a hierarchical and classification information set for each region.

[0030] The construction module is used to construct corresponding hierarchical classification rule bases based on hierarchical classification information sets from multiple regions.

[0031] Optionally, the determining module is further configured to determine, from the plurality of candidate test cases, a plurality of target test cases that match the target region and the target industry;

[0032] The construction module is also used to create the test case set based on the plurality of target test cases.

[0033] Optionally, the processing module is further configured to call the event interface corresponding to the target event to analyze and process the test result set, and obtain the test rule information returned by the event interface.

[0034] Optionally, the apparatus further includes: a generation module;

[0035] The generation module is used to generate a verification report and a visualization analysis chart corresponding to the target event based on the verification results. The verification report is used to indicate whether the batch verification results of the target event are accurate, and the visualization analysis chart includes: a visualization statistical chart with multiple dimensions.

[0036] Thirdly, this application provides a batch verification device based on a hierarchical classification rule base, comprising: at least one processor and a memory;

[0037] The memory stores computer-executed instructions;

[0038] The at least one processor executes the computer execution instructions stored in the memory, causing the at least one processor to perform the batch verification method based on a hierarchical classification rule base as described in the first aspect and various possible implementations of the first aspect above.

[0039] Fourthly, embodiments of the present invention provide a readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the batch verification method based on a hierarchical classification rule base as described in the first aspect and various possible implementations of the first aspect.

[0040] This application provides a batch verification method, apparatus, device, and medium based on a hierarchical classification rule base. The method involves: acquiring test requirements corresponding to a target event; selecting a set of test cases from multiple candidate test cases based on the test requirements; the test case set including multiple test cases related to the test requirements; executing the test case set to obtain a set of test results; determining corresponding test rule information based on the test result set; obtaining hierarchical classification information corresponding to the test case set from the hierarchical classification rule base, which indicates the relationship between multiple test requirements and multiple test rules; and performing batch verification processing on the test rule information and the hierarchical classification information to obtain verification results. This method completes batch verification of the rule base by executing the test case set, avoiding manual verification of each hierarchical classification rule, greatly improving testing efficiency and saving manpower and time costs. Attached Figure Description

[0041] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0042] Figure 1 This application provides a flowchart of a batch validation method based on a hierarchical classification rule base. Figure 1 ;

[0043] Figure 2 This application provides a flowchart of a batch validation method based on a hierarchical classification rule base. Figure 2 ;

[0044] Figure 3 This is a schematic diagram of the structure of the batch verification device based on a hierarchical classification rule base provided in this application;

[0045] Figure 4 This is a schematic diagram of the structure of the batch verification device based on the hierarchical classification rule base provided in this application.

[0046] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0047] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0048] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that embodiments of the invention described herein can be implemented, for example, in orders other than those illustrated or described herein.

[0049] In this application, the terms "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0050] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0051] First, let me explain the terms used in this application:

[0052] Test Case: A test case is a set of conditions designed for a specific purpose to test a program or system to check whether it meets specified requirements or functions correctly. A test case typically includes the test environment, preconditions, input data, execution steps, expected results, and actual results.

[0053] The execution of test cases typically involves the following steps:

[0054] Obtain test cases: Obtain the test cases to be executed from the test management system or the test manager;

[0055] Review test cases: Carefully read and understand the purpose, preconditions, input data, execution steps, and expected results of each test case;

[0056] Prepare the test environment: Ensure that the test environment has been set up and meets the requirements specified in the test cases, and check that all necessary test tools, software or hardware are ready;

[0057] Prepare test data: Prepare the corresponding test data according to the requirements of the test cases, including input data, files, database records, etc.

[0058] Execution of test steps: Strictly follow the steps provided in the test cases to execute the test. If any problems or abnormal situations are encountered during the execution process, record them in time and continue to execute the subsequent steps.

[0059] Record actual results: After each step, record the actual observed system behavior or output results. If the actual results are consistent with the expected results, mark it as passed; if they are inconsistent, mark it as failed and record the detailed differences.

[0060] Organize test results: After executing all test cases, organize the test results, including the number of test cases that passed, the number of test cases that failed, and the reasons for the failures;

[0061] Submit test reports: Write test reports to summarize the test execution, including test case coverage, number of defects found, severity of defects, etc., and submit the test reports to relevant personnel, such as test lead, project manager or developers;

[0062] Defect tracking and management: For defects discovered during execution, report, track and manage them in accordance with the team's or organization's defect management process, and collaborate with developers to ensure that defects are fixed and verified in a timely manner.

[0063] Currently, existing technologies for handling emergencies require significant manpower and time to maintain scripts. Furthermore, due to the diversity of emergencies, testers need to simulate numerous input scenarios. Additionally, when projects are applied to different regions or industries, the classification rules and handling methods for the same event will differ, necessitating adjustments to expectations. If different projects have customized development requirements and interface parameters change, scripts also require further maintenance. Moreover, different projects have different event types of concern to users, requiring adjustments to the test case set based on actual project needs. Therefore, test results cannot adequately support test analysis and cannot provide a basis for optimizing intelligent recognition models.

[0064] To address the aforementioned issues, this application provides a batch verification method based on a hierarchical classification rule base. This method obtains the test requirements of the target event, filters out the corresponding set of test cases based on these requirements, and performs batch verification processing on the test rule information from the execution results of these test cases against the hierarchical classification information corresponding to the test case set in the hierarchical classification rule base. This ultimately completes the batch verification based on the hierarchical classification rule base. This method performs batch verification of the rule base by executing the set of test cases, avoiding manual verification of each hierarchical classification rule, greatly improving testing efficiency and saving manpower and time costs.

[0065] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0066] Figure 1 This is a flowchart illustrating the batch verification method based on a hierarchical classification rule base provided in the embodiments of this application. Figure 1 .like Figure 1 As shown in the figure, the batch verification method based on a hierarchical classification rule base illustrated in this embodiment includes:

[0067] S101: Obtain the test requirements corresponding to the target event, and select a set of test cases from multiple candidate test cases based on the test requirements.

[0068] The test case set includes multiple test cases related to the test requirements. Target events can be, for example, sudden emergencies such as natural disasters, meteorological disasters, and earthquakes. These target events have different classification and grading information in different regions and industries, requiring different event reporting methods based on this classification and grading information. Furthermore, different target events correspond to different test requirements and different test case sets.

[0069] When the target event occurs, it is necessary to identify the corresponding hierarchical classification information of the reported content of the target event. This information may include, for example, the time and place of the target event, industry stakeholders, impact results, and severity of the event. Management personnel need to provide corresponding contingency plans based on the hierarchical classification information.

[0070] S102: Execute the set of test cases to obtain a set of test results, and determine the corresponding test rule information based on the set of test results.

[0071] The execution of the test case set can be performed, for example, by calling the event interface corresponding to the target event, and by analyzing and processing the test result set through the event interface to obtain the test rule information corresponding to the target event returned by the event interface.

[0072] S103: Obtain the hierarchical classification information corresponding to the test case set from the hierarchical classification rule base.

[0073] The hierarchical classification rule base is used to indicate the relationship between multiple test requirements and multiple test rules. For example, the hierarchical classification rule base can generate hierarchical classification information corresponding to each region and industry based on the hierarchical classification rules of multiple industries corresponding to each region. Then, the hierarchical classification information is divided and processed according to regional attributes and industry attributes to finally obtain the hierarchical classification information set of each region. Finally, the hierarchical classification rule base corresponding to each region is constructed through the hierarchical classification information set of each region.

[0074] S104: Perform batch verification processing on the test rule information and the hierarchical classification information to obtain the verification results.

[0075] The verification results may include, for example, verification of the time, location, industry stakeholders, impact, and severity of the target event.

[0076] Understandably, based on the aforementioned verification results, corresponding verification reports and visual analysis charts can be generated, thereby allowing a clear view of the verification results for the target event.

[0077] This embodiment provides a batch verification method based on a hierarchical classification rule base. This method obtains the test requirements of the target event, filters out the corresponding set of test cases based on these requirements, and performs batch verification processing on the test rule information in the execution results of these test cases against the hierarchical classification information corresponding to the test case set in the hierarchical classification rule base. This ultimately completes the batch verification based on the hierarchical classification rule base. This method completes the batch verification of the rule base by executing the set of test cases, avoiding manual verification of each hierarchical classification rule, greatly improving testing efficiency and saving manpower and time costs.

[0078] Figure 2 A flowchart illustrating the batch verification method based on a hierarchical classification rule base provided in this application embodiment. Figure 2 .like Figure 2 As shown, this embodiment is... Figure 1 Based on the embodiments, a batch verification method based on a hierarchical classification rule base is described in detail. The batch verification method based on a hierarchical classification rule base shown in this embodiment includes:

[0079] S201: Obtain the test requirements corresponding to the target event, the test requirements including: target region and target industry, and determine multiple target test cases that match the target region and target industry from multiple candidate test cases.

[0080] The target event can be, for example, a sudden event that affects a certain area; the target area can be, for example, an area affected by the sudden event that meets the testing requirements; and multiple candidate test cases can include, for example, the testing rule information for the target event in multiple areas. This testing rule information can include, for example, the time, location, industry stakeholders, impact results, and severity determination of the event. Multiple candidate test cases can be entered, for example, through system input or by importing from an Excel spreadsheet.

[0081] S202: Create a set of test cases based on the multiple target test cases.

[0082] The test case set can be, for example, a set of test cases constructed from test cases of the target industry corresponding to the target region.

[0083] S203: Execute the test case set to obtain the test result set, call the event interface corresponding to the target event to analyze and process the test result set, and obtain the test rule information returned by the event interface.

[0084] The test case set can be executed, for example, manually or by a scheduled task. There are no specific restrictions, and the choice can be made flexibly according to the actual situation. The event interface corresponding to the target event can obtain the test rule information of the target event of the test case based on the test case information, such as the occurrence time, location, industry stakeholders, impact results, and severity determination of the event.

[0085] S204: Determine the hierarchical classification rules for multiple industries corresponding to each of the multiple regions, and generate hierarchical classification information for the corresponding regions and industries based on the hierarchical classification rules.

[0086] The hierarchical classification information for the corresponding region and industry may include, for example, the time and location of the target event, industry stakeholders, impact results, and severity of the event.

[0087] S205: Divide and process multiple hierarchical and classification information according to regional and industry attributes to obtain a hierarchical and classification information set for each region.

[0088] The regional attributes can include levels such as country, province, and city; the industry attributes can include different business areas or industry classifications. Based on the regional and industry attributes, multiple hierarchical classification information items are filtered and categorized, assigning each piece of information to its corresponding region and industry. For each region, all hierarchical classification information belonging to that region is integrated into an information set, which should contain hierarchical classification information for all relevant industries in that region. The hierarchical classification information sets for each region are output in an appropriate format (such as tables, reports, databases, etc.) and stored in a batch validation system based on a hierarchical classification rule base, thus completing the construction of the hierarchical classification information set for each region.

[0089] S206: Construct corresponding hierarchical classification rule bases based on hierarchical classification information sets from multiple regions.

[0090] Understandably, this step involves storing the hierarchical and categorized information sets from multiple regions into the corresponding hierarchical and categorized rule base to complete the construction of the hierarchical and categorized rule base. If errors or omissions are found in the hierarchical and categorized rule base, it can be corrected and updated in a timely manner according to the actual situation.

[0091] S207: Obtain the hierarchical classification information corresponding to the test case set from the hierarchical classification rule base.

[0092] This step of obtaining the hierarchical classification information corresponding to the test case set may include, for example, extracting key features from the target event test rule information of the test case set, quickly finding the corresponding hierarchical classification information from the hierarchical classification rule base using these key features, and obtaining the classification and hierarchical information that matches the test case set based on the query results. The obtained hierarchical classification information is then verified to ensure it conforms to the actual situation of the test case set, and can be appropriately adjusted or integrated according to the actual situation.

[0093] S208: Perform batch verification processing on the test rule information and the hierarchical classification information to obtain the verification results.

[0094] The verification results may include, for example, the verification results of the target event occurrence time, location, industry stakeholders, impact of the target event, and severity of the event. These verification results may include, for example, verification success and verification failure. Verification success may mean that the verification results of the target event occurrence time, location, industry stakeholders, impact of the target event, and severity of the event are all successful. Verification failure may mean that the verification results of the target event occurrence time, location, industry stakeholders, impact of the target event, and severity of the event are all unsuccessful. Specifically, the factors in the verification failure results can be flexibly selected according to the actual situation, thereby flexibly selecting the verification results.

[0095] S209: Based on the verification results, generate a verification report and a visualization analysis chart corresponding to the target event.

[0096] The verification report indicates the accuracy of batch verification results for the target event. The visualization analysis charts include multi-dimensional statistical charts, which may include, for example, success rate information comparing different industries, regions, and events related to the target event. Specific settings can be flexibly configured according to actual needs, and no specific limitations are imposed here.

[0097] This embodiment provides a batch verification method based on a hierarchical classification rule base. This method generates hierarchical classification information for corresponding regions and industries based on hierarchical classification rules for each region and its corresponding industries, and constructs a corresponding hierarchical classification rule base. It further describes the creation of test case sets according to testing requirements, enabling the batch extraction of hierarchical classification information for each region and its corresponding industries by executing test cases. The hierarchical classification information in the executed test case results is then verified against the corresponding test rule information in the hierarchical classification rule base, thus achieving batch verification of the hierarchical classification rule base. Simultaneously, it provides verification reports and multi-dimensional visual analysis charts, allowing for a more intuitive and comprehensive understanding of the verification results of multiple rules under the target event. This method can verify the hierarchical classification rules for the same target event in different regions or industries, and can create corresponding test case sets according to testing requirements, thereby achieving accurate batch verification of hierarchical classification rules, greatly improving testing efficiency and saving manpower and time costs.

[0098] Figure 3 This is a schematic diagram of the structure of a batch verification device based on a hierarchical classification rule base provided in an embodiment of this application. Figure 3 As shown, the batch verification device 300 based on a hierarchical classification rule base provided in this application includes:

[0099] The acquisition module 301 is used to acquire the test requirements corresponding to the target event, and to filter a set of test cases from multiple candidate test cases according to the test requirements. The set of test cases includes multiple test cases that are related to the test requirements.

[0100] The determination module 302 is used to execute the set of test cases, obtain a set of test results, and determine the corresponding test rule information based on the set of test results;

[0101] The acquisition module 301 is further configured to acquire hierarchical classification information corresponding to the test case set from the hierarchical classification rule base, wherein the hierarchical classification rule base is used to indicate the association between multiple test requirements and multiple test rules;

[0102] The processing module 303 is used to perform batch verification processing on the test rule information and the hierarchical classification information to obtain the verification result.

[0103] Optionally, the device further includes: a construction module 304;

[0104] The determining module 302 is further configured to determine the hierarchical classification rules for multiple industries corresponding to each of the multiple regions, and generate hierarchical classification information for the corresponding regions and industries based on the hierarchical classification rules.

[0105] The processing module 303 is also used to divide and process multiple hierarchical classification information according to regional attributes and industry attributes to obtain a hierarchical classification information set for each region.

[0106] The construction module 304 is used to construct corresponding hierarchical classification rule bases based on hierarchical classification information sets from multiple regions.

[0107] Optionally, the determining module 302 is further configured to determine a plurality of target test cases that match the target region and the target industry from the plurality of candidate test cases;

[0108] The construction module 304 is also used to create the test case set based on the plurality of target test cases.

[0109] Optionally, the processing module 303 is further configured to call the event interface corresponding to the target event to analyze and process the test result set, and obtain the test rule information returned by the event interface.

[0110] Optionally, the device further includes: a generation module 305;

[0111] The generation module 305 is used to generate a verification report and a visualization analysis chart corresponding to the target event based on the verification results. The verification report is used to indicate whether the batch verification results of the target event are accurate, and the visualization analysis chart includes: a visualization statistical chart of multiple dimensions.

[0112] Figure 4 This is a schematic diagram of the batch verification device based on a hierarchical classification rule base provided in this application. Figure 4 As shown, this application provides a batch verification device based on a hierarchical classification rule base. The batch verification device 400 based on the hierarchical classification rule base includes: a receiver 401, a transmitter 402, a processor 403, and a memory 404.

[0113] Receiver 401 is used to receive instructions and data;

[0114] Transmitter 402 is used to send commands and data;

[0115] Memory 404 is used to store instructions executed by the computer;

[0116] Processor 403 is used to execute computer execution instructions stored in memory 404 to implement the various steps of the batch verification method based on a hierarchical classification rule base in the above embodiments. For details, please refer to the relevant descriptions in the foregoing embodiments of the batch verification method based on a hierarchical classification rule base.

[0117] Optionally, the memory 404 can be either standalone or integrated with the processor 403.

[0118] When the memory 404 is set up independently, the electronic device also includes a bus for connecting the memory 404 and the processor 403.

[0119] This application also provides a computer-readable storage medium storing computer-executable instructions. When a processor executes the computer-executable instructions, it implements the batch verification method based on a hierarchical classification rule base as described above, which is executed by the batch verification device based on the hierarchical classification rule base.

[0120] It will be understood by those skilled in the art that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0121] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0122] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A batch verification method based on a hierarchical classification rule base, characterized in that, The method includes: Obtain the test requirements corresponding to the target event, and based on the test requirements, filter a set of test cases from multiple candidate test cases. The set of test cases includes multiple test cases that are related to the test requirements. Execute the set of test cases to obtain a set of test results, and determine the corresponding test rule information based on the set of test results; Obtain the hierarchical classification information corresponding to the test case set from the hierarchical classification rule base, which is used to indicate the relationship between multiple test requirements and multiple test rules; The test rule information and the hierarchical classification information are subjected to batch verification processing to obtain the verification results.

2. The method according to claim 1, characterized in that, Before obtaining the hierarchical classification information corresponding to the test case set from the hierarchical classification rule base, the method further includes: Determine the hierarchical classification rules for multiple industries in each of the multiple regions, and generate hierarchical classification information for the corresponding regions and industries based on the hierarchical classification rules; Multiple hierarchical and categorized information are divided according to regional and industry attributes to obtain hierarchical and categorized information sets for each region; Based on the hierarchical classification information sets of multiple regions, corresponding hierarchical classification rule bases are constructed respectively.

3. The method according to claim 1, characterized in that, The testing requirements include: target region and target industry. The process of selecting a set of test cases from multiple candidate test cases based on these requirements includes: From the plurality of candidate test cases, determine a plurality of target test cases that match the target region and the target industry; The test case set is created based on the multiple target test cases.

4. The method according to claim 1, characterized in that, The step of determining the corresponding test rule information based on the test result set includes: The test result set is analyzed and processed by calling the event interface corresponding to the target event, and the test rule information returned by the event interface is obtained.

5. The method according to claim 1, characterized in that, After performing batch verification processing on the test rule information and the hierarchical classification information to obtain the verification results, the method further includes: Based on the verification results, a verification report and a visualization analysis chart corresponding to the target event are generated. The verification report is used to indicate whether the batch verification results of the target event are accurate, and the visualization analysis chart includes: a visualization statistical chart with multiple dimensions.

6. A batch verification device based on a hierarchical classification rule base, characterized in that, include: The acquisition module is used to acquire the test requirements corresponding to the target event, and to filter a set of test cases from multiple candidate test cases according to the test requirements. The set of test cases includes multiple test cases that are related to the test requirements. The determination module is used to execute the set of test cases, obtain a set of test results, and determine the corresponding test rule information based on the set of test results. The acquisition module is further configured to acquire hierarchical classification information corresponding to the test case set from the hierarchical classification rule base, wherein the hierarchical classification rule base is used to indicate the association between multiple test requirements and multiple test rules; The processing module is used to perform batch verification processing on the test rule information and the hierarchical classification information to obtain the verification results.

7. The apparatus according to claim 6, characterized in that, The device further includes: a construction module; The determining module is also used to determine the hierarchical classification rules for multiple industries corresponding to each region in multiple regions, and generate hierarchical classification information for the corresponding region and the corresponding industry according to the hierarchical classification rules; The processing module is also used to divide and process multiple hierarchical and classification information according to regional attributes and industry attributes to obtain a hierarchical and classification information set for each region. The construction module is used to construct corresponding hierarchical classification rule bases based on hierarchical classification information sets from multiple regions.

8. The apparatus according to claim 7, characterized in that, include: The determining module is further configured to determine, from the plurality of candidate test cases, a plurality of target test cases that match the target region and the target industry; The construction module is also used to create the test case set based on the plurality of target test cases.

9. A batch verification device based on a hierarchical classification rule base, characterized in that, include: Memory; processor; The memory stores computer-executed instructions; The processor executes the computer execution instructions stored in the memory to implement the batch verification method based on a hierarchical classification rule base as described in any one of claims 1-5.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the batch verification method based on a hierarchical classification rule base as described in any one of claims 1-5.

Images