Test method for batch test tasks and related device
By testing the processing time of batch tasks and looking up the solution strategy in advance, the processing delay problem caused by batch task timeout is solved, and more efficient task processing is achieved.
Patent Information
- Application Number
- CN202411601370.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-11
- Publication Date
- 2025-03-04
AI Technical Summary
After the batch tasks cannot be completed within the task completion deadline, the prior art will usually lead to delays in processing subsequent tasks and lack a mechanism for finding solutions in advance.
Obtain the processing time of batch tasks through tests. If the processing time exceeds the task completion period, find the solution strategy in advance, including obtaining task information, judging the task preparation status, sending scheduling instructions and obtaining processing time to reduce the delay of subsequent tasks.
It realizes the problem that batch task processing time exceeds the deadline in advance, reduces the processing delay of subsequent tasks, and improves the efficiency and reliability of task processing.
Smart Images

Figure CN119557210A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of testing technology, and in particular to a testing method and related devices for batch testing tasks. Background Art
[0002] Banks have many batch tasks. For example, a batch task can be a task to deduct the corresponding monthly payments from a large number of loan accounts on a fixed date every month.
[0003] Some batch tasks have a deadline for completion. For example, if the execution result of a batch task needs to be used after 1 hour, the deadline for completion of the batch task cannot exceed 1 hour. If a batch task cannot be completed within 1 hour, it will affect the processing of subsequent tasks. If a batch task cannot be completed within the deadline, a solution strategy needs to be found, for example, optimizing the processing of the batch task. In related technologies, after determining that a batch task cannot be completed within the deadline, a corresponding solution strategy is found, resulting in a delay in the processing of subsequent tasks.
[0004] Based on this, there is an urgent need for a testing method for batch tasks. Through testing, the processing time of batch tasks can be obtained. If the processing time exceeds the task completion deadline, a solution strategy can be found in advance to reduce the processing delay of subsequent tasks. Summary of the invention
[0005] In view of the above problems, the present application provides a test method and related device for batch test tasks, so as to obtain the processing time of batch tasks through testing. If the processing time exceeds the task completion deadline, a solution strategy can be found in advance to reduce the processing delay of subsequent tasks. The specific scheme is as follows:
[0006] The first aspect of the present application provides a method for obtaining the processing time of a batch task through testing, and if the processing time exceeds the task completion deadline, a solution strategy can be found in advance to reduce the occurrence of processing delays of subsequent tasks, including:
[0007] Acquire task information of a batch test task, wherein the task information includes a task number, a target data storage system identifier, a first communication address of a server, a target job flow type, a scheduling time, a target table, and a target order of magnitude;
[0008] The server runs a data storage system with the target data storage system identifier; the target table is the processing result of the batch test task; the target job flow type is the type of the job flow that processes the batch test task;
[0009] Obtaining the task preparation status of the batch test task;
[0010] If the task preparation state indicates that the data required to execute the batch test task has been prepared, and the current time reaches the scheduling time, a scheduling instruction is sent to the first communication address; the scheduling instruction is used to instruct the server to schedule all predecessor nodes of the target node in the job flow belonging to the target job flow type in the data storage system having the target data storage system identifier; the target node is the node obtained by processing the target table;
[0011] If information indicating that the batch test task processing is completed is received from the server, the processing time of the batch test task processing is obtained.
[0012] In a possible implementation, the step of obtaining the task preparation status of the batch test task includes:
[0013] From the correspondence between the preset communication address, the data storage system identifier and the communication address of the predecessor node, searching for the second communication address of the target predecessor node corresponding to the target data storage system identifier and the target communication address;
[0014] The data table stored in the target front-end node includes production data of the production environment and / or test data generation tool. Tool generated test data;
[0015] Sending a first detection instruction to the second communication address to detect whether a data table exists, wherein the data table refers to a data table required for the data storage system having the target data storage system identifier to execute a job flow belonging to the target job flow type;
[0016] Obtaining a first detection result fed back by the target preceding node;
[0017] Sending a second detection instruction to the first communication address for detecting whether there is a job flow belonging to the target job flow type;
[0018] Obtaining a second detection result fed back by the server;
[0019] Sending a third detection instruction for detecting the order of magnitude of the number of data rows in the data table to the second communication address;
[0020] Obtaining a third detection result fed back by the target preceding node;
[0021] The task preparation status of the batch test task is determined based on the first detection result, the second detection result, and the third detection result.
[0022] In a possible implementation, the step of determining the task preparation state of the batch test task based on the first test result, the second test result, and the third test result includes:
[0023] If the first detection result indicates that the data table exists, the second detection result indicates that there is a job flow belonging to the target job flow type, and the third detection result indicates that the order of magnitude of the number of data rows in the data table is the same as the target order of magnitude, it is determined that the task preparation state is that the data required to execute the batch test task has been prepared;
[0024] If the first detection result indicates that the data table does not exist, or the second detection result indicates that there is no job flow belonging to the target job flow type, or the third detection result indicates that the order of magnitude of the number of data rows in the data table is different from the target order of magnitude, it is determined that the task preparation status is that the data required to execute the batch test task is not prepared.
[0025] In a possible implementation, the method further includes:
[0026] Acquire a first tree structure including the target node and all preceding nodes of the target node from the server;
[0027] Obtaining identifiers of data tables corresponding to the target node and all predecessor nodes of the target node respectively;
[0028] Constructing a second tree structure of identifiers of data tables corresponding to all predecessor nodes of the target node based on the first tree structure;
[0029] Updating, by the server, a processing status corresponding to the identifier of the data table in the second tree structure;
[0030] Based on the processing status corresponding to the identifier of the data table in the second tree structure, the processing progress of the batch test task is determined.
[0031] A second aspect of the present application provides a testing device for batch testing tasks, comprising:
[0032] A first acquisition module is used to acquire task information of a batch test task, wherein the task information includes a task number, a target data storage system identifier, a first communication address of a server, a target job flow type, a scheduling time, a target table, and a target order of magnitude;
[0033] The server runs a data storage system with the target data storage system identifier; the target table is the processing result of the batch test task; the target job flow type is the type of the job flow that processes the batch test task;
[0034] A second acquisition module is used to obtain the task preparation status of the batch test task;
[0035] A sending module, configured to send a scheduling instruction to the first communication address if the task preparation state indicates that the data required to execute the batch test task has been prepared and the current time has reached the scheduling time; the scheduling instruction is used to instruct the server to schedule all predecessor nodes of the target node in the job flow belonging to the target job flow type in the data storage system having the target data storage system identifier; the target node is the node obtained by processing the target table;
[0036] The third acquisition module is used to obtain the processing time of the batch test task processing if the information indicating that the batch test task processing is completed is received from the server.
[0037] In a possible implementation, the second acquisition module includes:
[0038] A searching unit, configured to search for a second communication address of a target predecessor node corresponding to the target data storage system identifier and the target communication address from a correspondence relationship among preset communication addresses, data storage system identifiers and communication addresses of predecessor nodes;
[0039] The data table stored in the target front-end node includes production data of a production environment and / or test data generated by a test data generation tool;
[0040] A first sending unit, configured to send a first detection instruction to the second communication address to detect whether a data table exists, wherein the data table refers to a data table required for the data storage system having the target data storage system identifier to execute a job flow belonging to the target job flow type;
[0041] A first acquisition unit, configured to acquire a first detection result fed back by the target preceding node;
[0042] A second sending unit, configured to send a second detection instruction to the first communication address to detect whether there is a workflow belonging to the target workflow type;
[0043] A second acquisition unit, used to acquire a second detection result fed back by the server;
[0044] A third sending unit, used for sending a third detection instruction for detecting the order of magnitude of the number of data rows in the data table to the second communication address;
[0045] A third acquisition unit, used to acquire a third detection result fed back by the target preceding node;
[0046] A determination unit is used to determine the task preparation status of the batch test task based on the first detection result, the second detection result and the third detection result.
[0047] In a possible implementation, the determining unit includes:
[0048] A first determining subunit is configured to determine that the task preparation state is that the data required to execute the batch test task has been prepared if the first detection result indicates that the data table exists, the second detection result indicates that there is a job flow belonging to the target job flow type, and the third detection result indicates that the order of magnitude of the number of data rows in the data table is the same as the target order of magnitude;
[0049] The second determination subunit is used to determine that the task preparation status is that the data required to execute the batch test task is not prepared if the first detection result indicates that the data table does not exist, or the second detection result indicates that there is no job flow belonging to the target job flow type, or the third detection result indicates that the order of magnitude of the number of data rows in the data table is different from the target order of magnitude.
[0050] A third aspect of the present application provides a computer program product, comprising computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements the testing method for batch testing tasks of the first aspect or any implementation of the first aspect.
[0051] A fourth aspect of the present application provides an electronic device, comprising at least one processor and a memory connected to the processor, wherein:
[0052] The memory is used to store computer programs;
[0053] The processor is used to execute the computer program so that the electronic device can implement the testing method of the batch testing task of the above-mentioned first aspect or any implementation manner of the first aspect.
[0054] A fifth aspect of the present application provides a computer storage medium, which carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can perform a testing method for batch testing tasks according to the first aspect or any implementation of the first aspect.
[0055] By means of the above technical solution, the present application provides a testing method for batch test tasks, which obtains the task information of the batch test tasks; the task information includes the task number, the target data storage system identifier, the first communication address of the server, the target job flow type, the scheduling time, the target table and the target order of magnitude. The task preparation status of the batch test task is obtained; if the task preparation status indicates that the data required to execute the batch test task has been prepared, and the current time reaches the scheduling time, a scheduling instruction is sent to the server, and the scheduling instruction is used to instruct the server to schedule all the predecessor nodes of the target node in the job flow belonging to the target job flow type in the data storage system with the target data storage system identifier. Thereby, the processing time of the batch test task can be obtained. Thereby, it is possible to judge in advance whether the processing time is greater than the task completion deadline. If it is greater, a solution strategy can be found in advance, thereby reducing the delay in the processing of subsequent tasks. BRIEF DESCRIPTION OF THE DRAWINGS
[0056] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.
[0057] Figure 1 A schematic diagram of a system architecture provided for this application;
[0058] Figure 2 A schematic diagram of an optional hardware structure of a terminal 100 provided in this application;
[0059] Figure 3 A schematic diagram of the structure of a server 200 provided in this application;
[0060] Figure 4 A flow chart of a test method for a batch test task provided in an embodiment of the present application;
[0061] Figure 5 A schematic diagram of a tree structure of a job flow belonging to a target job flow type provided in an embodiment of the present application;
[0062] Figure 6 Provided for the embodiments of this application Figure 5 A schematic diagram of a second tree structure corresponding to the workflow shown;
[0063] Figure 7 A structural schematic diagram of a test device for a batch test task provided in an embodiment of the present application;
[0064] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0065] The following describes the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation method section of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application.
[0066] The embodiments of the present application are described below in conjunction with the accompanying drawings. Those skilled in the art will appreciate that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0067] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, which is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the present application. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.
[0068] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.
[0069] See also Figure 1 , Figure 1 A schematic diagram of a system architecture is shown. The system may include a terminal 100 and a server 200. The server 200 may include one or more servers ( Figure 1 In the example, a server is included, and the server 200 can provide the method provided in the embodiment of the present application for one or more terminals.
[0070] Among them, the terminal 100 can be installed with applications and web pages, which can provide an interface. The terminal 100 can receive relevant parameters entered by the staff on the interface, such as task information of batch testing tasks, and send the above parameters to the server 200. The server 200 can obtain processing results based on the received parameters and return the processing results to the terminal 100.
[0071] It should be understood that in some optional implementations, the terminal 100 can also complete the action of obtaining the processing result based on the received parameters by itself without the cooperation of the server, and the embodiments of the present application are not limited to this.
[0072] Next describe Figure 1 The product form of the mid-terminal 100;
[0073] The terminal 100 in the embodiment of the present application can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc., and the embodiment of the present application does not impose any limitation on this.
[0074] Figure 2 An optional hardware structure diagram of the terminal 100 is shown.
[0075] refer to Figure 2 As shown, the terminal 100 may include a radio frequency unit 110, a memory 120, an input unit 130, a display unit 140, a camera 150 (optional), an audio circuit 160 (optional), a speaker 161 (optional), a microphone 162 (optional), an earphone jack 163 (optional), a processor 170, an external interface 180, a power supply 190 and other components. Those skilled in the art will appreciate that Figure 2 This is merely an example of a terminal and does not constitute a limitation on the terminal. The terminal may include more or fewer components than shown in the figure, or a combination of certain components, or different components.
[0076] The input unit 130 can be used to receive input digital or character information, and generate key signal input related to the user settings and function control of the terminal. Specifically, the input unit 130 may include a touch screen 131 (optional) and / or other input devices 132. The touch screen 131 can collect the user's touch operations on or near it (such as the user's operation on or near the touch screen using any suitable object such as fingers, joints, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch screen can detect the user's touch action on the touch screen, convert the touch action into a touch signal and send it to the processor 170, and can receive and execute the command sent by the processor 170; the touch signal at least includes the touch point coordinate information. The touch screen 131 can provide an input interface and an output interface between the terminal 100 and the user. In addition, the touch screen can be implemented using multiple types such as resistive, capacitive, infrared and surface acoustic wave. In addition to the touch screen 131, the input unit 130 can also include other input devices. Specifically, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.
[0077] Among them, the input device 132 can receive input data and the like.
[0078] The display unit 140 may be used to display information input by the user or provided to the user, various menus of the terminal 100, interactive interfaces, file display and / or playback of any multimedia file. In the embodiment of the present application, the display unit 140 may be used to display interfaces, processing results, etc.
[0079] The memory 120 can be used to store instructions and data. The memory 120 can mainly include an instruction storage area and a data storage area. The data storage area can store various data, such as multimedia files, texts, etc.; the instruction storage area can store software units such as operating systems, applications, instructions required for at least one function, or their subsets and extensions. It can also include a non-volatile random access memory; provide the processor 170 with hardware, software and data resources including management of computing and processing equipment, and support control software and applications. It is also used for the storage of multimedia files, and the storage of running programs and applications.
[0080] The processor 170 is the control center of the terminal 100. It uses various interfaces and lines to connect various parts of the entire terminal 100. By running or executing instructions stored in the memory 120 and calling data stored in the memory 120, it executes various functions of the terminal 100 and processes data, thereby controlling the terminal device as a whole. Optionally, the processor 170 may include one or more processing units; preferably, the processor 170 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application program, and the modem processor mainly processes wireless communication. It is understandable that the above-mentioned modem processor may not be integrated into the processor 170. In some embodiments, the processor and the memory may be implemented on a single chip, and in some embodiments, they may also be implemented separately on separate chips. The processor 170 may also be used to generate corresponding operation control signals, send them to corresponding components of the computing and processing device, read and process data in the software, especially read and process data and programs in the memory 120, so that each functional module therein performs corresponding functions, thereby controlling the corresponding components to act according to the requirements of the instructions.
[0081] Among them, the memory 120 can be used to store software codes related to the testing method of batch testing tasks, the processor 170 can execute the steps of the testing method of batch testing tasks, and can also schedule other units (such as the above-mentioned input unit 130 and display unit 140) to implement corresponding functions.
[0082] The radio frequency unit 110 (optional) can be used for receiving and sending information or receiving and sending signals during a call, for example, after receiving the downlink information of the base station, it is sent to the processor 170 for processing; in addition, the designed uplink data is sent to the base station. Generally, the RF circuit includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, etc. In addition, the radio frequency unit 110 can also communicate with network devices and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (SMS), etc.
[0083] In this embodiment of the present application, the RF unit 110 can send data to the server 200 and receive processing results sent by the server 200.
[0084] It should be understood that the radio frequency unit 110 is optional and can be replaced by other communication interfaces, such as a network port.
[0085] The terminal 100 also includes a power supply 190 (such as a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 170 through a power management system, so that the power management system can manage functions such as charging, discharging, and power consumption.
[0086] The terminal 100 further includes an external interface 180 , which may be a standard Micro USB interface or a multi-pin connector, and may be used to connect the terminal 100 to communicate with other devices, or to connect a charger to charge the terminal 100 .
[0087] Although not shown, the terminal 100 may also include a flashlight, a wireless fidelity (WiFi) module, a Bluetooth module, sensors with different functions, etc., which are not described in detail here. Some or all of the methods described below may be applied in the following embodiments. Figure 2 In the terminal 100 shown.
[0088] Next describe Figure 1 The product form of the server 200;
[0089] Figure 3 A structural diagram of a server 200 is provided, such as Figure 3 As shown, the server 200 includes a bus 201, a processor 202, a communication interface 203, and a memory 204. The processor 202, the memory 204, and the communication interface 203 communicate with each other via the bus 201.
[0090] The bus 201 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0091] The processor 202 may be any one or more of a central processing unit (CPU), a graphics processing unit (GPU), a microprocessor (MP), or a digital signal processor (DSP).
[0092] The memory 204 may include a volatile memory, such as a random access memory (RAM). The memory 204 may also include a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD), or a solid state drive (SSD).
[0093] The memory 204 may be used to store software codes related to the test method of the batch test task, and the processor 202 may execute the steps of the test method of the batch test task of the chip, and may also schedule other units to implement corresponding functions.
[0094] It should be understood that the above-mentioned terminal 100 and server 200 can be centralized or distributed devices, and the processors in the above-mentioned terminal 100 and server 200 (such as processor 170 and processor 202) can be hardware circuits (such as application specific integrated circuit (ASIC), field-programmable gate array (FPGA), general-purpose processor, digital signal processor (DSP), microprocessor or microcontroller, etc.), or a combination of these hardware circuits. For example, the processor can be a hardware system with an instruction execution function, such as a CPU, DSP, etc., or a hardware system without an instruction execution function, such as an ASIC, FPGA, etc., or a combination of the above-mentioned hardware systems without an instruction execution function and hardware systems with an instruction execution function.
[0095] Reference Figure 4 , Figure 4 A flow chart of a test method for a batch test task provided in an embodiment of the present application is shown as follows: Figure 4 As shown, a testing method for a batch testing task provided in an embodiment of the present application may include steps S401 to S404, and these steps are described in detail below.
[0096] Step S401: Obtain task information of a batch test task.
[0097] The task information includes a task number, a target data storage system identifier, a first communication address of a server, a target job flow type, a scheduling time, a target table, and a target magnitude.
[0098] The server runs a data storage system with the target data storage system identifier; the target table is the processing result of the batch test task; and the target job flow type is the type of the job flow that processes the batch test task.
[0099] It is understandable that the batch task is a real task running in a production environment. The batch test task in the embodiment of the present application is a batch test task that is created before the batch task arrives and is equivalent to the batch task. The batch test task is executed in a production environment or a test environment to obtain the processing time of the batch test task. The processing time is the processing time of the batch task. If the processing time is longer than the task completion deadline of the batch task, a solution strategy can be found before the batch task arrives.
[0100] Exemplarily, multiple batch test tasks may be created in advance, and different batch test tasks may need to test different functions.
[0101] Exemplarily, the data tables required for executing the batch test task include production data of the production environment and / or test data generated by a test data generation tool.
[0102] Exemplarily, there are many types of data storage systems, including but not limited to: data lakes or data warehouses. Data lakes and data warehouses have significant differences in data structure, processing method, access method, security, storage cost, and application scenarios.
[0103] It is understandable that different data storage systems process batch test tasks in different ways, resulting in different processing times for batch test tasks. For example, the processing method for data lakes is TBDS (Tencent Big Data Service), and the processing method for data warehouses is EJCM (Enterprise Job Control Monitor).
[0104] Exemplarily, if the target data storage system identifier is an identifier of a data lake, the target workflow type may be a source-attachment type, and the workflow belonging to the source-attachment type is: pre-process→buffer→source-attachment.
[0105] Exemplarily, if the target data storage system is identified as a data warehouse identifier, the target job flow type can be all types, ETL (Extract-Transform-Load) type, and sinking type. If the target job flow type is all types, the workflow belonging to all types is table T to table ETL; if the target job flow type is ETL type, the workflow belonging to the ETL type is the ETL process of the table itself; if the target job flow type is a sinking type, the workflow belonging to the sinking type is the workflow from the data warehouse to the data lake.
[0106] Exemplarily, the target order of magnitude refers to the order of magnitude of the number of rows in the data table required to execute the parent node of the workflow belonging to the target workflow type. Exemplarily, the number of parent nodes may be one or more.
[0107] The following examples illustrate each parameter.
[0108] like Figure 5 , which is a schematic diagram of a tree structure of a job flow belonging to a target job flow type provided in an embodiment of the present application.
[0109] Figure 5The tree structure in includes 8 nodes, namely: node 11, node 12, node 13, node 14, node 21, node 22, node 31 and node 41.
[0110] Assume that the parent nodes of the job flow belonging to the target job flow type include node 11, node 12, node 13 and node 14. Assume that node 11 processes the first data table to obtain the fifth data table, node 12 processes the second data table to obtain the sixth data table, node 13 processes the third data table to obtain the seventh data table, and node 14 processes the fourth data table to obtain the eighth data table; node 21 processes the fifth data table and the sixth data table to obtain the ninth data table, node 22 processes the seventh data table and the eighth data table to obtain the tenth data table, and node 31 processes the ninth data table and the tenth data table to obtain the eleventh data table.
[0111] Assume that the first data table includes 4*10 5 Row data, the second data table includes 3*10 5 Row data, the third data table includes 3*10 5 Row data, the fourth data table includes 2*10 6 Then, the target order of magnitude can be the sum of the first data table, the second data table, the third data table, and the fourth data table 3*10 6 The order of magnitude is 10 6 The target order of magnitude can be max{the order of magnitude of the first data table, the order of magnitude of the second data table, the order of magnitude of the third data table, the order of magnitude of the fourth data table}=*10 6 .
[0112] like Figure 5 As shown, the target table in the embodiment of the present application is the eleventh data table.
[0113] It can be understood that although the job flow belonging to the target job flow type includes the node 41, since the node 31 has already obtained the target table, the node 41 does not need to be executed.
[0114] Exemplarily, the task number refers to which function of which project the batch testing task targets.
[0115] It is understandable that banking enterprises release a function update plan for executing batch tasks every month. After releasing the function update plan for batch tasks and before production, these functions for executing batch tasks need to be tested to test whether these batch tasks can be completed within the task completion period. Exemplarily, the application pre-sets the corresponding relationship between the project and the function for executing batch tasks.
[0116] Step S402: Obtain the task preparation status of the batch test task.
[0117] It is understandable that before executing the batch test task, it is necessary to prepare the data for executing the batch test task, such as the data table required by the job flow of the target job flow type and the job flow of the target job flow type. If the task status representation has been prepared, the batch test task can be triggered after the current time reaches the scheduled time, otherwise the batch test task cannot be triggered.
[0118] Step S403: If the task preparation status indicates that the data required to execute the batch test task has been prepared, When the current time reaches the scheduled time, a scheduling instruction is sent to the first communication address.
[0119] The scheduling instruction is used to instruct the server to schedule all predecessor nodes of a target node in a job flow belonging to the target job flow type in the data storage system having the target data storage system identifier; the target node is a node obtained by processing the target table.
[0120] The following example illustrates all the predecessor nodes of the target node.
[0121] like Figure 5 As shown in FIG. 1 , assuming that the target node of the target table is node 31, all the predecessor nodes of node 31 are: node 11, node 12, node 13, node 14, node 21, and node 22. It can be understood that after all the predecessor nodes of the target node are scheduled, they will also be scheduled according to Figure 5 The execution order shown in .
[0122] It can be understood that after all the predecessor nodes of the target node are executed, the target table can be obtained through the target node.
[0123] Step S404: if the information indicating that the batch test task processing is completed is received from the server, the processing time of the batch test task processing is obtained.
[0124] Exemplarily, processing time = end time of batch test task - scheduling time of batch test task.
[0125] The embodiment of the present application provides a testing method for batch test tasks, which obtains the task information of the batch test tasks; the task information includes the task number, the target data storage system identifier, the first communication address of the server, the target job flow type, the scheduling time, the target table and the target order of magnitude. The task preparation status of the batch test task is obtained; if the task preparation status indicates that the data required to execute the batch test task has been prepared, and the current time reaches the scheduling time, a scheduling instruction is sent to the server, and the scheduling instruction is used to instruct the server to schedule all the predecessor nodes of the target node in the job flow belonging to the target job flow type in the data storage system with the target data storage system identifier. Thereby, the processing time of the batch test task can be obtained. Thereby, it is possible to judge in advance whether the processing time is greater than the task completion deadline. If it is greater, a solution strategy can be found in advance, thereby reducing the delay in the processing of subsequent tasks.
[0126] In an optional implementation, there are multiple implementations of step S302. The embodiment of the present application provides but is not limited to the following method, which includes the following steps A1 to A8 during implementation.
[0127] Step A1: searching for a second communication address of a target predecessor node corresponding to the target data storage system identifier and the target communication address from a correspondence relationship among preset communication addresses, data storage system identifiers and communication addresses of predecessor nodes.
[0128] The data table stored in the target front-end node includes production data of a production environment and / or test data generated by a test data generation tool.
[0129] Exemplarily, the communication addresses mentioned in the embodiments of the present application include, but are not limited to: IP address (Internet Protocol Address), MAC (Media Access Control Address) address and port number.
[0130] It is understandable that the communication addresses of different servers are different.
[0131] Exemplarily, the same server runs one or more data storage systems. The same server can run different types of data storage systems. Different data storage systems running on the same server have different identifiers.
[0132] Step A2: Send a first detection instruction for detecting whether a data table exists to the second communication address.
[0133] The data table refers to a data table required for the data storage system having the target data storage system identifier to execute a job flow belonging to the target job flow type.
[0134] Exemplarily, the first detection instruction may include a suffix of a data table. If the target predecessor node stores a data table with a corresponding suffix, it is considered that the target predecessor node has the data table.
[0135] Exemplarily, the data table required by the job flow of the target job flow type is the data table required by the parent node. Figure 5 As shown, except for the parent node (including node 11, node 12, node 13 and node 14), other nodes are processed according to the data table received from the previous node. Then the data table required for the job flow belonging to the target job flow type is the data table required by the parent node (including node 11, node 12, node 13 and node 14).
[0136] Exemplarily, the data table required by the parent node of the target workflow type is stored in the target predecessor node of the parent node. Figure 5 As shown, the first data table, the second data table, the third data table and the fourth data table required by nodes 11, 12, 13 and 14 should be stored in the target predecessor nodes corresponding to nodes 11, 12, 13 and 14 respectively.
[0137] Exemplarily, the target predecessor nodes corresponding to the nodes 11, 12, 13, and 14 respectively may be the same or different.
[0138] Assuming that the target predecessor nodes corresponding to node 11, node 12, node 13, and node 14 are the same, and assuming that node SS will send the first to fourth data tables processed by itself to node 11, node 12, node 13, and node 14 respectively, then node SS is the target predecessor node of node 11, node 12, node 13, and node 14.
[0139] It is understandable that if the target predecessor node has been executed and the first to fourth data tables are obtained, then after scheduling nodes 11, 12, 13, and 14, nodes 11, 12, 13, and 14 can directly obtain the corresponding data tables from node SS. If the target predecessor node has not been executed, then after scheduling nodes 11, 12, 13, and 14, nodes 11, 12, 13, and 14 cannot obtain the corresponding data tables from node SS, and thus cannot perform the corresponding processing operations.
[0140] Step A3: Obtain the first detection result fed back by the target preceding node.
[0141] Step A4: Sending a second detection instruction to the first communication address for detecting whether there is a workflow belonging to the target workflow type.
[0142] It is understandable that if the data storage system with the target data storage system identifier running on the server does not have a job flow of the target job flow type, the scheduling process will also fail.
[0143] Step A5: Obtain the second detection result fed back by the server.
[0144] Step A6: Send a third detection instruction for detecting the order of magnitude of the number of data rows in the data table to the second communication address.
[0145] It is understandable that if you want to test a batch test task with a large amount of data, but the number of data rows in the data table is small, the processing time of the batch test task obtained in this way is inaccurate.
[0146] Step A7: Obtain the third detection result fed back by the target preceding node.
[0147] Step A8: Determine the task preparation status of the batch test task based on the first detection result, the second detection result and the third detection result.
[0148] Exemplarily, if the first detection result indicates the existence of the data table, the second detection result indicates that there is a job flow belonging to the target job flow type, and the third detection result indicates that the order of magnitude of the number of data rows in the data table is the same as the target order of magnitude, it is determined that the task preparation status is that the data required to execute the batch testing task has been prepared.
[0149] Exemplarily, if the first detection result indicates that the data table does not exist, or the second detection result indicates that there is no job flow belonging to the target job flow type, or the third detection result indicates that the order of magnitude of the number of data rows in the data table is different from the target order of magnitude, it is determined that the task preparation status is that the data required to execute the batch test task is not prepared.
[0150] It is understandable that there are multiple methods for obtaining the processing progress of batch test tasks, and the embodiments of the present application provide but are not limited to the following two.
[0151] The first method for obtaining the processing progress of batch test tasks includes the following steps B1 to B5.
[0152] Step B1: Acquire a first tree structure including the target node and all predecessor nodes of the target node from the server.
[0153] Still Figure 5 For example, the first tree structure can be Figure 5 The tree structure after removing node 41.
[0154] Step B2: Obtain identifiers of data tables corresponding to the target node and all predecessor nodes of the target node.
[0155] Exemplarily, the names of the data tables obtained by processing the target node and all the preceding nodes of the target node are different. Therefore, the identifier of the data table mentioned in step B2 can be the name of the data table.
[0156] Exemplarily, the target node and all the preceding nodes of the target node have different suffixes for the data tables obtained by processing them respectively. Therefore, the identifier of the data table mentioned in step B2 may be the suffix of the data table.
[0157] Step B3: constructing a second tree structure of identifiers of data tables corresponding to all predecessor nodes of the target node based on the first tree structure.
[0158] like Figure 6 As shown, the embodiment of the present application provides Figure 5 A schematic diagram of a second tree structure corresponding to the workflow shown.
[0159] Step B4: updating the processing status corresponding to the identifier of the data table in the second tree structure through the server.
[0160] Exemplarily, the server may detect whether a data table having an identifier of a corresponding data table has been obtained.
[0161] Step B5: Determine the processing progress of the batch test task based on the processing status corresponding to the identifier of the data table in the second tree structure.
[0162] Exemplarily, the processing status corresponding to the identifier of the data table may be: processing not started, processing in progress, or processing completed.
[0163] Combine the following Figure 6 For illustration, if the processing status corresponding to the identifier of the data table of node 21 is being processed and the processing status corresponding to the identifier of the data table of node 22 is being processed, the processing progress of the batch test task can be determined.
[0164] The second tree structure mentioned above can also be called a blood relationship.
[0165] For example, the association relationship between the identifiers of the data tables of each node in the operation flow can be deduced based on the blood relationship. Figure 5As shown in the figure, the workflow includes 4 layers in total) scheduling success or failure, which is convenient for intuitive display and troubleshooting. After all nodes of the workflow are successfully scheduled, the result display will automatically record the scheduling time of that level and display it in a graph, including scheduling time, CPU (Central Processing Unit) utilization, JVM (Java Virtual Machine) utilization, and memory utilization.
[0166] The second method for obtaining the processing progress of the batch test tasks includes the following steps C1 to C3.
[0167] Step C1: Obtaining from the server the processing states of the target node and all the predecessor nodes of the target node respectively.
[0168] Exemplarily, the processing states corresponding to the target node and all the predecessor nodes of the target node may be: processing not started, processing in progress, or processing completed.
[0169] Step C2: Determine the processing progress of the batch test task based on the processing statuses of the target node and all the predecessor nodes of the target node respectively corresponding to each other.
[0170] The test method for batch test tasks provided in the embodiment of the present application belongs to the performance test of big data. Big data is mainly processed in batches offline. Therefore, the performance test of big data mainly tests whether the job flow belonging to the target job flow type can complete the download of the data table within the agreed time (i.e., the task completion deadline) when the data volume is large.
[0171] Exemplarily, the embodiment of the present application can test the batch test task when the server is in an idle state. The present invention can set the task information of the batch test task through the front-end page, and then automatically trigger it when the scheduled time arrives.
[0172] Exemplarily, the present application can obtain the relevant results and log information of the job flow execution and the monitoring results of the server resources. When all nodes in the job flow corresponding to the batch test task are executed, it can support the analysis of a single test task separately, and also support the parallel analysis of multiple batch test tasks of different orders of magnitude. The parallel analysis can reveal the performance load bottleneck at multiple orders of magnitude.
[0173] A test method for a batch test task provided in an embodiment of the present application is introduced above, and a device for executing the test method for the batch test task is introduced below.
[0174] See also Figure 7 , Figure 7 A structural schematic diagram of a testing device for a batch testing task provided in an embodiment of the present application.
[0175] like Figure 7 As shown, the test device for the batch test task includes:
[0176] The first acquisition module 701 is used to acquire task information of a batch test task, wherein the task information includes a task number, a target data storage system identifier, a first communication address of a server, a target job flow type, a scheduling time, a target table, and a target order of magnitude;
[0177] The server runs a data storage system with the target data storage system identifier; the target table is the processing result of the batch test task; the target job flow type is the type of the job flow that processes the batch test task;
[0178] The second acquisition module 702 is used to obtain the task preparation status of the batch test task;
[0179] The sending module 703 is used to send a scheduling instruction to the first communication address if the task preparation state indicates that the data required to execute the batch test task has been prepared and the current time reaches the scheduling time; the scheduling instruction is used to instruct the server to schedule all the predecessor nodes of the target node in the job flow belonging to the target job flow type in the data storage system with the target data storage system identifier; the target node is the node obtained by processing the target table;
[0180] The third acquisition module 704 is used to acquire the processing time of the batch test task processing if the information indicating that the batch test task processing is completed is received from the server.
[0181] In an optional implementation, the second acquisition module includes:
[0182] A searching unit, configured to search for a second communication address of a target predecessor node corresponding to the target data storage system identifier and the target communication address from a correspondence relationship among preset communication addresses, data storage system identifiers and communication addresses of predecessor nodes;
[0183] The data table stored in the target front-end node includes production data of a production environment and / or test data generated by a test data generation tool;
[0184] A first sending unit, configured to send a first detection instruction to the second communication address to detect whether a data table exists, wherein the data table refers to a data table required for the data storage system having the target data storage system identifier to execute a job flow belonging to the target job flow type;
[0185] A first acquisition unit, configured to acquire a first detection result fed back by the target preceding node;
[0186] A second sending unit, configured to send a second detection instruction to the first communication address to detect whether there is a workflow belonging to the target workflow type;
[0187] A second acquisition unit, used to acquire a second detection result fed back by the server;
[0188] A third sending unit, used for sending a third detection instruction for detecting the order of magnitude of the number of data rows in the data table to the second communication address;
[0189] A third acquisition unit, used to acquire a third detection result fed back by the target preceding node;
[0190] A determination unit is used to determine the task preparation status of the batch test task based on the first detection result, the second detection result and the third detection result.
[0191] In an optional implementation, the determining unit includes:
[0192] A first determining subunit is configured to determine that the task preparation state is that the data required to execute the batch test task has been prepared if the first detection result indicates that the data table exists, the second detection result indicates that there is a job flow belonging to the target job flow type, and the third detection result indicates that the order of magnitude of the number of data rows in the data table is the same as the target order of magnitude;
[0193] The second determination subunit is used to determine that the task preparation status is that the data required to execute the batch test task is not prepared if the first detection result indicates that the data table does not exist, or the second detection result indicates that there is no job flow belonging to the target job flow type, or the third detection result indicates that the order of magnitude of the number of data rows in the data table is different from the target order of magnitude.
[0194] In an optional implementation, the method further includes:
[0195] A fourth acquisition module, configured to acquire, from the server, a first tree structure including the target node and all preceding nodes of the target node;
[0196] A fifth acquisition module, used to acquire identifiers of data tables corresponding to the target node and all predecessor nodes of the target node respectively;
[0197] A construction module, configured to construct, based on the first tree structure, a second tree structure of identifiers of data tables corresponding to all preceding nodes of the target node;
[0198] An updating module, configured to update, through the server, a processing state corresponding to the identifier of the data table in the second tree structure;
[0199] A determination module is used to determine the processing progress of the batch test task based on the processing status corresponding to the identifier of the data table in the second tree structure.
[0200] The present application also provides an electronic device in an embodiment. Figure 8 As shown, it shows a schematic diagram of the structure of an electronic device suitable for implementing the embodiments of the present application. The electronic device in the embodiments of the present application may include but is not limited to fixed terminals such as mobile phones, notebook computers, PDAs (personal digital assistants), PADs (tablet computers), desktop computers, etc. Figure 8 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0201] like Figure 8 As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 to a random access memory (RAM) 803. When the electronic device is powered on, various programs and data required for the operation of the electronic device are also stored in the RAM 803. The processing device 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.
[0202] Typically, the following devices may be connected to the I / O interface 805: input devices 806 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 808 including, for example, a memory card, a hard disk, etc.; and communication devices 809. The communication device 809 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although Figure 8 An electronic device having various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0203] The present application also provides a computer program product including computer-readable instructions. Machine readable When the instruction is executed on the electronic device, the electronic device implements the testing method of any batch testing task provided in the embodiments of the present application.
[0204] A computer-readable storage medium is also provided in an embodiment of the present application. The storage medium carries one or more computer programs. When one or more computer programs are executed by an electronic device, the electronic device can implement a testing method for any batch testing task provided in an embodiment of the present application.
[0205] It should be noted that the test method and related devices for batch test tasks provided by the present invention can be used in the financial field or other fields, for example, can be used in test application scenarios in the financial field. Other fields are any fields other than the financial field, for example, test scenarios in the power field. The above is only an example and does not limit the application field of the test method and related devices for batch test tasks provided by the present invention.
[0206] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.
[0207] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0208] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.
[0209] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.
Claims
1. A test method for batch test tasks, characterized in that: include: Acquire task information of a batch test task, wherein the task information includes a task number, a target data storage system identifier, a first communication address of a server, a target job flow type, a scheduling time, a target table, and a target order of magnitude; The server runs a data storage system with the target data storage system identifier; the target table is the processing result of the batch test task; the target job flow type is the type of the job flow that processes the batch test task; Obtaining the task preparation status of the batch test task; If the task preparation state indicates that the data required to execute the batch test task has been prepared, and the current time reaches the scheduling time, a scheduling instruction is sent to the first communication address; the scheduling instruction is used to instruct the server to schedule all predecessor nodes of the target node in the job flow belonging to the target job flow type in the data storage system having the target data storage system identifier; the target node is the node obtained by processing the target table; If information indicating that the batch test task processing is completed is received from the server, the processing time of the batch test task processing is obtained.
2. The test method for batch test tasks according to claim 1, characterized in that: The step of obtaining the task preparation status of the batch test task includes: Finding the second communication address of the target predecessor node corresponding to the target data storage system identifier and the target communication address from the correspondence between the preset communication address, the data storage system identifier and the communication address of the predecessor node; The data table stored in the target front-end node includes production data of a production environment and / or test data generated by a test data generation tool; Sending a first detection instruction to the second communication address to detect whether a data table exists, wherein the data table refers to a data table required for the data storage system having the target data storage system identifier to execute a job flow belonging to the target job flow type; Obtaining a first detection result fed back by the target preceding node; Sending a second detection instruction to the first communication address for detecting whether there is a job flow belonging to the target job flow type; Obtaining a second detection result fed back by the server; Sending a third detection instruction for detecting the order of magnitude of the number of data rows in the data table to the second communication address; Obtaining a third detection result fed back by the target preceding node; The task preparation status of the batch test task is determined based on the first detection result, the second detection result, and the third detection result.
3. The test method for batch test tasks according to claim 2, characterized in that: The step of determining the task preparation state of the batch test task based on the first test result, the second test result, and the third test result includes: If the first detection result indicates that the data table exists, the second detection result indicates that there is a job flow belonging to the target job flow type, and the third detection result indicates that the order of magnitude of the number of data rows in the data table is the same as the target order of magnitude, it is determined that the task preparation state is that the data required to execute the batch test task has been prepared; If the first detection result indicates that the data table does not exist, or the second detection result indicates that there is no job flow belonging to the target job flow type, or the third detection result indicates that the order of magnitude of the number of data rows in the data table is different from the target order of magnitude, it is determined that the task preparation status is that the data required to execute the batch test task is not prepared.
4. The test method for batch test tasks according to any one of claims 1 to 3, characterized in that: Also includes: Acquire a first tree structure including the target node and all preceding nodes of the target node from the server; Obtaining identifiers of data tables corresponding to the target node and all predecessor nodes of the target node respectively; Constructing a second tree structure of identifiers of data tables corresponding to all predecessor nodes of the target node based on the first tree structure; Updating, by the server, a processing status corresponding to the identifier of the data table in the second tree structure; Based on the processing status corresponding to the identifier of the data table in the second tree structure, the processing progress of the batch test task is determined.
5. A test device for batch test tasks, characterized in that: include: A first acquisition module is used to acquire task information of a batch test task, wherein the task information includes a task number, a target data storage system identifier, a first communication address of a server, a target job flow type, a scheduling time, a target table, and a target order of magnitude; The server runs a data storage system with the target data storage system identifier; the target table is the processing result of the batch test task; the target job flow type is the type of the job flow that processes the batch test task; A second acquisition module is used to obtain the task preparation status of the batch test task; A sending module, configured to send a scheduling instruction to the first communication address if the task preparation state indicates that the data required to execute the batch test task has been prepared and the current time has reached the scheduling time; the scheduling instruction is used to instruct the server to schedule all predecessor nodes of the target node in the job flow belonging to the target job flow type in the data storage system having the target data storage system identifier; the target node is the node obtained by processing the target table; The third acquisition module is used to obtain the processing time of the batch test task processing if the information indicating that the batch test task processing is completed is received from the server.
6. The test device for batch testing tasks according to claim 5, characterized in that: The second acquisition module includes: A searching unit, configured to search for a second communication address of a target predecessor node corresponding to the target data storage system identifier and the target communication address from a correspondence relationship among preset communication addresses, data storage system identifiers and communication addresses of predecessor nodes; The data table stored in the target front-end node includes production data of a production environment and / or test data generated by a test data generation tool; A first sending unit, configured to send a first detection instruction to the second communication address to detect whether a data table exists, wherein the data table refers to a data table required for the data storage system having the target data storage system identifier to execute a job flow belonging to the target job flow type; A first acquisition unit, configured to acquire a first detection result fed back by the target preceding node; A second sending unit, configured to send a second detection instruction to the first communication address to detect whether there is a workflow belonging to the target workflow type; A second acquisition unit, used to acquire a second detection result fed back by the server; A third sending unit, used for sending a third detection instruction for detecting the order of magnitude of the number of data rows in the data table to the second communication address; A third acquisition unit, used to acquire a third detection result fed back by the target preceding node; A determination unit is used to determine the task preparation status of the batch test task based on the first detection result, the second detection result and the third detection result.
7. The test device for batch testing tasks according to claim 6, characterized in that: The determining unit comprises: A first determining subunit is configured to determine that the task preparation state is that the data required to execute the batch test task has been prepared if the first detection result indicates that the data table exists, the second detection result indicates that there is a job flow belonging to the target job flow type, and the third detection result indicates that the order of magnitude of the number of data rows in the data table is the same as the target order of magnitude; The second determination subunit is used to determine that the task preparation status is that the data required to execute the batch test task is not prepared if the first detection result indicates that the data table does not exist, or the second detection result indicates that there is no job flow belonging to the target job flow type, or the third detection result indicates that the order of magnitude of the number of data rows in the data table is different from the target order of magnitude.
8. A computer program product, characterized in that It comprises computer-readable instructions, and when the computer-readable instructions are executed on an electronic device, the electronic device implements the testing method for batch testing tasks as claimed in any one of claims 1 to 4.
9. An electronic device, characterized in that: The method comprises at least one processor and a memory connected to the processor, wherein: The memory is used to store computer programs; The processor is used to execute the computer program so that the electronic device can implement the testing method for batch testing tasks as described in any one of claims 1 to 4.
10. A computer storage medium, characterized in that: The storage medium carries one or more computer programs, and when the one or more computer programs are executed by an electronic device, the electronic device can implement the testing method for batch testing tasks as described in any one of claims 1 to 4.