Monitoring Method and Device for Batch Version Changes

Abstract

The present disclosure provides a monitoring method for batch version changes, which can be applied to the field of big data technology. The monitoring method for batch version changes includes: periodically executing a script to obtain data table change information; determining a change information file according to the data table change information; determining a change batch job list according to the change information file; and displaying the change batch job list. The present disclosure also provides a monitoring device, device, storage medium and program product for batch version changes.

Description

Technical Field

[0001] The present disclosure relates to the field of big data technology, and more particularly to data processing methods, and even more particularly to a monitoring method, device, equipment, medium and program product for batch version changes. Background Art

[0002] With the advent of the big data era, enterprises have established big data platforms to store data. In the daily management process of big data platforms, enterprises mainly manage their data tables through batch versions. Due to the large number of data tables and the large amount of content involved in batch versions, it is difficult for testers to monitor the changes of data tables during the batch version testing process, resulting in insufficient testing and production problems. In addition, due to the inability to monitor the changes of data tables, testers cannot focus on testing the changed content, resulting in a large amount of testing content and low testing efficiency. Summary of the Invention

[0003] In view of the above problems, the present disclosure provides a monitoring method, device, equipment, medium and program product for batch version changes.

[0004] According to a first aspect of the present disclosure, there is provided a monitoring method for batch version changes, including: periodically executing a script to obtain data table change information;

[0005] Determining a change information file according to the data table change information;

[0006] Determining a change batch job list according to the change information file; and

[0007] Displaying the change batch job list.

[0008] According to an embodiment of the present disclosure, the data table change information includes new data table information, deleted data table information, data table structure change information, and data table new batch job information. Determining a change information file according to the data table change information includes:

[0009] Determining a list of table names of newly added data tables according to the new data table information;

[0010] Determining a list of table names of deleted data tables according to the deleted data table information;

[0011] Determining a list of table names of data table structure changes according to the data table structure change information; and

[0012] Determining a list of table names and a list of job names of data tables according to the data table new batch job information.

[0013] According to an embodiment of the present disclosure, determining a list of table names of newly added data tables according to the new data table information includes:

[0014] Obtain the log of the newly created table; and

[0015] Perform keyword extraction on the log of the newly created table to determine the list of table names of the newly added data tables.

[0016] According to an embodiment of the present disclosure, the determining the list of table names of the data tables to be deleted based on the data table deletion information includes:[[]]

[0017] Obtain the log of the deleted table; and

[0018] Perform keyword extraction on the log of the deleted table to obtain the list of table names of the data tables to be deleted.

[0019] According to an embodiment of the present disclosure, the determining the list of table names of the data table structure changes based on the data table structure change information includes:[[]]

[0020] Obtain the list of files in the fixed directory; and

[0021] Perform truncation on the list of files to determine the list of table names of the data table structure changes.

[0022] According to an embodiment of the present disclosure, the determining the list of table names and job names of the data tables based on the data table new batch job information includes:[[]]

[0023] Obtain the configuration SQL file of the new batch job;

[0024] Determine the configuration insert statement according to the SQL file; and

[0025] Parse the configuration insert statement to determine the list of table names and job names of the data tables.

[0026] According to an embodiment of the present disclosure, determining the change batch job list according to the change information file includes:[[]]

[0027] Determine the changed data table names according to the change information file;

[0028] Determine the corresponding batch job names according to the changed data table names; and

[0029] Determine the change batch job list according to the changed data table names, the batch job names and the change types.

[0030] According to an embodiment of the present disclosure, the determining the corresponding batch job names according to the changed data table names includes:[[]]

[0031] Determine the query statement of the data configuration table according to the changed data table names; and

[0032] Log in to the database and execute the query statement to determine the batch job names corresponding to the changed data table names.

[0033] The second aspect of the present disclosure provides a monitoring device for batch version changes, including: an acquisition module, configured to execute a script at regular intervals to obtain data table change information;

[0034] a first determination module, configured to determine a change information file according to the data table change information;

[0035] a second determination module, configured to determine a change batch job list according to the change information file; and

[0036] a display module, configured to display the change batch job list.

[0037] The third aspect of the present disclosure provides an electronic device, including: one or more processors; a memory, configured to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors are caused to execute the above-mentioned monitoring method for batch version changes.

[0038] The fourth aspect of the present disclosure further provides a computer-readable storage medium, on which executable instructions are stored, and when the instructions are executed by a processor, the processor is caused to execute the above-mentioned monitoring method for batch version changes.

[0039] The fifth aspect of the present disclosure further provides a computer program product, including a computer program, and when the computer program is executed by a processor, the above-mentioned monitoring method for batch version changes is implemented.

[0040] Through the monitoring method for batch version changes provided by the embodiments of the present disclosure, by executing a script at regular intervals to obtain data table change information, processing the data table change information to generate a change batch job list, and displaying the change batch job list, testers can master the data table change situation and the corresponding batch job names of the data tables, so as to focus on testing the changed content specifically and improve the testing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, the above-mentioned content and other objects, features and advantages of the present disclosure will become clearer. In the drawings:

[0042] Figure 1 Schematically shows an application scenario diagram of a monitoring method, device, equipment, medium and program product for batch version changes according to an embodiment of the present disclosure;

[0043] Figure 2 Schematically shows a system architecture diagram that can be used for a monitoring method for batch version changes according to an embodiment of the present disclosure;

[0044] Figure 3Schematically shows a flowchart of a method for monitoring batch version changes according to an embodiment of the present disclosure;

[0045] Figure 4 Schematically shows a flowchart of a method for processing data table change information according to an embodiment of the present disclosure;

[0046] Figure 5 Schematically shows a structural block diagram of a monitoring device for batch version changes according to an embodiment of the present disclosure; and

[0047] Figure 6 Schematically shows a block diagram of an electronic device suitable for implementing the method for monitoring batch version changes according to an embodiment of the present disclosure. Detailed implementation manners

[0048] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are merely exemplary and are not intended to limit the scope of the present disclosure. In the following detailed description, for the sake of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is obvious that one or more embodiments can also be implemented without these specific details. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily confusing the concepts of the present disclosure.

[0049] The terms used herein are merely for describing specific embodiments and are not intended to limit the present disclosure. The terms "including", "comprising", etc. used herein indicate the presence of the described features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0050] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0051] In the case of using expressions such as "at least one of A, B, and C", generally, it should be interpreted according to the meaning commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include, but not be limited to, a system having only A, only B, only C, having A and B, having A and C, having B and C, and / or having A, B, and C).

[0052] Embodiments of the present disclosure provide a method for monitoring batch version changes, including: periodically executing a script to obtain data table change information; determining a change information file based on the data table change information; determining a change batch job list based on the change information file; and displaying the change batch job list.

[0053] Figure 1 FIG. schematically shows an application scenario diagram of a method, apparatus, device, medium, and program product for monitoring batch version changes according to an embodiment of the present disclosure. Figure 2 FIG. schematically shows a system architecture diagram that can be used for the method for monitoring batch version changes according to an embodiment of the present disclosure. It should be noted that Figure 1 the application scenario shown Figure 2 and the system architecture shown are only examples of the application scenario and system architecture that can be used for the embodiments of the present disclosure, to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments, or scenarios. It should be noted that the method and apparatus for monitoring batch version changes provided by the embodiments of the present disclosure can be used in related aspects of the big data technology field and the financial field, and can also be used in any field other than the financial field. The application fields of the method and apparatus for monitoring batch version changes provided by the embodiments of the present disclosure are not limited.

[0054] As Figure 1 and Figure 2 shown, the application scenario 100 according to this embodiment may include a monitoring scenario for batch version changes. Testers can use the terminal device 104 to interact with the big data platform 101 to receive or send messages, etc. The change information extraction module automatically obtains the change information 102 from the big data platform 101 by setting a scheduled task. The change information 102 is saved in the txt file format. The change information processing module processes the change information 102 to generate a change batch job list 103. The change batch job display module displays the change batch job list 103 to the tester through the terminal device 104. The tester conducts targeted and focused testing on the change information according to the change batch job list, thereby improving the testing efficiency.

[0055] It should be understood that Figure 1 the numbers of terminal devices, networks, and servers in

[0056] are merely illustrative. According to actual needs, there can be any number of terminal devices, networks, and servers. Figure 1 Based on the scenario described below Figures 3 to 6 the method for monitoring batch version changes of the disclosed embodiments will be described in detail.

[0057] Figure 3The flowchart of the monitoring method for batch version changes according to an embodiment of the present disclosure is schematically shown.

[0058] As Figure 3 shown, the monitoring method for batch version changes in this embodiment includes operations S210 to S240, and this method can be executed by a monitoring server.

[0059] In one example, the big data platform in the embodiment of the present disclosure can be, for example, a hadoop platform. The monitoring method for batch version changes in the embodiment of the present disclosure includes three parts: change information extraction, change information processing, and change batch job display. Among them, operations S210 and S220 are the change information extraction part, operation S230 is the change information processing part, and operation S240 is the change batch job display part.

[0060] In operation S210, a script is executed regularly to obtain data table change information.

[0061] According to an embodiment of the present disclosure, the data table change information includes new data table information, deleted data table information, data table structure change information, and data table new batch job information.

[0062] In one example, the change information acquisition mainly involves four change types: new data table, deleted data table, data table structure change, and data table new batch job. Information is grabbed through the installation records of the version, the batch version change monitoring tool is executed at a fixed frequency, and the execution frequency of the script is set through a scheduled task. The script is executed regularly to obtain data table change information, including new data table information, deleted data table information, data table structure change information, and data table new batch job information.

[0063] In operation S220, a change information file is determined according to the data table change information.

[0064] In one example, the change records of the data table are usually saved in the form of logs on the scheduling server. A change information file is generated according to the data table change information obtained in operation S210, including the list of table names of new data tables create.txt, the list of table names of deleted data tables drop.txt, the list of table names of data table structure changes alter.txt, and the list of new batch job names of data tables insert.txt. The change information file records the table names of the changed data tables and the list of new batch job names of the data tables.

[0065] In operation S230, a change batch job list is determined according to the change information file.

[0066] In one example, since the tester tests the changed data table through a test batch job, after obtaining the change information file, it is necessary to process the change information file. The main process is to process three tables: the list of table names create.txt for newly added data tables, the list of table names drop.txt for deleted data tables, and the list of table names alter.txt for data table structure changes, to determine the names of the changed data tables and the corresponding batch job names for the changed data tables. Finally, integrate with the list of data table names and batch job names in the data table new batch job name list insert.txt, and generate a change batch job list according to the changed data table names, batch job names, and change types.

[0067] In operation S240, display the change batch job list.

[0068] In one example, according to the change batch job list generated by operation S230, display the changed data tables, the corresponding batch job names, and the corresponding change types to the tester. The tester can query in the foreground and conduct key tests on the changed content.

[0069] Through the monitoring method for batch version changes provided by the embodiments of the present disclosure, obtain data table change information by periodically executing a script, process the data table change information to generate a change batch job list, and display the change batch job list, enabling the tester to master the data table change situation and the corresponding batch job names for the data tables, so as to conduct key tests on the changed content targeted, and improve the test efficiency.

[0070] Figure 4 Schematically shows a flowchart of a method for processing data table change information according to an embodiment of the present disclosure.

[0071] The change of the data table is usually achieved by executing corresponding command statements, such as insert statements, delete table statements, and new table statements, etc. The execution records of these statements are usually saved on the server in the form of logs. By keyword extraction, the data table change information can be obtained to form a change information file, and then the change information file is processed to obtain a change batch job list. The specific process can be seen in operation S310 to operation S370, where the execution order of operation S310 to operation S340 is not specifically limited.

[0072] In operation S310, determine the list of table names of the newly added data tables according to the newly added data table information.

[0073] According to an embodiment of the present disclosure, obtain the new table log; perform keyword extraction on the new table log to determine the list of table names of the newly added data tables.

[0074] In one example, there is a log of creating a new table in the corresponding scheduling server, such as crete_hive_table.log, which records the log of the specific SQL statement for creating a new data table. The create table statement is, for example,

[0075] (FILE_DATE VARCHAR(12) COMMENT "File Date",

[0076] FILE_NAME VARCHAR(300) COMMENT "File Name",

[0077] SOURCE_APP VARCHAR(15) COMMENT "Source Application",

[0078] DESTIN_APP VARCHAR(15) COMMENT "Destination Application",

[0079] BRANCH_ID VARCHAR(15) COMMENT "Organization Number",

[0080] COMMENTS VARCHAR(3000) COMMENT "Comments")

[0081] COMMENT 'File Record Information Table'

[0082] Keyword extraction (CREATE TABLE) is performed on the create table log (crete_hive_table.log) to obtain the log content containing the table name. Subsequently, keyword truncation is performed to obtain the list of table names of the specific newly added data tables, named create.txt.

[0083] In operation S320, the list of table names of the data tables to be deleted is determined according to the information of deleting data tables.

[0084] According to the embodiments of the present disclosure, the log of deleting tables is obtained; keyword extraction is performed on the log of deleting tables to obtain the list of table names of the data tables to be deleted.

[0085] In one example, there is a log of deleting tables in the corresponding scheduling server, such as delete_hive_table.log, which records the execution records of the statements for deleting tables. For example: Drop table dcm_ta1111_h; The execution records of delete_hive_table.log are extracted to obtain the list of data tables to be deleted, named drop.txt.

[0086] In operation S330, the list of table names of the data tables with structure changes is determined according to the data table structure change information.

[0087] According to an embodiment of the present disclosure, obtain a list of files in a fixed directory; intercept the list of files to determine a list of table names with data table structure changes.

[0088] In one example, the HQL for changing the table structure (with the naming format: table name_yx.hql, such as dcm_ecs_ta1011_h_yx.hql) is stored in a fixed directory on the scheduling server, such as / tmp / yixing / . Obtain the list of files in the fixed directory and write it into a file; then intercept the list of files to obtain a list of table names with table structure changes (such as: dcm_ecs_ta1011_h), named alter.txt.

[0089] In operation S340, determine a list of table names and a list of job names of the data tables according to the information of newly added batch jobs for the data tables.

[0090] According to an embodiment of the present disclosure, obtain the configuration SQL file for newly added batch jobs; determine the configured insert statements according to the SQL file; parse the configured insert statements to determine a list of table names and a list of job names of the data tables.

[0091] There is a SQL file for configuring the insertion of newly added batch jobs in a fixed path of the scheduling server, such as (kfzx-001247729_20210719141031_init_bdp_table_src.sql). The SQL file records the configured insert statements for newly added batch jobs, such as insert into bdp_table_a(app, table_name, job_name) values(to_char(q′!F-ACIA!′), to_char(q′!dcm_ecs_ta1111_h!′), to_char(q′!DCM_ECS_TA1111_H_USI_000!′). By parsing the insert statement, obtain the corresponding table name dcm_ecs_ta1111_h and the list of job names DCM_ECS_TA1111_H_USI_000, named insert.txt.

[0092] In operation S350, determine the table names of the changed data tables according to the change information file. In operation S360, determine the corresponding batch job names according to the table names of the changed data tables.

[0093] According to an embodiment of the present disclosure, determine the query statement of the data configuration table according to the table names of the changed data tables; log in to the database and execute the query statement to determine the batch job names corresponding to the table names of the changed data tables.

[0094] In one example, after obtaining the change information files (create.txt, drop.txt, alter.txt, and insert.txt), the corresponding files are processed to add the corresponding change types, and query statements for the background oracle data configuration table are generated based on the data table names in the change information files to query the batch job names corresponding to the change data table names.

[0095] In operation S370, a change batch job list is determined based on the change data table name, the batch job name, and the change type.

[0096] In one example, based on the batch job name list obtained in operation S360, and by associating create.txt, drop.txt, and alter.txt according to the table name to obtain the change type, and finally integrating with the insert.txt file, a corresponding change batch job list is generated. The change batch job list includes the change data table, the corresponding batch job name, and the change type.

[0097] Based on the above monitoring method for batch version changes, the present disclosure also provides a monitoring device for batch version changes. The following will be combined with Figure 5 to describe the device in detail.

[0098] Figure 5 The structural block diagram of the monitoring device for batch version changes according to an embodiment of the present disclosure is schematically shown.

[0099] As Figure 5 shown, the monitoring device 500 for batch version changes in this embodiment includes an acquisition module 510, a first determination module 520, a second determination module 530, and a display module 540.

[0100] The acquisition module 510 is used to periodically execute a script to obtain data table change information. In one embodiment, the acquisition module 510 can be used to execute operation S210 described above, which will not be elaborated here.

[0101] The first determination module 520 is used to determine the change information file according to the data table change information. In one embodiment, the first determination module 520 can be used to execute operation S220 described above, which will not be elaborated here.

[0102] The second determination module 530 is used to determine the change batch job list according to the change information file. In one embodiment, the second determination module 530 can be used to execute operation S230 described above, which will not be elaborated here.

[0103] The display module 540 is used to display the change batch job list. In one embodiment, the display module 540 can be used to execute operation S240 described above, which will not be elaborated here.

[0104] According to an embodiment of the present disclosure, any plurality of the acquisition module 510, the first determination module 520, the second determination module 530, and the display module 540 may be combined and implemented in one module, or any one of them may be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules may be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the acquisition module 510, the first determination module 520, the second determination module 530, and the display module 540 may be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or any other reasonable manner of integrating or packaging circuits, etc., in hardware or firmware, or implemented in any one of the three implementation manners of software, hardware, and firmware, or in a suitable combination of any several of them. Alternatively, at least one of the acquisition module 510, the first determination module 520, the second determination module 530, and the display module 540 may be at least partially implemented as a computer program module, and when the computer program module is run, corresponding functions may be executed.

[0105] Figure 6 A block diagram of an electronic device suitable for implementing a monitoring method for batch version change according to an embodiment of the present disclosure is schematically shown.

[0106] As Figure 6 shown, the electronic device 900 according to an embodiment of the present disclosure includes a processor 901, which may perform various appropriate actions and processes according to a program stored in a read only memory (ROM) 902 or a program loaded from a storage section 908 into a random access memory (RAM) 903. The processor 901 may include, for example, a general microprocessor (such as a CPU), an instruction set processor, and / or a related chipset, and / or a dedicated microprocessor (such as an application specific integrated circuit (ASIC)), etc. The processor 901 may also include on-board memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0107] In the RAM 903, various programs and data required for the operation of the electronic device 900 are stored. The processor 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. The processor 901 performs various operations of the method flow according to the embodiments of the present disclosure by executing the programs in the ROM 902 and / or the RAM 903. It should be noted that the programs may also be stored in one or more memories other than the ROM 902 and the RAM 903. The processor 901 may also perform various operations of the method flow according to the embodiments of the present disclosure by executing the programs stored in the one or more memories.

[0108] According to an embodiment of the present disclosure, the electronic device 900 may further include an input / output (I / O) interface 905, and the input / output (I / O) interface 905 is also connected to the bus 904. The electronic device 900 may further include one or more of the following components connected to the I / O interface 905: an input portion 906 including a keyboard, a mouse, etc.; an output portion 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage portion 908 including a hard disk, etc.; and a communication portion 909 including a network interface card such as a LAN card, a modem, etc. The communication portion 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is mounted on the drive 910 as needed so that a computer program read from it can be installed into the storage portion 908 as needed.

[0109] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist separately without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the one or more programs are executed, a monitoring method for batch version change according to the embodiments of the present disclosure is implemented.

[0110] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example, but not limited to: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in conjunction with an instruction execution system, apparatus, or device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 902 and / or RAM 903 described above and / or one or more memories other than the ROM 902 and RAM 903.

[0111] An embodiment of the present disclosure also includes a computer program product, which includes a computer program that contains program code for executing the method shown in the flowchart. When the computer program product runs in a computer system, the program code is used to enable the computer system to implement the monitoring method for batch version change provided by the embodiment of the present disclosure.

[0112] When the computer program is executed by the processor 901, the above functions defined in the system / apparatus of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the above-described system, apparatus, module, unit, etc. may be implemented by computer program modules.

[0113] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices and magnetic storage devices. In another embodiment, the computer program may also be transmitted and distributed in the form of a signal on a network medium and downloaded and installed through the communication part 909, and / or installed from the removable medium 911. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0114] In such an embodiment, the computer program may be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the processor 901, the above functions defined in the system of the embodiment of the present disclosure are executed. According to an embodiment of the present disclosure, the above-described system, device, apparatus, module, unit, etc. may be implemented by computer program modules.

[0115] In accordance with embodiments of the present disclosure, program code for executing the computer programs provided by the embodiments of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. The programming languages include, but are not limited to, such as Java, C++, Python, the "C" language, or similar programming languages. The program code can be executed entirely on the user's computing device, partially on the user's device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device can be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., by connecting through the Internet using an Internet service provider).

[0116] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, a program segment, or a portion of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than that marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, and combinations of blocks in the block diagram or flowchart, can be implemented by a dedicated hardware-based system for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0117] Those skilled in the art can understand that the features recited in the various embodiments and / or claims of the present disclosure can be combined or / and combined in various ways, even if such combinations or combinations are not explicitly recited in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features recited in the various embodiments and / or claims of the present disclosure can be combined and / or combined in various ways. All such combinations and / or combinations fall within the scope of the present disclosure.

[0118] The embodiments of the present disclosure have been described above. However, these embodiments are merely for illustrative purposes and not for limiting the scope of the present disclosure. Although the embodiments have been described separately above, this does not mean that the measures in each embodiment cannot be used advantageously in combination. The scope of the present disclosure is defined by the appended claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art can make various substitutions and modifications, and these substitutions and modifications should all fall within the scope of the present disclosure.

Claims

1. A monitoring method for batch version changes, characterized in that, Including: Periodically execute a script to obtain data table change information; Determine a change information file according to the data table change information; Determine a change batch job list according to the change information file; And Display the change batch job list, wherein, the data table change information includes new data table information, deleted data table information, data table structure change information, and data table new batch job information. Determining a change information file according to the data table change information includes: Determine a list of table names of newly added data tables according to the new data table information; Determine a list of table names of deleted data tables according to the deleted data table information; Determine a list of table names of data table structure changes according to the data table structure change information; and Determine a list of table names and a list of job names of data tables according to the data table new batch job information; wherein, determining a change batch job list according to the change information file includes: Determine the table names of changed data tables according to the change information file; Determine the corresponding batch job names according to the table names of the changed data tables; and Determine a change batch job list according to the table names of the changed data tables, the batch job names, and the change types.

2. The method according to claim 1, characterized in that, The determining a list of table names of newly added data tables according to the new data table information includes: Obtain the new table log; and Perform keyword extraction on the new table log to determine a list of table names of newly added data tables.

3. The method according to claim 1, wherein The determining a list of table names of deleted data tables according to the deleted data table information includes: Obtain the deleted table log; and Perform keyword extraction on the deleted table log to obtain a list of table names of deleted data tables.

4. The method according to claim 1, wherein The determining a list of table names of data table structure changes according to the data table structure change information includes: Obtain the file list in a fixed directory; and Intercept the file list to determine a list of table names of data table structure changes.

5. The method according to claim 1, wherein The determining a list of table names and a list of job names of data tables according to the data table new batch job information includes: Obtain the configuration SQL file of the new batch job; Determine the configuration insert statement according to the SQL file; and Parse the configuration insert statement to determine a list of table names and a list of job names of data tables.

6. The method according to claim 1, wherein The determining the corresponding batch job names according to the table names of the changed data tables includes: Determine the query statement of the data configuration table according to the table names of the changed data tables; and Log in to the database and execute the query statement to determine the batch job names corresponding to the table names of the changed data tables.

7. A monitoring device for batch version change, including: An acquisition module, configured to periodically execute a script to obtain data table change information, where the data table change information includes new data table information, deleted data table information, data table structure change information, and data table new batch job information; A first determination module, configured to determine a change information file according to the data table change information; A second determination module, configured to determine a change batch job list according to the change information file; And A display module, configured to display the change batch job list, The first determination module is further configured to determine a list of table names of newly added data tables according to the new data table information; determine a list of table names of deleted data tables according to the deleted data table information; Determine a list of table names for the data table structure change based on the data table structure change information; Determine a list of table names and a list of job names for the data table based on the data table new batch job information; The second determination module is further configured to determine the changed data table name according to the change information file; Determine the corresponding batch job name according to the changed data table name; And determine a changed batch job list according to the changed data table name, the batch job name, and the change type.

8. An electronic device, comprising: One or more processors; A storage device for storing one or more programs, Wherein, when the one or more programs are executed by the one or more processors, the one or more processors are caused to execute the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, having executable instructions stored thereon, which when executed by a processor cause the processor to execute the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, which when executed by a processor implements the method according to any one of claims 1 to 6.

Images