Business data table processing method and device and electronic equipment

Abstract

The invention relates to a business data table processing method and device and electronic equipment, and belongs to the technical field of data processing. Comprising the following steps: archiving a historical business data table to obtain a first zipper table; querying a data cleaning configuration table, wherein the data cleaning configuration table comprises a candidate service data table to be cleaned; determining a to-be-cleaned first business data table from the candidate business data tables, and performing business field comparison on the first business data table and the first zipper table to obtain a newly added business field and a changed business field; determining a to-be-cleaned second business data table in the historical business data table; removing the second business data table from the first zipper table, adding the newly added business field and the changed business field to the first zipper table to obtain a second zipper table, and performing data removing operation and data adding operation on the first zipper table by performing archiving processing on the historical business data table. And the efficiency and the accuracy in the processing process of the service data table are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing, and in particular to a method, device and electronic device for processing a business data table. Background Art

[0002] In the related technology, when the amount of data in the historical business data table is too large, the historical business data table is not archived first, but the data clearing strategy is directly called to process the historical business data table, resulting in low efficiency and accuracy in the processing of the business data table. Therefore, how to improve the accuracy and efficiency of the processing of the business data table has become a problem that needs to be solved urgently. Summary of the invention

[0003] The present disclosure provides a method, device, electronic device, computer-readable storage medium and computer program product for processing a business data table, so as to at least solve the problem of low efficiency and accuracy in the process of processing a business data table in the related art.

[0004] The technical solution of the present disclosure is as follows:

[0005] According to a first aspect of an embodiment of the present disclosure, a method for processing a business data table is provided, the method comprising: archiving a historical business data table to obtain a first zipper table, the first zipper table comprising business fields, an opening date and a closing date of the historical business data table; querying a data cleaning configuration table, the data cleaning configuration table comprising candidate business data tables to be cleaned; performing parameter verification on the candidate business data tables to determine a first business data table to be cleaned from the candidate business data tables, and performing business field comparison on the first business data table and the first zipper table to obtain newly added business fields and changed business fields; determining a second business data table to be cleaned in the historical business data table according to the opening date and the closing date in the first zipper table; clearing the second business data table from the first zipper table, and adding the newly added business fields and the changed business fields to the first zipper table to obtain a second zipper table.

[0006] According to a second aspect of an embodiment of the present disclosure, a device for processing a business data table is provided, the device comprising: an archiving module, used to archive a historical business data table and obtain a first zipper table, wherein the first zipper table includes a business field, an opening date and a closing date of the historical business data table; a query module, used to query a data cleaning configuration table, wherein the data cleaning configuration table includes candidate business data tables to be cleaned; a verification module, used to perform parameter verification on the candidate business data table to determine a first business data table to be cleaned from the candidate business data table, and compare the business fields of the first business data table and the first zipper table to obtain newly added business fields and changed business fields; a determination module, used to determine a second business data table to be cleaned in the historical business data table according to the opening date and the closing date in the first zipper table; an acquisition module, used to clear the second business data table from the first zipper table, and add the newly added business field and the changed business field to the first zipper table to obtain a second zipper table.

[0007] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the method for processing the business data table as described in the first aspect.

[0008] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can execute the method for processing a business data table as described in the first aspect.

[0009] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the method for processing the business data table as described in the first aspect is implemented.

[0010] The technical solution provided by the embodiment of the present disclosure brings at least the following beneficial effects: by archiving the historical business data table, obtaining the first zipper table, the first zipper table includes the business fields, the opening date and the closing date of the historical business data table, querying the data cleaning configuration table, the data cleaning configuration table includes the candidate business data table to be cleaned, performing parameter verification on the candidate business data table to determine the first business data table to be cleaned from the candidate business data table, and performing business field comparison on the first business data table and the first zipper table to obtain the newly added business field and the changed business field, determining the second business data table to be cleaned in the historical business data table according to the opening date and the closing date in the first zipper table, clearing the second business data table from the first zipper table, and adding the newly added business field and the changed business field to the first zipper table to obtain the second zipper table. Therefore, the present disclosure improves the efficiency and accuracy in the processing of the business data table by archiving the historical business data table and performing data clearing and data adding operations on the first zipper table.

[0011] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0013] Figure 1 It is a flowchart of a method for processing a business data table according to the first embodiment of the present disclosure.

[0014] Figure 2 It is a flowchart of a method for processing a business data table according to the second embodiment of the present disclosure.

[0015] Figure 3 is a block diagram of a device for processing a business data table according to a first embodiment of the present disclosure.

[0016] Figure 4 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0017] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0018] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0019] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards.

[0020] It should be noted that the acquisition, transmission, storage, use, and processing of data in the technical solution of the present disclosure are in compliance with the relevant provisions of relevant laws and regulations. In the embodiments of the present disclosure, certain software, components, models, and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present disclosure, but it does not mean that the applicant has or will necessarily use the solution.

[0021] Figure 1 It is a flowchart of a method for processing a business data table according to the first embodiment of the present disclosure.

[0022] like Figure 1 As shown, the method for processing the business data table of the first embodiment of the present disclosure includes the following steps:

[0023] S101, archiving a historical business data table to obtain a first zipper table, the first zipper table including a business field, a chain opening date, and a chain closing date of the historical business data table.

[0024] In an embodiment of the present disclosure, a partition time period preset in the first zipper table can be obtained, wherein the partition time period is determined by an opening chain time and a closing chain time, and a target business field located in each partition time period is obtained from a historical business data table. The historical business data table is archived according to the target business field and the partition time period to obtain a first zipper table.

[0025] For example, after obtaining the business field, the link opening date, and the link closing date, as shown in Table 1, a first zipper table may be constructed.

[0026] Table 1

[0027] Table name Field Chinese name Field English name Field Type Remark Ending with _H Business Field Ending with _H Opening date START_DATE DATE Ending with _H Closing date END_DATE DATE

[0028] S102, querying a data cleaning configuration table, where the data cleaning configuration table includes candidate business data tables to be cleaned.

[0029] It should be noted that the table structure of the data cleaning configuration table can be preset, and based on the table structure of the data cleaning configuration table, the corresponding field information can be obtained, and the data cleaning configuration table can be constructed according to the table structure and field information set of the data cleaning configuration table.

[0030] For example, as shown in Table 2, by acquiring various field information, a data cleaning configuration table is constructed according to the table structure and field information of the data cleaning configuration table.

[0031] Table 2

[0032]

[0033] In the embodiment of the present disclosure, after the data cleaning configuration table is obtained, a query instruction may be sent to the data cleaning configuration table to query the data cleaning configuration table and obtain the candidate business data table to be cleaned from the data cleaning configuration table.

[0034] S103, performing parameter verification on the candidate business data tables to determine the first business data table to be cleaned up from the candidate business data tables, and performing business field comparison on the first business data table and the first zipper table to obtain newly added business fields and changed business fields.

[0035] In the disclosed embodiment, after obtaining the candidate business data table, the parameter verification of the candidate business data table can be performed to obtain the parameter verification result of the candidate business data table, and the candidate business data table with the parameter verification result as passed is used as the first business data table to be cleaned up.

[0036] It should be noted that the present disclosure does not limit the specific method of performing parameter verification on the candidate business data table and obtaining the parameter verification result of the candidate business data table, and it can be selected according to actual conditions.

[0037] Optionally, the field information set included in the data cleaning configuration table can be determined, the data cleaning result table can be queried, and the parameter verification of the candidate business data table can be performed according to the field information set, the data cleaning result table and the first zipper table to obtain the parameter verification results of the candidate business data table.

[0038] In the disclosed embodiment, after the first business data table is obtained, for the same type of business fields, the first business data table and the first zipper table are compared for business fields to obtain newly added business fields and changed business fields.

[0039] S104: Determine a second business data table to be cleared in the historical business data table according to the opening date and closing date in the first zipper table.

[0040] In the embodiment of the present disclosure, after obtaining the chain opening date and chain closing date, for the same historical business data table existing in both the first zipper table and the historical business data table, the creation date of the historical business data table can be compared with the chain opening date and chain closing date to determine the second business data table to be cleaned up in the historical business data table.

[0041] Optionally, a historical business data table whose creation date is earlier than the link opening date and later than the link closing date may be used as the second business data table.

[0042] S105, clearing the second business data table from the first zipper table, and adding the newly added business field and the changed business field to the first zipper table to obtain a second zipper table.

[0043] In an embodiment of the present disclosure, after obtaining the second business data table, the newly added business field and the changed business field, the second business data table is cleared from the first zipper table, and the newly added business field and the changed business field are added to the first zipper table to obtain the second zipper table.

[0044] In summary, according to the processing method of the business data table provided by the embodiment of the present disclosure, the historical business data table is archived to obtain the first zipper table, the first zipper table includes the business fields, the opening date and the closing date of the historical business data table, the data cleaning configuration table is queried, the data cleaning configuration table includes the candidate business data table to be cleaned, the candidate business data table is parameter-checked to determine the first business data table to be cleaned from the candidate business data table, and the business fields of the first business data table and the first zipper table are compared to obtain the newly added business fields and the changed business fields, and the second business data table to be cleaned in the historical business data table is determined according to the opening date and the closing date in the first zipper table, the second business data table is cleared from the first zipper table, and the newly added business fields and the changed business fields are added to the first zipper table to obtain the second zipper table. Therefore, the present disclosure improves the efficiency and accuracy in the processing of the business data table by archiving the historical business data table and performing data clearing and data adding operations on the first zipper table.

[0045] Figure 2 It is a flowchart of a method for processing a business data table according to the second embodiment of the present disclosure.

[0046] like Figure 2 As shown, the method for processing the business data table of the second embodiment of the present disclosure includes the following steps:

[0047] S201, archiving the historical business data table to obtain a first zipper table, the first zipper table including the business fields, the opening date and the closing date of the historical business data table.

[0048] S202, querying a data cleaning configuration table, where the data cleaning configuration table includes candidate business data tables to be cleaned.

[0049] For the relevant contents of step S201 to step S202, please refer to the above embodiment and will not be repeated here.

[0050] As a possible implementation method, based on the above implementation, the specific process of performing parameter verification on the candidate business data table in step S103 to determine the first business data table to be cleaned from the candidate business data table includes steps S203 to S205:

[0051] S203: Determine a set of field information included in the data cleaning configuration table.

[0052] For example, in the data cleaning configuration table shown in Table 2, the field information set includes multiple field information such as the business data table name, primary key field, date field, and retention days field.

[0053] S204, query the data cleaning result table.

[0054] In the embodiment of the present disclosure, after data cleaning is completed, a data cleaning result table can be constructed based on the data cleaning result information.

[0055] For example, as shown in Table 3, by obtaining various data cleaning result information such as the schema, the name of the business data table, the date of the data cleaning triggering business, and the last data cleaning date, a data cleaning result table is constructed according to the data cleaning result information.

[0056] Table 3

[0057]

[0058] S205, performing parameter verification on the candidate business data table according to the field information set, the data cleaning result table and the first zipper table, and obtaining the parameter verification result of the candidate business data table.

[0059] In the disclosed embodiment, a first parameter check can be performed on the candidate business data table based on the field information set, a second parameter check can be performed on the candidate business data table based on the data cleaning result table, and a third parameter check can be performed on the candidate business data table based on the first zipper table to obtain the parameter check results of the candidate business data table.

[0060] Optionally, for the first level of parameter verification, it can be determined whether the field information of the candidate business data table is complete based on the field information set, and the data cleanup date can be determined based on the retention period field and the current date to determine whether there is business data in the candidate business data table that is before the data cleanup date. In response to the fact that the field information of the candidate business data table is complete and there is business data in the candidate business data table that is before the data cleanup date, it is determined that the candidate business data table has passed the first level of parameter verification.

[0061] Optionally, for the second parameter verification, the last clearing date recorded in the data clearing result table can be obtained, and the data cleansing time interval can be determined based on the data cleansing date and the last clearing date. Based on the data cleansing time interval, it is judged whether the data cleansing dates are continuous. In response to the data cleansing dates being continuous, it is determined that the candidate business data table has passed the second parameter verification.

[0062] Optionally, for the third parameter verification, a set of field information of the first zipper table can be obtained, and for the same type of field information, it is determined whether the field information of the candidate business data table is consistent with the field information of the zipper table. In response to the field information being consistent, it is determined that the candidate business data table has passed the third parameter verification.

[0063] It should be noted that when determining whether the field information of the candidate business data table is consistent with the field information of the zipper table, the timestamp field needs to be excluded.

[0064] S206: Determine a first business data table to be cleared from the candidate business data tables according to the parameter verification result of the candidate business data tables.

[0065] In the embodiment of the present disclosure, in response to the first parameter check, the second parameter check and the third parameter check all passing, it is determined that the candidate business data table is the first business data table.

[0066] In the embodiment of the present disclosure, in response to any one of the heavy parameter verifications failing, it is determined that the parameter verification result of the candidate business data table fails the verification.

[0067] Optionally, if it is determined that the parameter verification result of the candidate business data table fails the verification, such as the clearing detail log table shown in Table 4, the verification result can be recorded in the detail log table for error reporting.

[0068] Table 4

[0069]

[0070] S207, performing a business field comparison between the first business data table and the first zipper table to obtain newly added business fields and changed business fields.

[0071] S208: Determine a second business data table to be cleared in the historical business data table according to the opening date and closing date in the first zipper table.

[0072] For the relevant contents of step S201 to step S202, please refer to the above embodiment and will not be repeated here.

[0073] S209, clearing the second business data table from the first zipper table, and adding the newly added business field and the changed business field to the first zipper table to obtain a second zipper table.

[0074] In an embodiment of the present disclosure, a data new record table can be obtained based on the newly added business field and the changed business field, the data new record table can be inserted into the first zipper table, the opening date of the data new record table can be set to the current date, and the closing date can be set to the target date.

[0075] The target date may be a larger pre-set date, for example, the target date may be 2999-12-31, or for another example, the target date may be 9999-12-31.

[0076] For example, based on the newly added business field and the changed business field, the data newly added record table VT_CHG_DATA is obtained, the data newly added record table VT_CHG_DATA is inserted into the first zipper table, the opening date of the data newly added record table is set to the current date, and the closing date is set to 2999-12-31.

[0077] In an embodiment of the present disclosure, a third business data table that existed in the previous cycle but does not exist in the current cycle in the first zipper table can be obtained, the second business data table and the third business data table can be cleared from the first zipper table to obtain a data clearing record table, the data clearing record table can be inserted into the first zipper table, and the closed date of the data clearing record table can be set to the current date.

[0078] It should be noted that you can check whether the second business data table is a partition table. If it is a partition table, clear the business data table corresponding to the sub-partition from the first zipper table, and retain the business data table corresponding to the end-of-month data. The massive parallel processing structure (Massive Parallel Processing, MPP for short) redistributes the business data table or sub-partition to reclaim space.

[0079] It should be noted that the processing tasks can be pre-set, the processing tasks can be scheduled according to the preset time, and the business data table can be processed according to the processing tasks.

[0080] After the business data table is processed, the processing results can be recorded in the clearing detail log table and the clearing result table. If an abnormal situation occurs during the processing, the transaction will be rolled back.

[0081] In summary, according to the processing method of the business data table provided by the embodiment of the present disclosure, by archiving the historical business data table, a first zipper table is obtained, the first zipper table includes the business fields, opening date and closing date of the historical business data table, the data cleaning configuration table is queried, the data cleaning configuration table includes the candidate business data table to be cleaned, the data cleaning configuration table is queried, the data cleaning configuration table includes the candidate business data table to be cleaned, the data cleaning result table is queried, and according to the field information set, the data cleaning result table and the first zipper table, the parameter verification is performed on the candidate business data table respectively to obtain the parameter verification result of the candidate business data table, and according to the parameter verification result of the candidate business data table, the first business data table to be cleaned is determined from the candidate business data table, the business fields of the first business data table and the first zipper table are compared to obtain the newly added business The business field and the changed business field are determined according to the opening date and closing date in the first zipper table, and the second business data table to be cleaned up in the historical business data table is determined, the second business data table is cleared from the first zipper table, and the newly added business field and the changed business field are added to the first zipper table to obtain the second zipper table. Therefore, the present disclosure can archive the full slice table to obtain the zipper table, solve the large table problem from the source, and can automatically clear the second business data table and the third business data table from the first zipper table, and can restore the cleared data, reducing the risks caused by business data table cleaning, and reducing the labor cost in the business data table processing process and avoiding errors in the manual processing process, thereby improving the efficiency and accuracy in the business data table processing process, which is beneficial to the batch running and data query of the later production operations.

[0082] Figure 3 It is a block diagram of a device for processing a business data table according to the first embodiment of the present disclosure.

[0083] like Figure 3 As shown, the business data table processing device 300 of the embodiment of the present disclosure includes: an archiving module 301, a query module 302, a verification module 303, a determination module 304 and an acquisition module 305.

[0084] The archiving module 301 is used to archive the historical business data table to obtain a first zipper table, wherein the first zipper table includes the business field, the opening date and the closing date of the historical business data table;

[0085] A query module 302 is used to query a data cleaning configuration table, wherein the data cleaning configuration table includes a candidate business data table to be cleaned;

[0086] A verification module 303 is used to perform parameter verification on the candidate business data table to determine the first business data table to be cleaned up from the candidate business data table, and compare the business fields of the first business data table and the first zipper table to obtain the newly added business fields and the changed business fields;

[0087] A determination module 304, configured to determine a second business data table to be cleared in the historical business data table according to the zipper opening date and the zipper closing date in the first zipper table;

[0088] The acquisition module 305 is used to clear the second business data table from the first zipper table, and add the newly added business field and the changed business field to the first zipper table to obtain a second zipper table.

[0089] In one embodiment of the present disclosure, the verification module 303 is also configured to: determine the field information set included in the data cleaning configuration table; query the data cleaning result table; perform parameter verification on the candidate business data table according to the field information set, the data cleaning result table and the first zipper table, and obtain the parameter verification result of the candidate business data table; determine the first business data table to be cleaned from the candidate business data table according to the parameter verification result of the candidate business data table.

[0090] In one embodiment of the present disclosure, the verification module 303 is further configured to: perform a first parameter verification on the candidate business data table according to the field information set; perform a second parameter verification on the candidate business data table according to the data cleaning result table; perform a third parameter verification on the candidate business data table according to the first zipper table; in response to the first parameter verification, the second parameter verification and the third parameter verification all passing, determine that the candidate business data table is the first business data table.

[0091] In one embodiment of the present disclosure, the verification module 303 is also configured to: determine whether the field information of the candidate business data table is complete based on the field information set; determine the data cleanup date based on the retention duration field and the current date, and determine whether there is business data in the candidate business data table that is before the data cleanup date; in response to the field information of the candidate business data table being complete and the presence of business data in the candidate business data table that is before the data cleanup date, determine that the candidate business data table passes the first parameter verification.

[0092] In one embodiment of the present disclosure, the verification module 303 is also configured to: obtain the last clearing date recorded in the data clearing result table; determine the data clearing time interval based on the data clearing date and the last clearing date; determine whether the data clearing dates are continuous based on the data clearing time interval; in response to the data clearing dates being continuous, determine that the candidate business data table passes the second parameter verification.

[0093] In one embodiment of the present disclosure, the verification module 303 is also configured to: obtain a set of field information of the first zipper table, and for the same type of field information, determine whether the field information of the candidate business data table is consistent with the field information of the zipper table; in response to the consistency of the field information, determine that the candidate business data table passes the third parameter verification.

[0094] In one embodiment of the present disclosure, the archiving module 301 is further configured to: obtain a partition time period preset in the first zipper table, wherein the partition time period is determined by an opening chain time and a closing chain time; obtain a target business field located in each of the partition time periods from the historical business data table, and archive the historical business data table according to the target business field and the partition time period to obtain the first zipper table.

[0095] In one embodiment of the present disclosure, the acquisition module 305 is also configured to: acquire a data new record table based on the new business field and the changed business field; insert the data new record table into the first zipper table, set the opening date of the data new record table to the current date and the closing date to the target date.

[0096] In one embodiment of the present disclosure, the acquisition module 305 is also configured to: acquire a third business data table in the first zipper table that existed in the previous cycle but does not exist in the current cycle; clear the second business data table and the third business data table from the first zipper table to obtain a data clearing record table; insert the data clearing record table into the first zipper table, and set the link date of the data clearing record table to the current date.

[0097] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0098] In summary, the processing device of the business data table provided by the embodiment of the present disclosure obtains the first zipper table by archiving the historical business data table, the first zipper table includes the business fields, the opening date and the closing date of the historical business data table, queries the data cleaning configuration table, the data cleaning configuration table includes the candidate business data table to be cleaned, performs parameter verification on the candidate business data table to determine the first business data table to be cleaned from the candidate business data table, and compares the business fields of the first business data table and the first zipper table to obtain the newly added business fields and the changed business fields, determines the second business data table to be cleaned in the historical business data table according to the opening date and the closing date in the first zipper table, clears the second business data table from the first zipper table, and adds the newly added business fields and the changed business fields to the first zipper table to obtain the second zipper table. Therefore, the present disclosure improves the efficiency and accuracy in the processing of the business data table by archiving the historical business data table and performing data clearing and data adding operations on the first zipper table.

[0099] Figure 4 It is a block diagram of an electronic device according to an exemplary embodiment.

[0100] like Figure 4 As shown, the electronic device 400 includes:

[0101] The memory 410 and the processor 420, a bus 430 connecting different components (including the memory 410 and the processor 420), the memory 410 stores a computer program, and when the processor 420 executes the program, the method for processing the business data table described in the embodiment of the present disclosure is implemented.

[0102] Bus 430 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.

[0103] The electronic device 400 typically includes a variety of electronic device readable media. These media can be any available media that can be accessed by the electronic device 400, including volatile and non-volatile media, removable and non-removable media.

[0104] The memory 410 may also include computer system readable media in the form of volatile memory, such as random access memory (RAM) 440 and / or cache memory 450. The electronic device 400 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 460 may be used to read and write non-removable, non-volatile magnetic media ( Figure 4 not shown, usually called a "hard drive"). Although Figure 4 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 430 via one or more data medium interfaces. The memory 410 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present disclosure.

[0105] A program / utility 480 having a set (at least one) of program modules 470 may be stored, for example, in the memory 410, such program modules 470 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 470 generally perform the functions and / or methods of the embodiments described in the present disclosure.

[0106] The electronic device 400 may also communicate with one or more external devices 490 (e.g., keyboard, pointing device, display 491, etc.), one or more devices that enable a user to interact with the electronic device 400, and / or any device that enables the electronic device 400 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed through an input / output (I / O) interface 492. Furthermore, the electronic device 400 may also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN) and / or public network, such as the Internet) through a network adapter 493. Figure 4 As shown, the network adapter 493 communicates with other modules of the electronic device 400 via the bus 430. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device 400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0107] The processor 420 executes various functional applications and data processing by running the programs stored in the memory 410 .

[0108] It should be noted that the implementation process and technical principles of the electronic device of this embodiment refer to the aforementioned explanation of the method for processing the business data table of the embodiment of the present disclosure, and will not be repeated here.

[0109] In summary, the electronic device provided by the embodiment of the present disclosure can execute the processing method of the business data table as described above, by obtaining the indicator data to be verified, obtaining the identification information and source identification information of the business report associated with the indicator data, and the coordinate information of the indicator data in the business report, and using the identification information, source identification information and coordinate information as the associated information of the indicator data, and standardizing the indicator data according to the associated information to obtain standard indicator data, obtaining the verification rules preset for the standard indicator data, verifying the standard indicator data based on the verification rules, and obtaining the verification results of the indicator data to be verified. Therefore, the present disclosure realizes the unification of the indicator data format and improves the readability of the indicator data by standardizing the indicator data, and verifies the standard indicator data based on the verification rules, thereby improving the accuracy and efficiency of the indicator data verification process.

[0110] In order to implement the above embodiments, the present disclosure also proposes a computer-readable storage medium.

[0111] When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device can implement the processing method of the business data table as described above. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0112] In order to implement the above embodiments, the present disclosure further provides a computer program product, including a computer program, characterized in that when the computer program is executed by a processor, the method for processing the business data table as described above is implemented.

[0113] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0114] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for processing a business data table, characterized in that: The method comprises Archiving the historical business data table to obtain a first zipper table, wherein the first zipper table includes a business field, a chain opening date, and a chain closing date of the historical business data table; Querying a data cleaning configuration table, wherein the data cleaning configuration table includes a candidate business data table to be cleaned; Performing parameter verification on the candidate business data table to determine a first business data table to be cleaned up from the candidate business data table, and performing business field comparison on the first business data table and the first zipper table to obtain newly added business fields and changed business fields; Determine a second business data table to be cleared in the historical business data table according to the zipper opening date and the zipper closing date in the first zipper table; The second business data table is cleared from the first zipper table, and the newly added business field and the changed business field are added to the first zipper table to obtain a second zipper table.

2. The method according to claim 1, characterized in that The performing parameter verification on the candidate business data table to determine the first business data table to be cleared from the candidate business data table includes: Determine the field information set included in the data cleaning configuration table; Query the data cleaning result table; According to the field information set, the data cleaning result table and the first zipper table, respectively perform parameter verification on the candidate business data table to obtain the parameter verification result of the candidate business data table; According to the parameter verification result of the candidate business data table, a first business data table to be cleared is determined from the candidate business data table.

3. The method according to claim 2, characterized in that The performing parameter verification on the candidate business data table to determine the first business data table to be cleared from the candidate business data table includes: Performing a first parameter check on the candidate business data table according to the field information set; According to the data cleaning result table, performing a second parameter check on the candidate business data table; According to the first zipper table, performing a third parameter check on the candidate business data table; In response to the first parameter check, the second parameter check and the third parameter check all passing, it is determined that the candidate business data table is the first business data table.

4. The method according to claim 3, characterized in that The performing a first parameter check on the candidate business data table according to the field information set includes: According to the field information set, determining whether the field information of the candidate business data table is complete; Determine a data cleanup date according to the retention duration field and the current date, and judge whether there is business data before the data cleanup date in the candidate business data table; In response to the field information of the candidate business data table being complete and the business data before the data cleansing date existing in the candidate business data table, it is determined that the candidate business data table passes the first parameter verification.

5. The method according to claim 3, characterized in that: The performing a second parameter check on the candidate business data table according to the data cleaning result table includes: Obtain the last clearing date recorded in the data clearing result table; Determine a data cleaning time interval according to the data cleaning date and the last cleaning date; According to the data cleaning time interval, determining whether the data cleaning dates are continuous; In response to the data cleaning dates being continuous, it is determined that the candidate business data table passes the second parameter verification.

6. The method according to claim 3, characterized in that The performing a third parameter check on the candidate business data table according to the first zipper table includes: Acquire the field information set of the first zipper table, and determine whether the field information of the candidate business data table is consistent with the field information of the zipper table for the same type of field information; In response to the field information being consistent, it is determined that the candidate business data table passes the third parameter check.

7. The method according to claim 1, characterized in that The archiving of the historical business data table to obtain the first zipper table also includes: Obtaining a partition time period preset in the first zipper table, wherein the partition time period is determined by a chain opening time and a chain closing time; The target business field in each partition time period is obtained from the historical business data table, and the historical business data table is archived according to the target business field and the partition time period to obtain the first zipper table.

8. The method according to claim 1, characterized in that The adding the newly added business field and the changed business field to the first zipper table includes: Based on the newly added business field and the changed business field, obtaining a data newly added record table; Insert the data addition record table into the first zipper table, set the opening date of the data addition record table to the current date and the closing date to the target date.

9. Description of the method according to claim 1, characterized in that The clearing the second business data table from the first zipper table includes: Acquire a third business data table in the first zipper table that existed in the previous cycle but does not exist in the current cycle; Clear the second business data table and the third business data table from the first zipper table to obtain a data clearing record table; The data clearing record table is inserted into the first zipper table, and the closing date of the data clearing record table is set to the current date.

10. A device for processing a business data table, characterized in that: The device comprises: An archiving module, used to archive the historical business data table and obtain a first zipper table, wherein the first zipper table includes the business field, the opening date and the closing date of the historical business data table; A query module, used to query a data cleaning configuration table, wherein the data cleaning configuration table includes a candidate business data table to be cleaned; A verification module, configured to perform parameter verification on the candidate business data table to determine a first business data table to be cleaned up from the candidate business data table, and compare business fields of the first business data table and the first zipper table to obtain newly added business fields and changed business fields; A determination module, configured to determine a second business data table to be cleared in the historical business data table according to the zipper opening date and the zipper closing date in the first zipper table; The acquisition module is used to clear the second business data table from the first zipper table, and add the newly added business field and the changed business field to the first zipper table to obtain a second zipper table.

11. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instruction to implement the method for processing the business data table according to any one of claims 1 to 9.

12. A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method for processing a business data table as described in any one of claims 1 to 9.

13. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method for processing a business data table according to any one of claims 1 to 9 is implemented.

Images