Upstream and downstream data processing method and device, processor and electronic device

Abstract

The present application discloses a method and device for processing upstream and downstream data, a processor, and an electronic device, which relates to the field of financial technology. The method comprises: obtaining change data of a first target data table in an upstream source system within a preset time period to obtain a first record table; obtaining change data of a second target data table in a downstream application within a preset time period to obtain a second record table; comparing the number of changes in the first record table with the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same. Through the present application, the problem that the accuracy of data verification is relatively low, which can only be achieved by manually verifying upstream and downstream data and generating data files from upstream and downstream data in the related art, is solved.

Description

Technical Field

[0001] The present application relates to the field of financial technology, and specifically, to a method and device for processing upstream and downstream data, a processor, and an electronic device. Background Art

[0002] At present, financial and other computer big data platforms need to transfer data between various upstream and downstream systems connected to the platform. If the data transmitted from the upstream and downstream interfaces does not match during the platform verification, it will have a significant impact on business development. The existing technology generally uses the source application table of the upstream source system and the source application file definition platform (SEAS platform) to check the files provided by the upstream source system, such as Figure 1 As shown, the check content includes: file record length, number of fields, delimiters, line breaks, field length, etc. Existing technical solutions cannot guarantee that upstream and downstream data are inconsistent due to downstream loading errors. The only way to ensure the consistency of upstream and downstream data is to manually query the upstream and downstream data separately and generate data files for verification.

[0003] Currently, no effective solution has been proposed to the problem that the accuracy of data verification is relatively low because the upstream and downstream data can only be verified manually and the data files generated from the upstream and downstream data can only be verified manually. Summary of the Invention

[0004] The main purpose of this application is to provide a method and device for processing upstream and downstream data, a processor and an electronic device to solve the problem in the related art that upstream and downstream data can only be checked manually and data files generated from upstream and downstream data are generated, resulting in a relatively low accuracy of data verification.

[0005] To achieve the above-mentioned purpose, according to one aspect of the present application, a method for processing upstream and downstream data is provided. The method comprises: obtaining change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table at least includes: the name of the first target data table and the number of changes to the first target data table; obtaining change data of a second target data table in a downstream application within the preset time period to obtain a second record table, wherein the second record table at least includes: the name of the second target data table and the number of changes to the second target data table; comparing the number of changes in the first record table with the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same.

[0006] Furthermore, before obtaining the change records of the first target data table in the upstream source system within the first preset time and obtaining the first record table, the method also includes: in the upstream source system, according to the preset time period, statistics the change information in the first target data table to obtain an initial record table and a change details table of the first target data table; and sending the initial record table and the change details table to the downstream application.

[0007] Furthermore, after the initial record table and the change details table are sent to the downstream application, the method also includes: storing the initial record table in the target database of the downstream application; performing a change operation on the second target data table in the downstream application based on the change details table of the first target data table, and recording the change data of the second target data table; and recording the change data of the second target data table in the target details table of the downstream application.

[0008] Furthermore, obtaining the change data of the first target data table in the upstream source system in a preset time period to obtain the first record table includes: determining the preset time period, and obtaining the change data of the first target data table in the upstream source system from the target database based on the preset time period to obtain the first record table.

[0009] Furthermore, obtaining the change data of the second target data table in the downstream application within the preset time period to obtain the second record table includes: based on the preset time period, obtaining the change data of the second target data table from the target detail table of the downstream application to obtain the second record table.

[0010] Furthermore, the number of changes in the first record table and the number of changes in the second record table are compared to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same, including: if the number of changes in the first record table and the number of changes in the second record table are the same, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same; if the number of changes in the first record table and the number of changes in the second record table are different, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are different.

[0011] Furthermore, if the number of changes in the first record table is different from the number of changes in the second record table, the method further includes: triggering a message reminder to the target object to remind the target object to process the second target data table in the downstream application.

[0012] Furthermore, in the upstream source system, statistics are performed on the change information in the first target data table based on a preset time period to obtain the initial record table and the change details table of the first target data table, including: determining the attribute information of the first target data table, and determining the statistical logic algorithm of the first target data table based on the attribute information; statistics are performed on the change information in the first target data table based on the statistical logic algorithm and the preset time period to obtain the initial record table and the change details table of the first target data table.

[0013] To achieve the above-mentioned purpose, according to another aspect of the present application, a device for processing upstream and downstream data is provided. The device comprises: a first acquisition unit, configured to acquire change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table at least includes: the name of the first target data table and the number of changes to the first target data table; a second acquisition unit, configured to acquire change data of a second target data table in a downstream application within the preset time period to obtain a second record table, wherein the second record table at least includes: the name of the second target data table and the number of changes to the second target data table; and a comparison unit, configured to compare the number of changes in the first record table with the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are identical.

[0014] Furthermore, the device also includes: a statistical unit, which is used to obtain the change records of the first target data table in the upstream source system within a first preset time, and before obtaining the first record table, in the upstream source system, according to a preset time period, count the change information in the first target data table to obtain an initial record table and a change details table of the first target data table; a sending unit, which is used to send the initial record table and the change details table to the downstream application.

[0015] Furthermore, the device also includes: a storage unit, used to store the initial record table in the target database of the downstream application after the initial record table and the change details table are sent to the downstream application; a change unit, used to perform a change operation on the second target data table in the downstream application according to the change details table of the first target data table, and record the change data of the second target data table; a recording unit, used to record the change data of the second target data table in the target details table of the downstream application.

[0016] Furthermore, the first acquisition unit includes: a first acquisition module, configured to determine the preset time period, and acquire the change data of the first target data table in the upstream source system from the target database according to the preset time period to obtain the first record table.

[0017] Furthermore, the second acquisition unit includes: a second acquisition module, configured to acquire the change data of the second target data table from the target detail table of the downstream application based on the preset time period to obtain the second record table.

[0018] Furthermore, the comparison unit includes: a first determination module, used to indicate that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same if the number of changes in the first record table and the number of changes in the second record table are the same; and a second determination module, used to indicate that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are different if the number of changes in the first record table and the number of changes in the second record table are different.

[0019] Furthermore, the device also includes: a reminder unit, which is used to trigger a message reminder to the target object if the number of changes in the first record table is different from the number of changes in the second record table, so as to remind the target object to process the second target data table in the downstream application.

[0020] Furthermore, the statistical unit includes: a determination module for determining the attribute information of the first target data table, and determining the statistical logic algorithm of the first target data table based on the attribute information; a statistical module for performing statistics on the change information in the first target data table based on the statistical logic algorithm and the preset time period to obtain the initial record table and the change details table of the first target data table.

[0021] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a processor is provided, which is used to run a program, wherein the program executes any one of the above-mentioned methods for processing upstream and downstream data when running.

[0022] In order to achieve the above-mentioned purpose, according to one aspect of the present application, an electronic device is provided, which includes one or more processors and a memory, and the memory is used to store the one or more processors to implement the upstream and downstream data processing method described in any one of the above-mentioned items.

[0023] The present application adopts the following steps: obtaining change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table includes at least: the name of the first target data table and the number of changes to the first target data table; obtaining change data of a second target data table in a downstream application within a preset time period to obtain a second record table, wherein the second record table includes at least: the name of the second target data table and the number of changes to the second target data table; comparing the number of changes in the first record table and the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same, thereby solving the problem in the related art that only upstream and downstream data can be manually verified and data files generated from the upstream and downstream data are generated, resulting in a relatively low data verification accuracy. By verifying the first target data table in the upstream source system and the second target data table in the downstream application based on the number of changes in the first record table of the upstream source system and the second record table of the downstream application, the consistency of the data can be quickly and accurately verified, thereby achieving the effect of improving the accuracy of data verification. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The accompanying drawings, which constitute part of this application, are intended to provide a further understanding of this application. The exemplary embodiments and descriptions of this application are intended to explain this application and do not constitute an improper limitation on this application. In the accompanying drawings:

[0025] Figure 1 It is a schematic diagram of upstream and downstream data verification in the prior art;

[0026] Figure 2 This is a flowchart of a method for processing upstream and downstream data according to an embodiment of the present application;

[0027] Figure 3 is a flowchart of an optional method for processing upstream and downstream data provided in an embodiment of the present application;

[0028] Figure 4 is a schematic diagram of a device for processing upstream and downstream data provided according to an embodiment of the present application;

[0029] Figure 5 is a schematic diagram of an electronic device provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0030] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in this application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0031] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0032] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present application described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0033] It should be noted that the relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display and analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties. For example, an interface is set up between this system and the relevant user or organization. Before obtaining relevant information, it is necessary to send an acquisition request to the aforementioned user or organization through the interface, and obtain the relevant information after receiving the consent information fed back by the aforementioned user or organization.

[0034] The present invention will be described below in conjunction with preferred implementation steps. Figure 2 is a flowchart of a method for processing upstream and downstream data according to an embodiment of the present application. Figure 2 As shown, the method includes the following steps:

[0035] Step S201 : Acquire change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table at least includes: a name of the first target data table and a number of changes to the first target data table.

[0036] Step S202 : Acquire change data of a second target data table in a downstream application within a preset time period to obtain a second record table, wherein the second record table at least includes: a name of the second target data table and a number of changes to the second target data table.

[0037] Step S203 : Compare the number of changes in the first record table with the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same.

[0038] Specifically, the upstream source system is the source system that generates the original data, and the downstream application is used to receive the original data generated by the upstream source system and implement business operations through the original data. The upstream source system transmits the statistical results of the record table of the change data of the first target data table to the downstream application according to the preset time period. The preset time period can be set according to actual needs. For example, it can be set to be uploaded at 6 pm every day. Similarly, the downstream application will collect statistics on the change data of the second target data table in the downstream application to obtain the corresponding record table. The corresponding record table of the upstream source system and the corresponding record table of the downstream application are then compared to complete the verification of upstream and downstream data.

[0039] Considering the pressure of frequent data statistics, upstream and downstream data reconciliation can be performed at a certain frequency, while ensuring that the time range or time point of upstream and downstream statistics is consistent. For example, for detailed upstream and downstream reconciliation, the upstream source system will pilot a count of all transaction detail records for the month at the end of the month, and the downstream application will also count all transaction detail records for the month. For example, for point-in-time upstream and downstream reconciliation, the upstream system will count all records with normal account status at the beginning of the month, and the downstream application will also count all records with normal account status. Upstream and downstream data reconciliation supports the following frequency reconciliations: daily, Sunday, end of month, end of quarter, and end of year. The specific frequency can be set based on the business type and actual needs.

[0040] In an optional embodiment, changes to a first target data table in an upstream source system within a preset time period (e.g., one month) are counted to obtain a first record table. Changes to a second target data table in a downstream application within the preset time period are counted to obtain a second record table, the structure of which may be as shown in Table 1. By comparing the number of changes in the first record table with the number of changes in the second record table, upstream and downstream data are verified.

[0041] Table 1

[0042]

[0043] In summary, by comparing the first target data table in the upstream source system and the second target data table in the downstream application based on the number of changes in the first record table in the upstream source system and the second record table in the downstream application, the consistency of the data can be quickly verified, thereby improving the accuracy of data verification.

[0044] Before obtaining the change records of the first target data table in the upstream source system within the first preset time and obtaining the first record table, the upstream and downstream data processing method provided in the embodiment of the present application adopts the following technical means to implement change data statistics in the upstream source system: in the upstream source system, based on the preset time period, statistics are performed on the change information in the first target data table to obtain an initial record table and a change detail table of the first target data table; attribute information of the first target data table is determined, and based on the attribute information, a statistical logic algorithm for the first target data table is determined; based on the statistical logic algorithm and the preset time period, statistics are performed on the change information in the first target data table to obtain an initial record table and a change detail table of the first target data table. The initial record table and the change detail table are sent to the downstream application.

[0045] Specifically, the upstream source system downloads the statistical results of the record table of the change data of the first target data table to the downstream application according to the preset time period. The preset time period can be set according to actual needs. For example, it can be set to download at 6 pm every day. Since the upstream source system includes multiple types of data tables, different statistical logic algorithms need to be selected according to the attributes of the data table when counting the change data. The change statistics of the data table are realized through the corresponding statistical logic algorithm. For example, the target data table contains transaction records, and each piece of data corresponds to a transaction record, that is, a change. When the upstream source system executes changes to the target data table, it also needs to regularly download the change details of the target data table to the downstream application so that the downstream application can make data changes through the change details table.

[0046] Therefore, according to the set time period (for example, download at 6 pm every day), the change information in the first target data table is counted to obtain the initial record table and the change details table of the first target data table, and then the change details table of the initial record table and the first target data table are sent to the downstream application so that the downstream application can make data changes through the change details table.

[0047] In summary, by regularly collecting statistics on changed data in the upstream source system and sending it to downstream applications, downstream applications can easily check the consistency of the data.

[0048] After the initial record table and the change details table are sent to the downstream application, the following technical means are executed in the downstream application: the initial record table is stored in the target database of the downstream application; based on the change details table of the first target data table, the second target data table in the downstream application is changed, and the change data of the second target data table is recorded; the change data of the second target data table is recorded in the target details table of the downstream application.

[0049] First, the initial record table issued by the upstream source system is saved in the downstream application's database (i.e., the aforementioned target database). This facilitates the subsequent data verification process by directly obtaining the required record table from the target database. Then, in the downstream application, changes are performed on the second target data table based on the change details table of the first target data table. These changes are recorded in the downstream application's target details table, allowing for subsequent compilation of changes to the second target data table from the aforementioned target details table to generate the second record table. These steps help improve the efficiency of upstream and downstream data consistency verification.

[0050] In the upstream and downstream data processing method provided in an embodiment of the present application, the first record table and the second record table are obtained in the following manner: a preset time period is determined, and based on the preset time period, change data of the first target data table in the upstream source system is obtained from the target database to obtain the first record table. Based on the preset time period, change data of the second target data table is obtained from the target detail table of the downstream application to obtain the second record table.

[0051] Specifically, upstream and downstream data consistency checks can be performed at the following frequencies: daily, Sundays, end of month, end of quarter, and end of year. Therefore, the check time period (i.e., the preset time period mentioned above) must be determined first. For example, to check data changes for May, the change data for the first target data table for May is filtered from the target database to obtain the first record table. The change data for the second target data table for May is obtained from the target detail table to obtain the second record table.

[0052] In summary, the above method can quickly obtain the corresponding record tables of upstream and downstream, and then quickly and accurately check the consistency of upstream and downstream data.

[0053] In the upstream and downstream data processing method provided in the embodiment of the present application, the following steps are used to check whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same: if the number of changes in the first record table and the number of changes in the second record table are the same, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same; if the number of changes in the first record table and the number of changes in the second record table are different, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are different.

[0054] Specifically, if the number of changes in the first record table and the number of changes in the second record table are the same, it indicates that the contents of the first target data table and the second target data table are the same. If the number of changes in the first record table and the number of changes in the second record table are different, it indicates that the contents of the first target data table and the second target data table are different.

[0055] When it is determined that there is a difference between the contents of the first target data table and the second target data table, the following technical means are used for processing: triggering a message reminder to the target object to remind the target object to process the second target data table in the downstream application.

[0056] Specifically, when inconsistencies occur in the data verification, a message reminder is sent to the operation and maintenance personnel (ie, the above-mentioned target object), reminding the operation and maintenance personnel to process the second target data table, for example, to supplement data.

[0057] In an optional implementation, the following may be used: Figure 3 The flowchart shown realizes the verification of upstream and downstream data. Upstream source system: counts the change data of the source table (i.e. the first target data table mentioned above), generates a record number statistics file (i.e. the first record table mentioned above) and transmits it to the downstream application for upstream and downstream consistency verification. DQM system: a system for entering consistency verification rules, and deploying the consistency verification rules to downstream applications; and receiving the verification failure results fed back by downstream applications to realize the closed-loop process of data governance. The consistency verification rules here refer to the frequency of data consistency verification. Downstream application: deploy consistency verification rules, count the change data of the downstream application data table (the second target data table mentioned above), generate a record number statistics file (i.e. the second record table mentioned above), and generate data verification results.

[0058] The embodiment of the present application provides a method for processing upstream and downstream data. The method obtains change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table includes at least: the name of the first target data table and the number of changes to the first target data table; obtains change data of a second target data table in a downstream application within a preset time period to obtain a second record table, wherein the second record table includes at least: the name of the second target data table and the number of changes to the second target data table; compares the number of changes in the first record table and the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same. This solves the problem in the related art that upstream and downstream data can only be verified manually and data files generated from upstream and downstream data are generated, resulting in a relatively low data verification accuracy. By verifying the first target data table in the upstream source system and the second target data table in the downstream application based on the number of changes in the first record table of the upstream source system and the second record table of the downstream application, the consistency of the data can be quickly verified, thereby achieving the effect of improving the accuracy of data verification.

[0059] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0060] The present application also provides an apparatus for processing upstream and downstream data. It should be noted that the apparatus for processing upstream and downstream data in the present application can be used to execute the method for processing upstream and downstream data provided in the present application. The following describes the apparatus for processing upstream and downstream data provided in the present application.

[0061] Figure 4 Schematic diagram of a device for processing upstream and downstream data according to an embodiment of the present application. Figure 4 As shown, the device includes: a first acquiring unit 401 , a second acquiring unit 402 and a comparing unit 403 .

[0062] The first acquisition unit 401 is configured to acquire change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table at least includes: a name of the first target data table and a number of changes to the first target data table.

[0063] The second acquiring unit 402 is configured to acquire change data of a second target data table in a downstream application within a preset time period to obtain a second record table, wherein the second record table at least includes: a name of the second target data table and a number of changes to the second target data table.

[0064] The comparison unit 403 is configured to compare the number of changes in the first record table with the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same.

[0065] The upstream and downstream data processing device provided in the embodiment of the present application uses a first acquisition unit 401 to acquire change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table includes at least the name of the first target data table and the number of changes to the first target data table. A second acquisition unit 402 acquires change data of a second target data table in a downstream application within a preset time period to obtain a second record table, wherein the second record table includes at least the name of the second target data table and the number of changes to the second target data table. A comparison unit 403 compares the number of changes in the first record table and the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are identical. This solves the problem in the related art that upstream and downstream data can only be manually verified by manually verifying the upstream and downstream data and generating data files from the upstream and downstream data, resulting in relatively low data verification accuracy. By verifying the change counts in the first record table of the upstream source system and the second record table of the downstream application, the first target data table in the upstream source system and the second target data table in the downstream application can be verified quickly, thereby achieving the effect of improving data verification accuracy.

[0066] Optionally, in the upstream and downstream data processing device provided in the embodiment of the present application, the statistical unit is used to obtain the change records of the first target data table in the upstream source system within a first preset time, and before obtaining the first record table, in the upstream source system, according to a preset time period, statistics the change information in the first target data table to obtain the initial record table and the change details table of the first target data table; the sending unit is used to send the initial record table and the change details table to the downstream application.

[0067] Optionally, in the upstream and downstream data processing device provided in the embodiment of the present application, the device also includes: a storage unit, used to store the initial record table in the target database of the downstream application after the initial record table and the change details table are sent to the downstream application; a change unit, used to perform a change operation on the second target data table in the downstream application based on the change details table of the first target data table, and record the change data of the second target data table; a recording unit, used to record the change data of the second target data table in the target details table of the downstream application.

[0068] Optionally, in the upstream and downstream data processing device provided in an embodiment of the present application, the first acquisition unit 401 includes: a first acquisition module, used to determine a preset time period, and based on the preset time period, obtain the change data of the first target data table in the upstream source system from the target database to obtain a first record table.

[0069] Optionally, in the upstream and downstream data processing device provided in an embodiment of the present application, the second acquisition unit 402 includes: a second acquisition module, used to obtain change data of the second target data table from the target detail table of the downstream application based on a preset time period to obtain a second record table.

[0070] Optionally, in the upstream and downstream data processing device provided in the embodiment of the present application, the comparison unit 403 includes: a first determination module, used to indicate that if the number of changes in the first record table and the number of changes in the second record table are the same, the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same; a second determination module, used to indicate that if the number of changes in the first record table and the number of changes in the second record table are different, the contents of the first target data table in the upstream source system and the second target data table in the downstream application are different.

[0071] Optionally, in the upstream and downstream data processing device provided in an embodiment of the present application, the device also includes: a reminder unit, which is used to trigger a message reminder to the target object if the number of changes in the first record table is different from the number of changes in the second record table, so as to remind the target object to process the second target data table in the downstream application.

[0072] Optionally, in the upstream and downstream data processing device provided in the embodiment of the present application, the statistical unit includes: a determination module, used to determine the attribute information of the first target data table, and determine the statistical logic algorithm of the first target data table based on the attribute information; a statistical module, used to perform statistics on the change information in the first target data table based on the statistical logic algorithm and a preset time period, to obtain an initial record table and a change details table of the first target data table.

[0073] The upstream and downstream data processing device includes a processor and a memory. The above-mentioned first acquisition unit 401, second acquisition unit 402 and comparison unit 403 are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to realize the corresponding functions.

[0074] The processor contains a kernel, which retrieves the corresponding program unit from the memory. One or more kernels can be configured, and the consistency of upstream and downstream data can be verified by adjusting the kernel parameters.

[0075] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0076] An embodiment of the present invention provides a processor, which is used to run a program, wherein the program executes a method for processing upstream and downstream data when the program is running.

[0077] like Figure 5 As shown, an embodiment of the present invention provides an electronic device, which includes a processor, a memory, and a program stored in the memory and executable on the processor. When the processor executes the program, the following steps are implemented: obtaining change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table at least includes: a name of the first target data table and the number of changes to the first target data table; obtaining change data of a second target data table in a downstream application within a preset time period to obtain a second record table, wherein the second record table at least includes: a name of the second target data table and the number of changes to the second target data table; comparing the number of changes in the first record table and the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same.

[0078] Optionally, before obtaining the change records of the first target data table in the upstream source system within the first preset time and obtaining the first record table, the method also includes: in the upstream source system, according to the preset time period, counting the change information in the first target data table to obtain the initial record table and the change details table of the first target data table; and sending the initial record table and the change details table to the downstream application.

[0079] Optionally, after the initial record table and the change details table are sent to the downstream application, the method also includes: storing the initial record table in the target database of the downstream application; performing a change operation on the second target data table in the downstream application based on the change details table of the first target data table, and recording the change data of the second target data table; recording the change data of the second target data table in the target details table of the downstream application.

[0080] Optionally, obtaining the change data of the first target data table in the upstream source system within a preset time period to obtain the first record table includes: determining a preset time period, and obtaining the change data of the first target data table in the upstream source system from the target database based on the preset time period to obtain the first record table.

[0081] Optionally, obtaining the change data of the second target data table in the downstream application within a preset time period to obtain the second record table includes: based on the preset time period, obtaining the change data of the second target data table from the target detail table of the downstream application to obtain the second record table.

[0082] Optionally, the number of changes in the first record table and the number of changes in the second record table are compared to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same, including: if the number of changes in the first record table and the number of changes in the second record table are the same, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same; if the number of changes in the first record table and the number of changes in the second record table are different, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are different.

[0083] Optionally, if the number of changes in the first record table is different from the number of changes in the second record table, the method further includes: triggering a message reminder to the target object to remind the target object to process the second target data table in the downstream application.

[0084] Optionally, in the upstream source system, statistics are performed on the change information in the first target data table based on a preset time period to obtain the initial record table and the change details table of the first target data table, including: determining the attribute information of the first target data table, and determining the statistical logic algorithm of the first target data table based on the attribute information; statistics are performed on the change information in the first target data table based on the statistical logic algorithm and the preset time period to obtain the initial record table and the change details table of the first target data table.

[0085] The devices in this article can be servers, PCs, PADs, mobile phones, etc.

[0086] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program initialized with the following method steps: obtaining change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table at least includes: the name of the first target data table and the number of changes to the first target data table; obtaining change data of a second target data table in a downstream application within a preset time period to obtain a second record table, wherein the second record table at least includes: the name of the second target data table and the number of changes to the second target data table; comparing the number of changes in the first record table and the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same.

[0087] Optionally, before obtaining the change records of the first target data table in the upstream source system within the first preset time and obtaining the first record table, the method also includes: in the upstream source system, according to the preset time period, counting the change information in the first target data table to obtain the initial record table and the change details table of the first target data table; and sending the initial record table and the change details table to the downstream application.

[0088] Optionally, after the initial record table and the change details table are sent to the downstream application, the method also includes: storing the initial record table in the target database of the downstream application; performing a change operation on the second target data table in the downstream application based on the change details table of the first target data table, and recording the change data of the second target data table; recording the change data of the second target data table in the target details table of the downstream application.

[0089] Optionally, obtaining the change data of the first target data table in the upstream source system within a preset time period to obtain the first record table includes: determining a preset time period, and obtaining the change data of the first target data table in the upstream source system from the target database based on the preset time period to obtain the first record table.

[0090] Optionally, obtaining the change data of the second target data table in the downstream application within a preset time period to obtain the second record table includes: based on the preset time period, obtaining the change data of the second target data table from the target detail table of the downstream application to obtain the second record table.

[0091] Optionally, the number of changes in the first record table and the number of changes in the second record table are compared to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same, including: if the number of changes in the first record table and the number of changes in the second record table are the same, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same; if the number of changes in the first record table and the number of changes in the second record table are different, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are different.

[0092] Optionally, if the number of changes in the first record table is different from the number of changes in the second record table, the method further includes: triggering a message reminder to the target object to remind the target object to process the second target data table in the downstream application.

[0093] Optionally, in the upstream source system, statistics are performed on the change information in the first target data table based on a preset time period to obtain the initial record table and the change details table of the first target data table, including: determining the attribute information of the first target data table, and determining the statistical logic algorithm of the first target data table based on the attribute information; statistics are performed on the change information in the first target data table based on the statistical logic algorithm and the preset time period to obtain the initial record table and the change details table of the first target data table.

[0094] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0095] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0096] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0097] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 The steps for the function specified in one or more boxes.

[0098] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0099] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0100] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0101] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0102] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0103] The above are merely embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.

Claims

1. A method for processing upstream and downstream data, characterized in that: include: Acquire change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table at least includes: a name of the first target data table and a number of changes to the first target data table; Acquire change data of a second target data table in the downstream application within the preset time period to obtain a second record table, wherein the second record table at least includes: a name of the second target data table and a number of changes to the second target data table; Comparing the number of changes in the first record table with the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same; Before obtaining the change record of the first target data table in the upstream source system within the first preset time and obtaining the first record table, the method further includes: In the upstream source system, statistics are collected on the change information in the first target data table according to a preset time period to obtain an initial record table and a change detail table of the first target data table; Sending the initial record table and the change details table to the downstream application; Determining a corresponding statistical logic algorithm to perform statistics on change information of the data table according to the attribute information of the first target data table; The preset time period is set according to the service type.

2. The method according to claim 1, characterized in that After sending the initial record table and the change details table to the downstream application, the method further includes: Storing the initial record table in the target database of the downstream application; Performing a change operation on a second target data table in the downstream application according to the change details table of the first target data table, and recording the changed data of the second target data table; The changed data of the second target data table is recorded in the target detail table of the downstream application.

3. The method according to claim 2, characterized in that Obtaining the change data of the first target data table in the upstream source system in a preset time period, and obtaining the first record table includes: The preset time period is determined, and based on the preset time period, the change data of the first target data table in the upstream source system is obtained from the target database to obtain the first record table.

4. The method according to claim 2, characterized in that Acquiring the change data of the second target data table in the downstream application within the preset time period to obtain the second record table includes: Based on the preset time period, the change data of the second target data table is obtained from the target detail table of the downstream application to obtain the second record table.

5. The method according to claim 1, wherein Comparing the number of changes in the first record table with the number of changes in the second record table to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are identical includes: If the number of changes in the first record table is the same as the number of changes in the second record table, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are the same; If the number of changes in the first record table is different from the number of changes in the second record table, it indicates that the contents of the first target data table in the upstream source system and the second target data table in the downstream application are different.

6. The method according to claim 5, characterized in that If the number of changes in the first record table is different from the number of changes in the second record table, the method further includes: A trigger message reminder is sent to the target object to remind the target object to process the second target data table in the downstream application.

7. The method according to claim 1, characterized in that In the upstream source system, statistics are collected on the change information in the first target data table according to a preset time period to obtain an initial record table and a change detail table of the first target data table, including: Determining attribute information of the first target data table, and determining a statistical logic algorithm for the first target data table based on the attribute information; According to the statistical logic algorithm and the preset time period, statistics are collected on the change information in the first target data table to obtain the initial record table and the change details table of the first target data table.

8. A device for processing upstream and downstream data, characterized in that: include: A first acquiring unit is configured to acquire change data of a first target data table in an upstream source system within a preset time period to obtain a first record table, wherein the first record table at least includes: a name of the first target data table and a number of changes to the first target data table; a second acquiring unit, configured to acquire change data of a second target data table in the downstream application within the preset time period, and obtain a second record table, wherein the second record table at least includes: a name of the second target data table and a number of changes to the second target data table; a comparing unit, configured to compare the number of changes in the first record table with the number of changes in the second record table, so as to verify whether the contents of the first target data table in the upstream source system and the second target data table in the downstream application are identical; Before obtaining the change records of the first target data table in the upstream source system within the first preset time and obtaining the first record table, the device is further configured to, in the upstream source system, perform statistics on the change information in the first target data table according to a preset time period to obtain an initial record table and a detailed change table of the first target data table; send the initial record table and the detailed change table to the downstream application; and determine a corresponding statistical logic algorithm based on the attribute information of the first target data table to perform statistics on the change information of the data table; The preset time period is set according to the service type.

9. A processor, characterized in that: The processor is used to run a program, wherein the program, when running, executes the method for processing upstream and downstream data according to any one of claims 1 to 7.

10. An electronic device, characterized in that: It includes one or more processors and a memory, wherein the memory is used to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the upstream and downstream data processing method described in any one of claims 1 to 7.

Images