Data processing method and device, equipment and medium

Abstract

The invention provides a data processing method and device, equipment and a medium, and relates to the technical field of data processing. The method comprises the following steps: receiving a first submission task sent by a data application end, and analyzing the first submission task to obtain first to-be-processed data and a first task configuration table in the first submission task; according to at least one first target processing node in a processing link indicated by a first task level in the first task configuration table, processing the first to-be-processed data to obtain a first processing result of the first to-be-processed data; the first processing result is sent to a data application end, so that the data application end executes a data verification and approval process on the first processing result, and an integration task is generated; and receiving the integration task sent by the data application end, and processing the integration task to obtain a second processing result, thereby improving the timeliness of data submission, and the flexibility, accuracy and processing efficiency of data processing.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to a data processing method, apparatus, device and medium. Background Art

[0002] With the diversification of financial institutions' businesses and the continuous increase in sub-financial institutions, it has become increasingly arduous and complex to process the data submitted by each sub-financial institution in a timely and effective manner. Due to the uneven technological levels of each sub-financial institution, sub-financial institutions with higher technological levels can submit data in a timely manner, but sub-financial institutions with lower technological levels may not be able to submit data in a timely manner (such as data supplementary recording). Therefore, financial institutions cannot process data in a timely manner, resulting in financial institutions being unable to understand the operating conditions of each sub-financial institution in a timely manner, affecting the accuracy and timeliness of financial institutions' decisions. Summary of the invention

[0003] The present disclosure provides a data processing method, device, equipment and medium to solve one of the technical problems in the related art at least to a certain extent. The technical solution of the present disclosure is as follows:

[0004] According to a first aspect of an embodiment of the present disclosure, a data processing method is provided, comprising: receiving a first reporting task sent by a data application end, and parsing the first reporting task to obtain first data to be processed and a first task configuration table in the first reporting task; wherein the first task configuration table is configured with a first task type of the first reporting task and a first task level under the first task type; processing the first data to be processed according to at least one first target processing node in a processing link indicated by the first task level to obtain a first processing result of the first data to be processed; sending the first processing result to the data application end, so that the data application end performs data verification and approval procedures on the first processing result to generate an integration task; receiving the integration task sent by the data application end, and processing the integration task to obtain a second processing result.

[0005] According to a second aspect of an embodiment of the present disclosure, a data processing device is provided, including: a receiving module, used to receive a first reporting task sent by a data application end, and parse the first reporting task to obtain first data to be processed and a first task configuration table in the first reporting task; wherein the first task configuration table is configured with a first task type of the first reporting task and a first task level under the first task type; a first processing module, used to process the first data to be processed according to at least one first target processing node in a processing link indicated by the first task level, to obtain a first processing result of the first data to be processed; a sending module, used to send the first processing result to the data application end, so that the data application end performs data verification and approval procedures on the first processing result to generate an integration task; a second processing module, used to receive the integration task sent by the data application end, and process the integration task to obtain a second processing result.

[0006] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the data processing method proposed in the above-mentioned first aspect of the present disclosure.

[0007] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device can execute the data processing method proposed in the first aspect of the present disclosure.

[0008] According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, comprising: a computer program, wherein when the computer program is executed by a processor, the data processing method as described in the above embodiment of the present disclosure is implemented.

[0009] The technical solution provided by the embodiments of the present disclosure brings at least the following beneficial effects:

[0010] By receiving the first reporting task sent by the data application end, the sub-financial institution can directly report data on the data application end, thereby improving the timeliness of data reporting. The data processing end parses the first reporting task to obtain the first data to be processed and the first task configuration table in the first reporting task, and accurately locates the target processing node in the processing link according to the task type and task level in the task configuration table, thereby achieving efficient and orderly processing of the first data to be processed, improving data processing flexibility, accuracy and processing efficiency, and at the same time ensuring that the data can generate high-quality integration tasks after verification and approval by the data application end, thereby improving the accuracy and timeliness of financial institutions' decision-making.

[0011] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0013] Figure 1 It is a flowchart of the data processing method shown in the first embodiment of the present disclosure.

[0014] Figure 2 It is a flowchart of a data processing method shown in the second embodiment of the present disclosure.

[0015] Figure 3 This is a flowchart of a data processing method shown in the third embodiment of the present disclosure.

[0016] Figure 4 This is a flowchart of a data processing method shown in the fourth embodiment of the present disclosure.

[0017] Figure 5 It is a schematic diagram of the principle of data processing shown in an embodiment of the present disclosure.

[0018] Figure 6 It is a schematic diagram of the structure of a data processing device shown in the fifth embodiment of the present disclosure.

[0019] Figure 7 It is a schematic diagram of the structure of an electronic device shown in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0020] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0021] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0022] It should be noted that the acquisition, storage, use, and processing of data in the technical solution disclosed in this disclosure are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0023] It should also be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0024] It should also be noted that in the embodiments of the present disclosure, certain software, components, models and other existing solutions in the industry may be mentioned, which should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present disclosure, but it does not mean that the applicant has or will necessarily use the solution.

[0025] In the relevant technology, a subsidiary financial institution with a higher level of technology can submit the re-reported data through an interface. The processing process of the re-reported data submitted by the interface on the data processing end is achieved through the steps of data collection-data verification-data processing and integration-data application. The data processing end processes the reported data based on the scheduling platform and the Massively Parallel Processor (Mpp) distributed database. The processing of the supplementary data reported by the subsidiary financial institution is achieved through the steps of data supplement-data verification-data processing and integration-data approval-data application. The data processing end processes the supplementary data based on the supplementary application function and the Oracle online database. The technical implementations of the above-mentioned processing of re-reported data and supplementary data are different. Therefore, how to seamlessly convert the data integration, data application and reporting methods of financial institutions (such as the head office) and subsidiary financial institutions (branches) has become an urgent problem to be solved.

[0026] In addition, in the related art, the method for processing supplementary data is usually (1) requiring users to supplement data on a specified date; (2) data processing is started at a scheduled time, and a data synchronization operation is performed after the start, that is, the supplementary data of the online database is synchronized to the Mpp database for processing and integration by the Mpp database. However, the above data processing process cannot meet the demand scenarios of real-time supplementary data recording and real-time verification and processing, and cannot meet the scenario of re-supplementation and re-verification when errors occur in the verification of supplementary data, and cannot meet the scenario of transferring the supplementary data to the approval process again after processing, and support rollback and re-supplementation.

[0027] In view of the above problems, the present disclosure proposes a data processing method, apparatus, device and medium.

[0028] The data processing method, apparatus, device and medium of the embodiments of the present disclosure are described below with reference to the accompanying drawings.

[0029] Figure 1 It is a flowchart of a data processing method shown in the first embodiment of the present disclosure. It should be noted that the embodiment of the present disclosure is applied to a data processing end, and the data processing end belongs to a first institution (eg, a head office).

[0030] like Figure 1 As shown, the data processing method may include the following steps S11 to S14.

[0031] In step S11, a first reporting task sent by a data application terminal is received, and the first reporting task is parsed to obtain first to-be-processed data and a first task configuration table in the first reporting task.

[0032] Among them, the first task configuration table is configured with a first task type of the first reporting task and a first task level under the first task type.

[0033] In order to meet the real-time data supplement scenario, as a possible implementation method, the sub-financial institution may supplement the data at the data application end, and the data application end may generate a first reporting task based on the supplemented data. At the same time, the sub-financial institution may also configure the first task configuration table of the first reporting task on the relevant page of the data application end, wherein the first task configuration table may include the first task type of the first reporting task and the first task level under the first task type. It should be noted that the first task type is used to indicate the type of the first data to be processed, such as supplementary data, repeated data, etc., and the first task level is used to indicate the processing node of the data processing end for the first data to be processed, such as the processing node only includes the verification node; for another example, the processing node includes the verification node and the processing node, etc.

[0034] In order to improve the efficiency of data reporting, as another possible implementation method, the sub-financial institution may also report data through its own interface, and the data processing end uses each node in the processing link to process the reported data.

[0035] As an example, in response to receiving the second reporting task sent by the target interface, the third target script corresponding to the processing link is obtained; wherein the target interface is an interface configured for the second organization, and the second organization is a sub-organization under the first organization; the third target script is executed to process the second reporting task and obtain a third processing result including the second target business table. It should be noted that the processing nodes in the processing link include: inspection nodes, processing nodes, and integration nodes.

[0036] In order to improve the accuracy and efficiency of data processing, as a possible implementation method, the data processing end can automatically trigger task processing by setting a period, or trigger task processing when receiving a reported task.

[0037] As an example, in response to reaching a set cycle, pending tasks are obtained from a task queue; wherein the pending tasks include a first reporting task; the first reporting task in the pending tasks is parsed to obtain the first pending data and the first task configuration table in the first reporting task.

[0038] As another example, in response to receiving the first reporting task, the first reporting task is parsed to obtain the first to-be-processed data and the first task configuration table in the first reporting task.

[0039] In step S12, the first data to be processed is processed according to at least one first target processing node in the processing link indicated by the first task level to obtain a first processing result of the first data to be processed.

[0040] In order to improve the flexibility, accuracy and consistency of data processing, as an example, the data processing end has a processing link for data processing, and the data processing end processes the first data to be processed according to at least one first target processing node in the processing link indicated by the first task level in the first task configuration table, thereby obtaining a first processing result of the first data to be processed. The first processing result includes data that has been successfully checked, data that has been successfully checked and processed, etc.

[0041] In step S13, the first processing result is sent to the data application end, so that the data application end performs data verification and approval process on the first processing result to generate an integration task.

[0042] In order to verify the accuracy and completeness of the first processing result to avoid errors or omissions in the data during the processing, as an example, the first processing result is sent to the data application end, and the relevant personnel of the sub-financial institution can perform data verification on the first processing result at the data application end, and approve the data after the data verification passes, to obtain a third processing result. The data application end generates an integration task based on the third processing result, wherein the third processing result is used to indicate that the first processing result has passed the data verification and approval.

[0043] As another example, the first processing result is sent to the data application end, and the relevant personnel of the sub-financial institution can perform data verification on the first processing result at the data application end. When the data verification fails, the relevant personnel can be reminded to re-enter the data. Alternatively, when the first processing result indicates that the data processing end has failed the verification of the first data to be processed, the relevant personnel can also re-enter the data and re-submit the re-entered data to the data processing end for processing.

[0044] In step S14, the integration task sent by the data application end is received, and the integration task is processed to obtain a second processing result.

[0045] In order to manage the data reported by each sub-financial institution, as an example, the data processing end receives the integration task sent by the data application end, and the data processing end integrates the data in the integration task to obtain a second processing result to integrate the data reported by each sub-financial institution.

[0046] In summary, the first reporting task sent by the data application end is received, and the first reporting task is parsed to obtain the first data to be processed and the first task configuration table in the first reporting task; wherein the first task type of the first reporting task and the first task level under the first task type are configured in the first task configuration table; the first data to be processed is processed according to at least one first target processing node in the processing link indicated by the first task level to obtain a first processing result of the first data to be processed; the first processing result is sent to the data application end, so that the data application end performs data verification and approval process on the first processing result to generate an integration task; the integration task sent by the data application end is received, and the integration task is Processing, obtain a second processing result, thereby, by receiving the first reporting task sent by the data application end, the sub-financial institution can directly report data on the data application end, thereby improving the timeliness of data reporting. The data processing end parses the first reporting task to obtain the first data to be processed and the first task configuration table in the first reporting task, and accurately locates the target processing node in the processing link according to the task type and task level in the task configuration table, thereby achieving efficient and orderly processing of the first data to be processed, improving data processing flexibility, accuracy and processing efficiency, and at the same time ensuring that the data can generate high-quality integration tasks after verification and approval by the data application end, thereby improving the accuracy and timeliness of financial institutions' decision-making.

[0047] The present disclosure provides another data processing method. Figure 2 It is a flow chart of a data processing method shown in the second embodiment of the present disclosure. It should be noted that the embodiment of the present disclosure is applied to the data processing end.

[0048] In addition, it should be noted that the data processing method can be executed alone, or it can be executed in combination with any embodiment of the present disclosure or a possible implementation method in an embodiment, or it can be executed in combination with any technical solution in the relevant technology, and the embodiments of the present disclosure are not limited to this.

[0049] like Figure 2 As shown, the data processing method may include the following steps S21 to S26.

[0050] In step S21, a first reporting task sent by a data application terminal is received, and the first reporting task is parsed to obtain first to-be-processed data and a first task configuration table in the first reporting task.

[0051] Among them, the first task configuration table is configured with a first task type of the first reporting task and a first task level under the first task type.

[0052] In step S22, a first interface name associated with the first reporting task is obtained from the first task configuration table.

[0053] In order to improve the accuracy of data processing, as a possible implementation method, the correspondence between the reporting task and the interface is clearly defined in the first task configuration table. As an example, the first task configuration table also includes the first interface name associated with the first reporting task. Therefore, the first interface name associated with the first reporting task is obtained from the first task configuration table, and the first data to be processed is processed based on the first interface name and at least one first target processing node indicated by the first task level.

[0054] In step S23, according to the first interface name, a first interface parameter table matching the first interface name is searched.

[0055] It should be understood that different interfaces correspond to different interface parameter tables. Therefore, as an example, based on the first interface name, a first interface parameter table matching the first interface name is queried from multiple interface parameter tables.

[0056] In step S24, the first data to be processed is processed based on the first interface parameter table and at least one first target processing node to obtain a first processing result of the first data to be processed.

[0057] In order to improve the accuracy and flexibility of data processing, as a possible implementation method, a script for processing the first data to be processed is generated according to the first interface parameter table and at least one first target processing node, and the first data to be processed is processed based on the script.

[0058] It should be noted that some sub-financial institutions did not develop the relevant interface programs when submitting data in the early stage. They can first supplement the data through the data application end. After the interface program is ready, they can switch to interface reporting. At this time, the scripts on the data processing end are unified and reusable, reducing the cost of data processing.

[0059] In step S25, the first processing result is sent to the data application end, so that the data application end performs data verification and approval process on the first processing result to generate an integration task.

[0060] In step S26, the integration task sent by the data application end is received, and the integration task is processed to obtain a second processing result.

[0061] It should be noted that the explanations of step S21 and step S25 to step S26 can be found in the relevant descriptions in any embodiment of the present disclosure and will not be repeated here.

[0062] In summary, by obtaining the first interface name from the first task configuration table, the correctness and effectiveness of the interface used for data processing are ensured, and data processing errors caused by incorrect interface selection are avoided. Then, the first interface parameter table is queried according to the first interface name, and the first data to be processed is processed based on the first interface parameter table and at least one first target processing node. This ensures that each processing node can be independently designed and optimized according to the interface parameter table, thereby improving the flexibility of data processing, and improving the accuracy and consistency of data processing.

[0063] In order to clearly illustrate the above embodiment, another data processing method is proposed in the embodiment of the present disclosure. Figure 3 This is a flowchart of a data processing method shown in the third embodiment of the present disclosure.

[0064] like Figure 3 As shown, the data processing method may include the following steps S31 to S38:

[0065] In step S31, a first reporting task sent by a data application terminal is received, and the first reporting task is parsed to obtain first to-be-processed data and a first task configuration table in the first reporting task.

[0066] Among them, the first task configuration table is configured with a first task type of the first reporting task and a first task level under the first task type.

[0067] In step S32, a first interface name associated with the first reporting task is obtained from the first task configuration table.

[0068] In step S33, according to the first interface name, a first interface parameter table matching the first interface name is searched.

[0069] In step S34, a first target subscript corresponding to each first target processing node is generated according to the first interface parameters configured in the first interface parameter table and each first target processing node.

[0070] In order to improve the flexibility and accuracy of data processing, as a possible implementation method, a first target sub-script matching each first target processing node is generated according to the parameter configuration information in the first interface parameter table and the functional requirements of each first target processing node.

[0071] As an example, a script template of each first target processing node is obtained; wherein the script template includes a general processing logic corresponding to the first target processing node; according to the functional requirements of each first target processing node, the first interface parameters configured in the first interface parameter table are divided to obtain the first interface parameters corresponding to each first target processing node; for any first target processing node, the first interface parameters corresponding to any first target processing node are filled into the corresponding script template to obtain the first target sub-script of any first target processing node.

[0072] That is to say, in order to achieve efficient data processing, the data processing end first obtains the script template of each first target processing node, and the script template contains the general processing logic of the corresponding processing node; since different processing nodes have different functional requirements, for example, some processing nodes have functional requirements for processing string data, some processing nodes have functional requirements for numerical calculations, and some processing nodes have functional requirements for accessing specific database resources, etc., different functional requirements determine which interface parameters each node needs to use. Therefore, according to the functional requirements of each first target processing node, the first interface parameters configured in the first interface parameter table are divided to obtain the first interface parameters corresponding to each first target processing node; then, for each first target processing node, the data processing end fills the corresponding first interface parameters into its script template to generate the first target sub-script of the processing node; this process ensures that each processing node can perform specific processing tasks according to the specific parameter configuration, thereby improving the flexibility and accuracy of data processing.

[0073] In step S35, a first target script is generated according to each first target sub-script.

[0074] In order to improve the accuracy of data processing, as a possible implementation method, each first target sub-script is spliced ​​to generate a first target script.

[0075] As an example, each first target sub-script is spliced ​​according to the arrangement order of the corresponding first target processing nodes to obtain the first target script.

[0076] In step S36, the first target script is executed to process the first data to be processed to obtain a first processing result of the first data to be processed.

[0077] In order to improve the accuracy and consistency of data processing, as an example, the function of each processing node is called in sequence according to the order defined in the first target script to process the first data to be processed to obtain a first processing result.

[0078] In step S37, the first processing result is sent to the data application end, so that the data application end performs data verification and approval process on the first processing result to generate an integration task.

[0079] In step S38, the integration task sent by the data application end is received, and the integration task is processed to obtain a second processing result.

[0080] It should be noted that the explanations of steps S31 to S33 and steps S37 to S38 can be found in the relevant descriptions in any embodiment of the present disclosure and will not be repeated here.

[0081] In summary, by generating the first target sub-script corresponding to each first target processing node according to the first interface parameters configured in the first interface parameter table and each first target processing node, the modularization of the processing logic is achieved, making the logic of each processing node clearer, easier to understand and maintain. When it is necessary to modify or expand the logic of a processing node, only the corresponding sub-script needs to be paid attention to without affecting other parts, thereby improving the flexibility of data processing, generating the first target script according to each first target sub-script, and executing the first target script to process the first data to be processed, thereby realizing the automation of data processing, reducing manual intervention, and improving processing efficiency.

[0082] In order to clearly illustrate the above embodiment, another data processing method is proposed in the embodiment of the present disclosure. Figure 4 This is a flowchart of a data processing method shown in the fourth embodiment of the present disclosure.

[0083] like Figure 4 As shown, the data processing method includes steps S41 to S410:

[0084] In step S41, a first reporting task sent by a data application terminal is received, and the first reporting task is parsed to obtain first to-be-processed data and a first task configuration table in the first reporting task.

[0085] Among them, the first task configuration table is configured with a first task type of the first reporting task and a first task level under the first task type.

[0086] In step S42, the first data to be processed is processed according to at least one first target processing node in the processing link indicated by the first task level to obtain a first processing result of the first data to be processed.

[0087] In step S43, the first processing result is sent to the data application end, so that the data application end performs data verification and approval process on the first processing result to generate an integration task.

[0088] In step S44, the integration task sent by the data application end is received.

[0089] In step S45, the integration task is parsed to obtain the second to-be-processed data and the second task configuration table in the integration task.

[0090] The second task configuration table includes a second task type of the integrated task and a second task level under the second task type.

[0091] As an example, the second data to be processed and a second task configuration table associated with the integration task are extracted from the integration task, wherein the second task configuration table is configured with a second task type (e.g., integration) of the integration task and a second task level under the second task type, wherein the second task level is used to specify a processing node of the data processing end for the second data to be processed.

[0092] In step S46, the second interface name associated with the integration task is obtained from the second task configuration table.

[0093] In order to improve the accuracy of data processing, as a possible implementation method, the correspondence between the integration task and the interface is clearly defined in the second task configuration table. As an example, the second task configuration table also includes a second interface name associated with the integration task. Therefore, the second interface name associated with the integration task is obtained from the second task configuration table, and the second data to be processed is processed based on the second interface name and at least one second target processing node indicated by the second task level.

[0094] In step S47, according to the second interface name, a second interface parameter table matching the second interface name is searched.

[0095] It should be understood that different interfaces correspond to different interface parameter tables. Therefore, in order to accurately determine the interface parameter table of the second interface name, as an example, based on the second interface name, a second interface parameter table that matches the second interface name is queried from multiple interface parameter tables.

[0096] In step S48, according to the second interface parameter table and at least one second target processing node in the processing link indicated by the second task level, a second target sub-script corresponding to each second target processing node is generated.

[0097] In order to improve the accuracy and flexibility of data processing, as a possible implementation method, a script (second target sub-script) for processing the second data to be processed is generated according to the second interface parameter table and at least one second target processing node, and the second data to be processed is processed based on the script.

[0098] In step S49, a second target script is generated based on each second target sub-script.

[0099] Furthermore, each second target sub-script is spliced ​​in the order of the corresponding second target processing nodes to obtain a second target script.

[0100] In step S410, the second target script is executed to integrate the second data to be processed to obtain a second processing result including the first target business table.

[0101] In order to improve the accuracy and consistency of data processing, as an example, the function of each processing node is called in sequence according to the order defined in the second target script, the second data to be processed is integrated, and the second processing result including the first target business table is obtained.

[0102] In summary, by parsing the integration task, the data and task configuration that need to be processed can be accurately extracted, and accurate basic data and configuration information can be provided for subsequent processing, reducing problems caused by inaccurate data or configuration errors. Then, the second interface name associated with the integration task is obtained from the second task configuration table to ensure that the corresponding interface can be correctly called during data processing, thereby improving the reliability and accuracy of data processing. Furthermore, according to the second interface name, the second interface parameter table matching the second interface name is queried, and according to the second interface parameter table and at least one second target processing node in the processing link indicated by the second task level, a second target sub-script corresponding to each second target processing node is generated. According to each second target sub-script, a second target script is generated, thereby executing the second target script, integrating the second data to be processed, and obtaining a second processing result including the first target business table, thereby realizing standardization and modularization of the processing logic, ensuring that the processing logic of each node is consistent, reducing human errors, and improving the overall efficiency and reliability of the task.

[0103] Based on any of the above embodiments, the implementation process of the present disclosure can be as follows: Figure 5 As shown, it mainly includes the following steps:

[0104] 1. After the user of the sub-financial institution enters the data in the sub-financial institution management system (data application end), a reporting task (the first reporting task) will be generated, where the reporting task includes a reporting information table (the first task configuration table), and the reporting information table may include: reporting task number, batch processing working day, institution number, interface name, task type, data date, task level, batch number and step number and other fields.

[0105] Among them, the reporting task number is used to indicate the number of this reporting task, the batch processing working day is used to indicate the date on which the reporting information is generated, the institution number is used to indicate the sub-financial institution number, the interface name is used to indicate the interface name associated with the reporting task, the task type is used to indicate the type of the first data to be processed in the reporting task, such as, for example, supplementary data, repeated data, integrated data, etc., the data date is used to indicate the date of the business data of this reporting task, the task level is used to indicate the processing node of the data processing end for the business data of this reporting task, the batch number is used to indicate the batch number to which this reporting task belongs, and the step number is used to indicate the order of batch running between multiple interfaces in this reporting task.

[0106] 2. After the data processing end obtains the new reporting task, it copies the supplementary data in the reporting task to the data end, and splices the corresponding script program according to the "Interface Parameter Table", starts the script program, and performs unified verification and processing. When the verification is successful, the processed data is copied to the data application end. When the verification fails, the verification failure record data is sent to the data application end. At the same time, the reporting task is written into the "Reporting Information Result" table and copied to the data application end;

[0107] Among them, the reporting information result table includes: reporting task number, batch processing working day, organization number, interface name, task type, data date, task level, task status code, remark description, start time and end time and other fields. Among them, the task status code is used to indicate the success or failure of this reporting task, the remark description is used to specify if it fails, the remark records the steps and reasons for the failure, the start time is used to indicate the start time of this task for display, and the end time is used to specify the start time of this task for display. The meaning of other fields can be found in the reporting information table.

[0108] The interface parameter table includes: interface name, Mpp table name, application library table name, date field, organization field, reporting organization number, Schema number, and database type to which the table name belongs.

[0109] Among them, the interface name is used to identify the interface to be supplemented, the Mpp table name indicates the Mpp table name corresponding to the interface, which is used to find the verification rules and to splice the name of the processing script program; the application library table name is used to indicate the application-side target table corresponding to the interface, which is used to splice the name of the replication script program; the date field indicates the name of the business date field corresponding to the target table of this interface, which is used to splice the filter parameters of the replication script program; the organization field indicates the name of the subsidiary organization field corresponding to the target table of this interface, which is used to splice the filter parameters of the replication script program; the reporting organization number is usually used in conjunction with the Schema number to obtain a special Schema and to splice the processing script parameters; the Schema number is usually used in conjunction with the reporting organization number field to configure a special Schema and to generate the input parameters of the script program; the database types to which the table name belongs are Oracle and Mpp, which are used to obtain different database access connection strings and generate the parameters of the replication script program.

[0110] 3. The data application end obtains the "Information Submission Results" and displays it to the user for confirmation. If the confirmation is correct, the supplementary data is submitted and enters the approval stage. If the confirmation is incorrect, the data can be modified again and the above process is repeated;

[0111] 4. After the approving user approves the supplementary data, an integration task is generated;

[0112] 5. After the data processing end obtains the "integration task", it will copy the approved data and integrate it into the target business table.

[0113] With the above Figures 1 to 5 Corresponding to the data processing method provided in the embodiment, the present disclosure also provides a data processing device. Figures 1 to 5 The data processing method provided in the embodiment corresponds to the data processing method, so the implementation of the data processing method is also applicable to the data processing device provided in the embodiment of the present disclosure, and will not be described in detail in the embodiment of the present disclosure.

[0114] Figure 6 It is a structural diagram of a data processing device shown in the fifth embodiment of the present disclosure. It should be noted that the data processing device in the embodiment of the present disclosure is applied to a data processing terminal.

[0115] Reference Figure 6 The data processing device 600 includes: a receiving module 610, a first processing module 620, a sending module 630 and a second processing module 640.

[0116] Among them, the receiving module 610 is used to receive the first reporting task sent by the data application end, and parse the first reporting task to obtain the first data to be processed and the first task configuration table in the first reporting task; wherein the first task configuration table is configured with the first task type of the first reporting task and the first task level under the first task type; the first processing module 620 is used to process the first data to be processed according to at least one first target processing node in the processing link indicated by the first task level to obtain a first processing result of the first data to be processed; the sending module 630 is used to send the first processing result to the data application end, so that the data application end performs data verification and approval process on the first processing result to generate an integration task; the second processing module 640 is used to receive the integration task sent by the data application end, and process the integration task to obtain a second processing result.

[0117] In a possible implementation of the embodiment of the present disclosure, the first processing module 620 is used to obtain a first interface name associated with a first reporting task from a first task configuration table; based on the first interface name, query a first interface parameter table that matches the first interface name; based on the first interface parameter table and at least one first target processing node, process the first data to be processed to obtain a first processing result of the first data to be processed.

[0118] In a possible implementation of the embodiment of the present disclosure, the first processing module 620 is used to generate a first target sub-script corresponding to each first target processing node according to the first interface parameters configured in the first interface parameter table and each first target processing node; generate a first target script according to each first target sub-script; execute the first target script to process the first data to be processed and obtain a first processing result of the first data to be processed.

[0119] In a possible implementation of the embodiment of the present disclosure, the first processing module 620 is used to obtain a script template for each first target processing node; wherein the script template includes a general processing logic corresponding to the first target processing node; according to the functional requirements of each first target processing node, the first interface parameters configured in the first interface parameter table are divided to obtain the first interface parameters corresponding to each first target processing node; for any first target processing node, the first interface parameters corresponding to any first target processing node are filled into the corresponding script template to obtain the first target sub-script of any first target processing node.

[0120] In a possible implementation of the embodiment of the present disclosure, the integration task is generated using the following modules: a third processing module and a generation module.

[0121] Among them, the third processing module is used to execute data verification and approval process on the first processing result through the data application end to obtain a third processing result; wherein the third processing result is used to indicate that the first processing result has passed the data verification and approval; the generation module is used to generate an integration task based on the third processing result through the data application end.

[0122] In a possible implementation of the embodiment of the present disclosure, the second processing module 640 is used to parse the integration task to obtain the second data to be processed and the second task configuration table in the integration task; wherein the second task configuration table is configured with the second task type of the integration task and the second task level under the second task type; from the second task configuration table, the second interface name associated with the integration task is obtained; according to the second interface name, the second interface parameter table matching the second interface name is queried; according to the second interface parameter table and at least one second target processing node in the processing link indicated by the second task level, a second target sub-script corresponding to each second target processing node is generated; according to each second target sub-script, a second target script is generated; the second target script is executed to integrate the second data to be processed to obtain a second processing result including the first target business table.

[0123] In a possible implementation of the embodiment of the present disclosure, the receiving module 610 is used to obtain pending tasks from the task queue in response to reaching a set period; wherein the pending tasks include the first reporting task; the first reporting task in the pending tasks is parsed to obtain the first pending data and the first task configuration table in the first reporting task; or, in response to receiving the first reporting task, the first reporting task is parsed to obtain the first pending data and the first task configuration table in the first reporting task.

[0124] In a possible implementation of the embodiment of the present disclosure, the data processing end belongs to the first mechanism, and the data processing device 600 further includes: a fourth processing module.

[0125] Among them, the fourth processing module is used to obtain the third target script corresponding to the processing link in response to receiving the second reporting task sent by the target interface; wherein the target interface is an interface configured for the second organization, and the second organization is a sub-organization under the first organization; execute the third target script to process the second reporting task and obtain a third processing result including the second target business table.

[0126] The data processing device of the disclosed embodiment receives a first reporting task sent by a data application end, and parses the first reporting task to obtain first data to be processed and a first task configuration table in the first reporting task; wherein the first task type of the first reporting task and a first task level under the first task type are configured in the first task configuration table; processes the first data to be processed according to at least one first target processing node in the processing link indicated by the first task level to obtain a first processing result of the first data to be processed; sends the first processing result to the data application end, so that the data application end performs a data verification and approval process on the first processing result to generate an integration task; receives the integration task sent by the data application end, and performs a data verification and approval process on the integration task; The first task is processed to obtain a second processing result. Thus, by receiving the first reporting task sent by the data application end, the sub-financial institution can directly report data at the data application end, thereby improving the timeliness of data reporting. The data processing end parses the first reporting task to obtain the first data to be processed and the first task configuration table in the first reporting task, and accurately locates the target processing node in the processing link according to the task type and task level in the task configuration table, thereby achieving efficient and orderly processing of the first data to be processed, improving the flexibility, accuracy and efficiency of data processing, and at the same time ensuring that the data can generate high-quality integration tasks after verification and approval by the data application end, thereby improving the accuracy and timeliness of financial institutions' decision-making.

[0127] In an exemplary embodiment, the present disclosure also provides an electronic device.

[0128] Among them, electronic equipment includes:

[0129] processor;

[0130] a memory for storing processor-executable instructions;

[0131] The processor is configured to execute instructions to implement the data processing method proposed in any of the aforementioned embodiments.

[0132] As an example, Figure 7 is a schematic diagram of the structure of an electronic device 700 shown in an exemplary embodiment of the present disclosure, such as Figure 7 As shown, the electronic device 700 may further include:

[0133] The memory 710 and the processor 720, a bus 730 connecting different components (including the memory 710 and the processor 720), the memory 710 stores a computer program, and when the processor 720 executes the program, the data processing method described in the embodiment of the present disclosure is implemented.

[0134] Bus 730 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.

[0135] The electronic device 700 typically includes a variety of electronic device readable media. These media can be any available media that can be accessed by the electronic device 700, including volatile and non-volatile media, removable and non-removable media.

[0136] The memory 710 may also include computer system readable media in the form of volatile memory, such as random access memory (RAM) 740 and / or cache memory 750. The server 700 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 760 may be used to read and write non-removable, non-volatile magnetic media ( Figure 7 not shown, usually called a "hard drive"). Although Figure 7 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a CD-ROM, a DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to the bus 730 via one or more data medium interfaces. The memory 710 may include at least one program product having a set (e.g., at least one) of program modules that are configured to perform the functions of the various embodiments of the present disclosure.

[0137] A program / utility 780 having a set (at least one) of program modules 770 may be stored, for example, in the memory 710, such program modules 770 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 770 generally perform the functions and / or methods of the embodiments described in the present disclosure.

[0138] The electronic device 700 may also communicate with one or more external devices 790 (e.g., keyboard, pointing device, display 791, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 700, and / or communicate with any device that enables the electronic device 700 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed through an input / output (I / O) interface 792. Furthermore, the electronic device 700 may also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN) and / or public network, such as the Internet) through a network adapter 793. As shown, the network adapter 793 communicates with other modules of the electronic device 700 through a bus 730. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0139] The processor 720 executes various functional applications and data processing by running the programs stored in the memory 710 .

[0140] It should be noted that the implementation process and technical principles of the electronic device of this embodiment refer to the aforementioned explanation of the data processing method of the embodiment of the present disclosure, and will not be repeated here.

[0141] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the above instructions can be executed by a processor of an electronic device to complete the data processing method proposed in any of the above embodiments. Optionally, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0142] In an exemplary embodiment, a computer program product is also provided, including a computer program / instruction, wherein the computer program / instruction implements the data processing method proposed in any of the above embodiments when executed by a processor.

[0143] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0144] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A data processing method, characterized in that: Applied to data processing, including: Receive a first reporting task sent by a data application terminal, and parse the first reporting task to obtain first to-be-processed data and a first task configuration table in the first reporting task; wherein the first task configuration table is configured with a first task type of the first reporting task and a first task level under the first task type; Processing the first data to be processed according to at least one first target processing node in the processing link indicated by the first task level to obtain a first processing result of the first data to be processed; Sending the first processing result to the data application end, so that the data application end performs data verification and approval process on the first processing result to generate an integration task; The integration task sent by the data application end is received, and the integration task is processed to obtain a second processing result.

2. The method according to claim 1, characterized in that The processing of the first data to be processed by at least one first target processing node in the processing link indicated by the first task level to obtain a first processing result of the first data to be processed includes: Acquire a first interface name associated with the first reporting task from the first task configuration table; According to the first interface name, querying a first interface parameter table matching the first interface name; Based on the first interface parameter table and the at least one first target processing node, the first data to be processed is processed to obtain a first processing result of the first data to be processed.

3. The method according to claim 2, characterized in that The processing of the first data to be processed based on the first interface parameter table and the at least one first target processing node to obtain a first processing result of the first data to be processed includes: Generate a first target subscript corresponding to each first target processing node according to the first interface parameters configured in the first interface parameter table and each first target processing node; Generate a first target script according to each of the first target sub-scripts; Execute the first target script to process the first data to be processed and obtain a first processing result of the first data to be processed.

4. The method according to claim 3, characterized in that The step of generating a first target sub-script corresponding to each first target processing node according to the first interface parameters configured in the first interface parameter table and each first target processing node includes: Obtaining a script template of each of the first target processing nodes; wherein the script template includes a general processing logic corresponding to the first target processing node; According to the functional requirements of each of the first target processing nodes, the first interface parameters configured in the first interface parameter table are divided to obtain the first interface parameters corresponding to each of the first target processing nodes; For any first target processing node, fill the first interface parameter corresponding to the any first target processing node into the corresponding script template to obtain the first target sub-script of the any first target processing node.

5. The method according to claim 1, characterized in that The integration task is generated using the following steps: Performing a data verification and approval process on the first processing result through the data application end to obtain a third processing result; wherein the third processing result is used to indicate that the first processing result has passed the data verification and approval; The integration task is generated based on the third processing result through the data application end.

6. The method according to claim 1, characterized in that The processing of the integration task to obtain a second processing result includes: Parsing the integration task to obtain second to-be-processed data and a second task configuration table in the integration task; wherein the second task configuration table is configured with a second task type of the integration task and a second task level under the second task type; Acquire a second interface name associated with the integration task from the second task configuration table; According to the second interface name, querying a second interface parameter table matching the second interface name; Generate a second target subscript corresponding to each second target processing node according to the second interface parameter table and at least one second target processing node in the processing link indicated by the second task hierarchy; Generate a second target script according to each of the second target sub-scripts; The second target script is executed to integrate the second data to be processed to obtain a second processing result including the first target business table.

7. The method according to claim 1, characterized in that The parsing of the first reporting task to obtain the first to-be-processed data and the first task configuration table in the first reporting task includes: In response to reaching a set period, obtaining tasks to be processed from a task queue; wherein the tasks to be processed include the first reporting task; Parsing the first submitted task in the tasks to be processed to obtain the first to-be-processed data and the first task configuration table in the first submitted task; or, In response to receiving the first reporting task, the first reporting task is parsed to obtain the first to-be-processed data and the first task configuration table in the first reporting task.

8. The method according to claim 1, characterized in that The data processing end belongs to the first organization, and the method further includes: In response to receiving a second reporting task sent by a target interface, obtaining a third target script corresponding to the processing link; wherein the target interface is an interface configured for a second organization, and the second organization is a sub-organization under the first organization; The third target script is executed to process the second reporting task to obtain a third processing result including a second target business table.

9. A data processing device, characterized in that: Applied to data processing, including: A receiving module, used for receiving a first reporting task sent by a data application terminal, and parsing the first reporting task to obtain first to-be-processed data and a first task configuration table in the first reporting task; wherein the first task configuration table is configured with a first task type of the first reporting task and a first task level under the first task type; a first processing module, configured to process the first data to be processed according to at least one first target processing node in the processing link indicated by the first task level, so as to obtain a first processing result of the first data to be processed; A sending module, used for sending the first processing result to the data application end, so that the data application end performs data verification and approval process on the first processing result and generates an integration task; The second processing module is used to receive the integration task sent by the data application end, and process the integration task to obtain a second processing result.

10. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the data processing method according to any one of claims 1 to 8.

11. A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the data processing method according to any one of claims 1 to 8.

12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the data processing method according to any one of claims 1 to 8 is implemented.

Images