Business data batch processing method and device

By detecting and processing target business data for intermediate dates in the financial system, we ensure that target business data for intermediate dates is detected and processed in the financial system's day-jump-to-day running batch test, the problem that business data may be missed in the day-jump-to-day running batch test in the financial system is solved, and data continuity and integrity are achieved.

CN117592754BActive Publication Date: 2025-05-30CHINA ELECTRONICS JINXIN DIGITAL TECH GRP CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311707227.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-12
Publication Date
2025-05-30
Estimated Expiration
2043-12-12

AI Technical Summary

Technical Problem

In the day-jump-up batch test of the financial system, due to the different dates of the pre-built data by the tester, the communication and coordination between the tester and the batch execution personnel are inadequate, and the business data of the date skipped in the middle may be missed, resulting in discontinuous or unusable data.

Method used

By obtaining the batch date switching request, it detects whether there is target business data that needs to be processed on batches under each intermediate date between the first and second dates, and performs batch task based on the target business data when the target business data exists on the intermediate date. After the batch run task of each intermediate date is completed, the batch run task is performed based on the target business data under the second date.

Benefits of technology

It effectively avoids the missed business data corresponding to the skipped intermediate date, ensures the continuity and integrity of data, and reduces the complexity of pre-buried data and batch execution work.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117592754B_ABST
    Figure CN117592754B_ABST
Patent Text Reader

Abstract

The present application provides a method and device for batch running of service data. The method includes: obtaining a request for switching batch running dates, detecting whether there is target service data that needs to be batch processed on each intermediate date between the first date and the second date, and in the case where there is target service data on the intermediate date, performing a batch running task based on the target service data. After the batch running tasks on each intermediate date are completed, a batch running task is performed based on the target service data on the second date. The present application can avoid missing the service data corresponding to the skipped intermediate dates when performing skip-day batch running based on the first date and the second date.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical field of data processing, and in particular, to a method and apparatus for batch running of business data. Background Art

[0002] Financial systems such as bank clearing systems, loan systems, etc. usually need to perform batch running based on a set period. To ensure the correctness of the batch running function of the financial system in long-period scenarios, the financial system needs to perform skip-day batch running tests during the R & D and testing phases, for example, skipping one year for batch running tests.

[0003] The skip-day batch running test is based on the business data pre-buried by testers on each date. When performing the skip-day batch running test, the batch running executor needs to know in advance which dates have data pre-buried to ensure that the business data corresponding to the skipped dates will not be missed. However, different testers pre-bury data on different dates. Therefore, when the scale of the test team is large, this skip-day batch running test method may cause the business data of the skipped dates in the middle to be missed due to poor communication and coordination between the testers and the batch running executor, resulting in discontinuous data or unusable data. Summary of the Invention

[0004] This application aims to at least solve one of the technical problems in the related art to some extent.

[0005] To this end, the first object of this application is to propose a method for batch running of business data.

[0006] The second object of this application is to propose an apparatus for batch running of business data.

[0007] The third object of this application is to propose an electronic device.

[0008] The fourth object of this application is to propose a computer-readable storage medium.

[0009] The fifth object of this application is to propose a computer program product.

[0010] To achieve the above object, the first aspect embodiment of this application proposes a method for batch running of business data, including:

[0011] Obtaining a batch running date switching request, where the batch running date switching request is used to indicate switching from a first date to a non-adjacent second date;

[0012] Detecting whether there is target business data that needs to be batch processed on each intermediate date between the first date and the second date;

[0013] When there is target business data on the intermediate date, performing a batch running task based on the target business data;

[0014] After the batch job execution at each intermediate date is completed, a batch job is executed based on the target business data on the second date.

[0015] To achieve the above object, an embodiment of the second aspect of the present application provides a business data batch processing device, including:

[0016] A request acquisition module, configured to acquire a batch date switching request, where the batch date switching request is used to indicate switching from a first date to a non-adjacent second date;

[0017] A data detection module, configured to detect whether there is target business data that needs to be batch processed at each intermediate date between the first date and the second date;

[0018] A first execution module, configured to execute a batch job based on the target business data when there is target business data at an intermediate date;

[0019] A second execution module, configured to execute a batch job based on the target business data on the second date after the batch job execution at each intermediate date is completed.

[0020] To achieve the above object, an embodiment of the third aspect of the present application provides an electronic device, including: a processor, and a memory communicatively connected to the processor; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to implement a business data batch processing method as described in the first aspect of the embodiments of the present application.

[0021] To achieve the above object, an embodiment of the fourth aspect of the present application provides a computer-readable storage medium, where computer execution instructions are stored in the computer-readable storage medium, and when the computer execution instructions are executed by a processor, they are used to implement a business data batch processing method as described in the first aspect of the embodiments of the present application.

[0022] To achieve the above object, an embodiment of the fifth aspect of the present application provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements a business data batch processing method as described in the first aspect of the embodiments of the present application.

[0023] The technical solution provided by the present application at least brings the following beneficial effects:

[0024] This application obtains a batch job date switching request, detects whether there is target business data that needs to be processed in batch at each intermediate date between the first date and the second date. In the case where there is target business data at the intermediate date, a batch job is executed based on the target business data. After the batch jobs at each intermediate date are completed, a batch job is executed based on the target business data on the second date. Based on this, when performing skip-day batch processing based on the first date and the second date, this application can avoid missing the business data corresponding to the skipped intermediate dates.

[0025] Additional aspects and advantages of this application will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of this application. Description of the Drawings

[0026] The above and / or additional aspects and advantages of this application will become apparent and be readily understood from the following description of the embodiments in conjunction with the drawings, where:

[0027] Figure 1 is a schematic flowchart of a method for batch processing business data provided by an embodiment of this application;

[0028] Figure 2 is a schematic flowchart of a method for batch processing business data provided by another embodiment of this application;

[0029] Figure 3 is a schematic flowchart of a method for batch processing business data provided by yet another embodiment of this application;

[0030] Figure 4 is a schematic structural diagram of a device for batch processing business data provided by an embodiment of this application;

[0031] Figure 5 is a block diagram of an electronic device provided by an embodiment of this application. Detailed Embodiments

[0032] The embodiments of this application will be described in detail below. The examples of the embodiments are shown in the drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary and are intended to explain this application and should not be construed as limiting this application.

[0033] The method and device for batch processing business data according to the embodiments of this application will be described below with reference to the drawings.

[0034] Figure 1The flowchart shows a method for batch processing of business data provided by an embodiment of the present application. The business data batch processing method provided by the present application can be applied to financial systems such as settlement systems and loan systems. For the sake of easy understanding, the present application takes the loan system as an example for illustration.

[0035] As Figure 1 shown, the business data batch processing method includes the following steps:

[0036] Step 101: Obtain a batch date switching request, which is used to indicate switching from a first date to a non-adjacent second date.

[0037] Optionally, the batch date switching request may include the first date and the second date, or may include information indicating switching from the first date to the second date. Among them, the first date and the second date may refer to two non-adjacent dates.

[0038] The interval duration between the first date and the second date can be determined according to actual needs, and the present application does not limit the interval duration between the first date and the second date.

[0039] The interval duration between the first date and the second date can be in days, months, or years. By way of example and not limitation, the interval duration between the first date and the second date can be ten days or one year.

[0040] Step 102: Detect whether there is target business data that needs to be batch processed on each intermediate date between the first date and the second date.

[0041] The dates when different testers pre-embed business data may be different. Detecting whether each intermediate date corresponds to target business data that needs to be batch processed can avoid missed batch processing of the business data pre-embedded on the intermediate dates.

[0042] It should be noted that the pre-embedded business data corresponding to each date may be different.

[0043] Step 103: When there is target business data on the intermediate date, execute a batch task based on the target business data.

[0044] When there is target business data on the intermediate date, the batch task can be executed in sequence based on the target business data on each intermediate date according to the time sequence.

[0045] By way of example and not limitation, in the loan system, the target business data may refer to loan notes; the batch tasks may refer to interest supplement tasks, interest settlement tasks, bill issuance tasks, and grace period processing tasks.

[0046] By detecting whether there is target business data at the intermediate date and performing batch processing based on the target business data at the intermediate date, the continuity of relevant data can be ensured, and the complexity of pre-embedded data and batch processing execution work can be reduced.

[0047] Step 104, after the batch processing tasks at each intermediate date are completed, perform a batch processing task based on the target business data at the second date.

[0048] After the batch processing tasks at each intermediate date are completed, it is possible to detect the target business data that needs to be batch processed existing at the second date, and perform a batch processing task based on the detected target business data.

[0049] In this embodiment, obtain a batch processing date switching request, detect whether there is target business data that needs to be batch processed at each intermediate date between the first date and the second date. In the case where there is target business data at the intermediate date, perform a batch processing task based on the target business data. After the batch processing tasks at each intermediate date are completed, perform a batch processing task based on the target business data at the second date. Based on this, when performing skip-day batch processing based on the first date and the second date, the present application can avoid missing the batch processing of the business data corresponding to the skipped intermediate dates.

[0050] This embodiment provides another method for batch processing business data. Figure 2 It is a flowchart of a method for batch processing business data provided by an embodiment of the present application.

[0051] As Figure 2 shown, the method for batch processing business data may include the following steps:

[0052] Step 201, obtain a batch processing date switching request.

[0053] The relevant content in Step 201 can refer to the relevant description in Step 101, which will not be elaborated here.

[0054] Step 202, according to at least one data screening rule, search in the business data set corresponding to the intermediate date to find out whether there is target business data that meets the data screening rule.

[0055] The data screening rule can be preset by the user according to the characteristics of the business data that needs to be batch processed at the intermediate date.

[0056] By way of example and not limitation, if batch processing of promissory notes due on the intermediate date is required, the data screening rule can be to compare the due date of the promissory note with the intermediate date and screen out the promissory notes with the due date being the intermediate date; if batch processing of promissory notes due on the intermediate date and not repaid is required, the data screening rule can be to compare the due date of the promissory note with the intermediate date and detect whether there is corresponding repayment data for the promissory note, and screen out the promissory notes with the due date being the intermediate date and without corresponding repayment data.

[0057] Users can flexibly adjust the data screening rules according to actual needs, and then screen out the target business data that meets the requirements and needs to be batch processed.

[0058] Step 203: According to the set data processing order, sequentially execute batch tasks based on the target business data under each data type, where the data type corresponds one-to-one with the data screening rule.

[0059] In the case where there are multiple data screening rules, there may be a dependency relationship between the target business data screened out based on each data screening rule. For example, based on data screening rule 1, target business data 1 is screened out, and based on data screening rule 2, target business data 2 is screened out. When executing the batch task based on target business data 2, it depends on the batch result of target business data 1. Based on this, in order to ensure the smooth execution of the batch task, the data processing order can be determined in advance according to the dependency relationship.

[0060] By way of example and not limitation, assume there are three data screening rules, and target business data of three data types A, B, and C are screened out according to the three data screening rules. Among them, the target business data under data type B depends on the batch result of the target business data under data type A, and there is no dependency relationship between the target business data under data type C and the target business data under the other two data types. Then the pre-determined data processing order can be the target business data under data type A, the target business data under data type B, and the target business data under data type C, or it can also be the target business data under data type C, the target business data under data type A, and the target business data under data type B.

[0061] Taking the data processing order as the target business data under data type A, the target business data under data type B, and the target business data under data type C as an example, when executing the batch task, the corresponding batch task can be executed first based on the target business data under data type A, then the corresponding batch task can be executed based on the target business data under data type B, and finally the corresponding batch task can be executed based on the target business data under data type C.

[0062] Suppose based on the data screening rules, three types of target business data are screened out, namely, the promissory notes with the due date of the installment payment being the middle date (corresponding to data type A), the promissory notes with the due date of the installment payment being the middle date and without corresponding repayment data (corresponding to data type B), and the promissory notes with new installment payments added on the middle date (corresponding to data type C). Among them, the batch processing tasks corresponding to the promissory notes with the due date of the installment payment being the middle date include interest supplement tasks, the batch processing tasks corresponding to the promissory notes with the due date of the installment payment being the middle date and without corresponding repayment data include interest settlement tasks, and the batch processing tasks corresponding to the promissory notes with new installment payments added on the middle date include loan amount calculation tasks.

[0063] The interest settlement tasks corresponding to the promissory notes with the due date of the installment payment being the middle date and without corresponding repayment data depend on the batch processing results of the interest supplement tasks corresponding to the promissory notes with the due date of the installment payment being the middle date. The loan amount calculation tasks corresponding to the promissory notes with new installment payments added on the middle date do not depend on the target business data of the other two data types. Therefore, the set data processing order can be the promissory notes with the due date of the installment payment being the middle date, the promissory notes with the due date of the installment payment being the middle date and without corresponding repayment data, and the promissory notes with new installment payments added on the middle date, or it can be the promissory notes with new installment payments added on the middle date, the promissory notes with the due date of the installment payment being the middle date, and the promissory notes with the due date of the installment payment being the middle date and without corresponding repayment data.

[0064] Optionally, each type of target business data corresponds to a set of batch processing tasks. The set of batch processing tasks includes the batch processing tasks that need to be performed based on the target business data of this data type. Executing the batch processing tasks based on the target business data under each data type includes: for each target business data under each data type, according to the set task execution order, sequentially perform the batch processing tasks included in the corresponding set of batch processing tasks based on this target business data.

[0065] Suppose based on the data screening rules, two types of target business data are screened out, namely, the promissory notes with the due date of the installment payment being the middle date, and the promissory notes with the due date of the installment payment being the middle date and without corresponding repayment data. By way of example and not limitation, the batch processing tasks included in the set of batch processing tasks corresponding to the promissory notes with the due date being the middle date can be interest supplement tasks, order issuing tasks, and new installment payment generation tasks, etc.; the batch processing tasks included in the set of batch processing tasks corresponding to the promissory notes with the due date of the installment payment being the middle date and without corresponding repayment data can be interest settlement tasks, grace period processing tasks, etc.

[0066] Among them, for the IOU with the maturity date being the intermediate date and without corresponding repayment data, if the borrower fails to repay in time, the financial institution can allow the borrower to delay the repayment according to relevant policies. In this case, the batch tasks to be executed based on this IOU may include generating sub-periodic payments for the overdue periodic payments with delayed repayment allowed, performing interest compensation processing on the sub-periodic payments, performing interest settlement processing on the original overdue periodic payments, performing grace period processing on the sub-periodic payments, and performing grace period processing on the overdue overdue periodic payments, etc. Among them, the overdue overdue periodic payments can refer to the periodic payments that have undergone grace period processing and have not been repaid on the repayment date corresponding to the grace period. In addition, the grace periods corresponding to the periodic payments with delayed repayment allowed and the overdue periodic payments can be different or the same.

[0067] Optionally, the task execution order can be determined in advance according to the dependency relationship between batch tasks.

[0068] For each target business data under each data type, according to the set task execution order, based on the target business data in sequence, execute the batch tasks included in the corresponding batch task set. It can be understood that the batch tasks with the same input data are grouped together and executed in sequence to improve the execution efficiency of batch tasks. Among them, the input data can be understood as the data based on which the batch tasks are executed, that is, the target business data.

[0069] As an example rather than a limitation, for the IOU with the maturity date of the periodic payment being the intermediate date, the interest compensation task, the document issuance task, and the new periodic payment generation task included in the batch task set can be executed in sequence.

[0070] Step 204, after the batch tasks at each intermediate date are executed, execute the batch tasks based on the target business data on the second date.

[0071] Optionally, the method further includes: generating a batch log of the target business data after the batch tasks are executed.

[0072] The batch log can be understood as the detailed data generated after executing the batch tasks based on the target business data. Taking the interest compensation task as an example of the batch task, the batch log includes information such as the interest compensation amount, the interest compensation time period, and the corresponding interest rate.

[0073] When there are error data in the jump-day batch test, the batch log helps the testers to troubleshoot the error causes and improve the troubleshooting efficiency of the testers.

[0074] In this embodiment, a batch running date switching request is obtained. According to at least one data screening rule, in the set of business data corresponding to the intermediate date, it is checked whether there is target business data that meets the data screening rule. According to the set data processing order, the batch running tasks are sequentially executed based on the target business data under each data type. After the batch running tasks for each intermediate date are completed, the batch running task is executed based on the target business data on the second date. Based on this, the user can flexibly adjust the data screening rule according to actual needs, and then screen out the target business data that meets the requirements and needs to be batch processed. In addition, according to the set task execution order, the batch running tasks included in the batch running task set are sequentially executed, which can improve the execution efficiency of the batch running tasks.

[0075] This embodiment provides another method for batch running business data. This method can be applied to a financial system. The financial system needs to perform batch running based on relevant business data every day. Therefore, a batch running program is designed when constructing the financial system.

[0076] Figure 3 It is a schematic flowchart of a method for batch running business data provided by an embodiment of the present application. As Figure 3 shown, this method for batch running business data may include the following steps:

[0077] Step 301, obtain a batch running date switching request.

[0078] Step 302, detect whether there is target business data that needs to be batch processed under each intermediate date between the first date and the second date.

[0079] Step 303, when there is target business data on the intermediate date, call the original batch running program corresponding to the batch running task in the financial system to perform batch processing on the target business data to execute the batch running task.

[0080] Calling the original batch running program in the financial system to execute the corresponding batch running task can avoid adding new execution logic and avoid affecting the processing of the original business in the financial system, achieving the effect of having no impact on the actual business for "starting the skip-day batch running test and stopping the skip-day batch running test" without expanding the test scope.

[0081] Optionally, executing the batch running task based on the target business data includes: detecting whether there is a batch running result corresponding to the target business data; when there is no batch running result corresponding to the target business data, executing the batch running task based on the target business data.

[0082] If there is a batch running result corresponding to the target business data, it can indicate that the target business data has been batch processed. At this time, there is no need to perform batch processing again or an empty run can be performed based on the target business data.

[0083] In the case where there is no corresponding batch running result for the target business data, call the corresponding batch running program to perform batch running processing on the target business data to execute the batch running task.

[0084] Through the above steps, an idempotent effect can be achieved, that is, no matter how many times the batch running processing is performed based on the same target business data, the batch running results are the same.

[0085] Optionally, the method further includes: in the case where the batch running task is interrupted, obtain the interruption information; based on the interruption information, perform resume running of the batch running task from the breakpoint.

[0086] The interruption information may include the data identification information of the target business data being batch run, and / or the task identification information of the batch running task being executed. Among them, the data identification information may refer to information such as location and data number, and the task identification information may refer to information such as task number and task name.

[0087] After starting to execute the batch running task again, according to the interruption information, directly execute the batch running task interrupted previously, avoiding repeated execution of the batch running task and saving computing resources.

[0088] Optionally, the method further includes: after the batch running task is completed, count the number N of the obtained batch running results; in the case where the number N is equal to the set quantity threshold, submit the N batch running results to the database.

[0089] As an example rather than a limitation, the batch running tasks corresponding to the obtained batch running results may be the same type of batch running task. Taking the batch running task as the order issuing task as an example, after obtaining N order issuing results, submit the N order issuing results to the database.

[0090] Optionally, after obtaining every N batch running results, submit the N batch running results to the database to implement the function of segmented transaction submission and avoid continuously occupying the submission interface of the database.

[0091] Step 304, after the batch running tasks at each intermediate date are completed, perform a batch running task based on the target business data under the second date.

[0092] In this embodiment, in the case where there is target business data at the intermediate date, call the original batch running program corresponding to the batch running task in the financial system to perform batch running processing on the target business data to execute the batch running task, which can avoid adding new execution logic and affecting the processing of the original business in the financial system.

[0093] To implement the above embodiment, an embodiment of the present application also proposes a business data batch running device. Figure 4 For the structural schematic diagram of a business data batch running device provided by an embodiment of the present application, as Figure 4As shown in the figure, the batch processing device 400 for business data includes:

[0094] A request acquisition module 401, configured to acquire a batch processing date switching request, where the batch processing date switching request is used to indicate switching from a first date to a non - adjacent second date;

[0095] A data detection module 402, configured to detect whether there is target business data that needs to be batch - processed on each intermediate date between the first date and the second date;

[0096] A first execution module 403, configured to execute a batch task based on the target business data when there is target business data on the intermediate date;

[0097] A second execution module 404, configured to execute a batch task based on the target business data on the second date after the batch tasks on each intermediate date are completed.

[0098] Optionally, the data detection module 402 is specifically configured to:

[0099] According to at least one data screening rule, search for whether there is target business data that meets the data screening rule in the business data set corresponding to the intermediate date.

[0100] Optionally, the first execution module 403 is specifically configured to:

[0101] According to the set data processing order, sequentially execute batch tasks based on the target business data under each data type, where the data type corresponds one - to - one with the data screening rule.

[0102] Optionally, for the target business data of each data type, there is a corresponding batch task set, and the batch task set includes batch tasks that need to be batch - processed based on the target business data of this data type. The first execution module 403 is specifically configured to:

[0103] For each target business data under each data type, according to the set task execution order, sequentially execute the batch tasks included in the corresponding batch task set based on this target business data.

[0104] Optionally, the first execution module 403 is specifically configured to:

[0105] Detect whether there is a corresponding batch result for the target business data;

[0106] When the target business data does not have a corresponding batch result, execute the batch task based on the target business data.

[0107] Optionally, the device further includes:

[0108] An interruption information acquisition module, configured to acquire interruption information when a batch job execution is interrupted, where the interruption information includes data identification information of target service data undergoing batch processing, and / or task identification information of the batch job being executed;

[0109] A breakpoint resumption module, configured to resume the batch job from the breakpoint based on the interruption information.

[0110] Optionally, the apparatus further includes:

[0111] A quantity statistics module, configured to count the quantity N of the obtained batch job results after the batch job execution is completed;

[0112] A result submission module, configured to submit the N batch job results to a database when the quantity N is equal to a set quantity threshold.

[0113] Optionally, the apparatus is applied to a financial system, and the first execution module 403 is specifically configured to:

[0114] Call an original batch program corresponding to the batch job in the financial system to perform batch processing on the target service data so as to execute the batch job.

[0115] Optionally, the apparatus further includes:

[0116] A log generation module, configured to generate a batch log of the target service data after the batch job execution is completed.

[0117] It should be noted that the foregoing explanation of the embodiments of the batch processing method for service data also applies to the batch processing apparatus for service data in this embodiment, and details are not described herein again.

[0118] Figure 5 FIG. is a schematic structural diagram of an electronic device provided in an embodiment of the present application. Among them, the electronic device 500 in this embodiment is intended to represent various forms of digital computers, such as, a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as, a personal digital processor, a cellular phone, a smart phone, a wearable device, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0119] As Figure 5 shown, the above-mentioned electronic device 500 includes:

[0120] A memory 501 and a processor 502, a bus 503 connecting different components (including the memory 501 and the processor 502), the memory 501 stores a computer program, and when the processor 502 executes the program, the batch processing method of service data in the embodiments of the present application is implemented.

[0121] The bus 503 represents one or more of several types of bus architectures, including a memory bus or a memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any bus architecture in a variety of bus architectures. For example, these architectures include, but are not limited to, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

[0122] The electronic device 500 typically includes a variety of electronically device-readable media. These media can be any available media that can be accessed by the electronic device 500, including volatile and non-volatile media, removable and non-removable media.

[0123] The memory 501 may further include a computer system-readable medium in the form of volatile memory, such as random access memory (RAM) 504 and / or cache memory 505. The electronic device 500 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, a storage system 506 can be used for reading and writing non-removable, non-volatile magnetic media ( Figure 5 not shown, commonly referred to as a "hard disk drive"). Although Figure 5 not shown in the figure, a disk drive for reading and writing removable non-volatile disks (such as "floppy disks") and an optical disk drive for reading and writing removable non-volatile optical disks (such as CD-ROM, DVD-ROM, or other optical media) can be provided. In these cases, each drive can be connected to the bus 503 through one or more data media interfaces. The memory 501 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of the present application.

[0124] A program / utility 508 having a set (at least one) of program modules 507 can be stored, for example, in the memory 501. Such program modules 507 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include the implementation of a network environment. The program modules 507 generally execute the functions and / or methods in the embodiments described in the present application.

[0125] The electronic device 500 can also communicate with one or more external devices 509 (such as a keyboard, a pointing device, a display 511, etc.), and can also communicate with one or more devices that enable a user to interact with the electronic device 500, and / or communicate with any device that enables the electronic device 500 to communicate with one or more other computing devices (such as a network card, a modem, etc.). Such communication can be carried out through the input / output (I / O) interface 512. Moreover, the electronic device 500 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 513. As Figure 5 shown, the network adapter 513 communicates with other modules of the electronic device 500 through the bus 503. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in combination with the electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0126] The processor 502 executes various functional applications and data processing by running the programs stored in the memory 501.

[0127] It should be noted that for the implementation process and technical principle of the electronic device in this embodiment, refer to the foregoing explanation of the method for batch processing of service data in the embodiments of the present application, which will not be elaborated here.

[0128] To implement the above embodiments, the present application also proposes a computer-readable storage medium, in which computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, they are used to implement the method provided in the foregoing embodiments.

[0129] To implement the above embodiments, the present application also proposes a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the method provided in the foregoing embodiments.

[0130] The collection, storage, use, processing, transmission, provision, and disclosure, etc. of the user's personal information involved in the present application all comply with the provisions of relevant laws and regulations and do not violate public order and good customs.

[0131] It should be noted that personal information from users should be collected for legal and reasonable purposes and should not be shared or sold outside of such legal uses. In addition, such collection / sharing should be carried out after obtaining the informed consent of the users, including but not limited to notifying the users to read the user agreement / user notice and sign an agreement / authorization including authorizing relevant user information before the users use the function. In addition, any necessary steps should be taken to safeguard and protect access to such personal information data and ensure that others with access to the personal information data comply with their privacy policies and procedures.

[0132] This application is expected to provide an implementation scheme for users to selectively block the use or access to personal information data. That is, the present disclosure is expected to provide hardware and / or software to prevent or block access to such personal information data. Once the personal information data is no longer needed, the risk can be minimized by restricting data collection and deleting the data. In addition, when applicable, personal identifiers are removed from such personal information to protect the privacy of users.

[0133] In the description of the foregoing embodiments, the descriptions referring to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples" mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0134] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. In the description of the present application, "a plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

[0135] Any process or method description shown in the flowchart or described in other ways herein can be understood as representing a module, segment, or part of code including one or more executable instructions for implementing a customized logical function or process, and the scope of the preferred implementation of the present application includes additional implementations, where the functions may be executed not in the order shown or discussed, including in a substantially simultaneous manner or in a reverse order according to the functions involved, which should be understood by those skilled in the art to which the embodiments of the present application belong.

[0136] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a definite sequence list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch and execute instructions from the instruction execution system, apparatus, or device), or in conjunction with these instruction execution systems, apparatuses, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer diskette (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or otherwise processing as appropriate, and then storing it in a computer memory.

[0137] It should be understood that various parts of the present application can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

[0138] Those of ordinary skill in the art of this technology can understand that all or part of the steps carried by the method of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.

[0139] In addition, each functional unit in various embodiments of the present application may be integrated into one processing module, may exist physically alone for each unit, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0140] The above-mentioned storage medium may be a read-only memory, a magnetic disk, an optical disc, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.

Claims

1. A method for batch processing of business data, which is used for skip-day batch processing test, Characterized in that, It includes the following steps: Execute a batch task based on the business data on the first date; After the batch task on the first date is completed, obtain a batch date switching request, which is used to indicate switching from the first date to a non-adjacent second date; Detect whether there is target business data that needs to be batch processed on each intermediate date between the first date and the second date; When there is target business data on an intermediate date, execute a batch task based on the target business data; After the batch tasks on each intermediate date are completed, execute a batch task based on the target business data on the second date.

2. The method according to claim 1, Characterized in that, The step of detecting whether there is target business data that needs to be batch processed on each intermediate date between the first date and the second date includes: According to at least one data screening rule, search in the business data set corresponding to the intermediate date to find out whether there is target business data that meets the data screening rule.

3. The method according to claim 2, Characterized in that, When there is target business data on an intermediate date, the step of executing a batch task based on the target business data includes: According to the set data processing order, execute batch tasks based on the target business data under each data type in turn, where the data type corresponds to the data screening rule one by one.

4. The method according to claim 3, Characterized in that, Each data type of target business data corresponds to a batch task set, and the batch task set includes batch tasks that need to be batch processed based on the target business data of this data type. The step of executing batch tasks based on the target business data under each data type includes: For each target business data under each data type, according to the set task execution order, execute the batch tasks included in the corresponding batch task set based on this target business data in turn.

5. The method according to claim 1, Characterized in that, The step of executing a batch task based on the target business data includes: Detect whether the target business data corresponds to a batch result; When the target business data does not correspond to a batch result, execute a batch task based on the target business data.

6. The method according to claim 1, Characterized in that, The method further includes: When the batch task execution is interrupted, obtain interruption information, where the interruption information includes the data identification information of the target business data being batch processed, and / or, the task identification information of the batch task being executed; Based on the interruption information, perform breakpoint resumption of the batch task.

7. The method according to claim 1, Characterized in that, The method further includes: After the batch task is completed, count the number N of the obtained batch results; When the number N is equal to the set number threshold, submit N batch results to the database.

8. The method according to claim 1, Characterized in that, The method is applied to a financial system. The batch job execution based on target business data includes: Invoking the original batch program corresponding to the batch job in the financial system to perform batch processing on the target business data so as to execute the batch job.

9. The method according to any one of claims 1-6, wherein, the method further includes: After the batch job is executed, generating a batch log of the target business data.

10. A business data batch processing device for performing skip-day batch testing, wherein, it includes: A request acquisition module, configured to acquire a batch date switching request after the batch job on the first date is executed, where the batch date switching request is used to indicate switching from the first date to a non-adjacent second date; A data detection module, configured to detect whether there is target business data that needs to be batch processed on each intermediate date between the first date and the second date; A first execution module, configured to execute a batch job based on the target business data when there is target business data on the intermediate date; A second execution module, configured to execute a batch job based on the target business data on the second date after the batch jobs on each intermediate date are executed; The device also executes: Executing a batch job based on the business data on the first date.

Citation Information

Patent Citations

  • Data processing method, device and equipment and computer readable storage medium

    CN111858542A

  • Automatic testing method, device and equipment for batch processing tasks and storage medium

    CN116383052A