Check patentability & draft patents in minutes with Patsnap Eureka AI!

A batch processing method and a batch processing system for data

A batch processing and data technology, applied in the field of data processing, can solve the problems of low hardware failure rate, high cost, and high price of financial services, and achieve the effect of reducing hardware cost and improving reliability

Active Publication Date: 2018-08-17
TENPAY PAID TECH
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] (1) In order to ensure that running batches can be completed on time and with high quality, and to achieve the reliability of financial-level data processing, it is necessary to execute batch running tasks on high-performance hardware, and exchange higher hardware costs for lower hardware failure rates. Take a computer composed of X86 architecture processor chip components as an example. The price is at the level of 100,000 RMB. The high hardware cost leads to high financial service prices, and it is difficult to serve the general public at an affordable price.
[0004] (2) Interest calculation services cannot be provided to users during the batch running period, so 7*24 real-time interest calculation services cannot be provided, which reduces user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A batch processing method and a batch processing system for data
  • A batch processing method and a batch processing system for data
  • A batch processing method and a batch processing system for data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] A data batching method such as figure 1 As shown, the method includes:

[0039] S101. Read data entries for batch processing from the data center sequentially according to a preset order.

[0040] The data center can simultaneously accept read and write operations on data entries by multiple batch processes, and record the processing results of the data entries by marking the processing status of the data entries.

[0041] S102. Determine whether the data entry has been successfully processed according to the processing status of the data entry.

[0042] S103. If not, process the data entry.

[0043] S104. If yes, skip the data entry and continue processing the next data entry. If all data items have been read, stop reading data items.

[0044] Specifically, during the interaction between multiple batch processes and the data center, the data center does not implement read protection for the data entries used for batch processing, that is, all batch processes can su...

Embodiment 2

[0055] The data batch processing method provided in this embodiment is applied to the execution of financial batch running tasks. The batch running refers to calculating the user's interest according to the preset billing rules through batch processing. The batch running is executed once a day, such as figure 2 As shown, the method includes:

[0056] S201. Read data entries for batch processing from the data center sequentially according to a preset sequence.

[0057] The data center can simultaneously accept read and write operations on data items by multiple batch processes, and record the processing results of the data items by marking the processing status of the data items. In this embodiment, the data entry is the relevant data used to calculate the interest of a certain user. Reading the data entry is the process of calculating the interest and obtaining the preparation data. The processing status is used to mark whether the user is running on the current day. The int...

Embodiment 3

[0067] In the financial field, batch running tasks are usually performed within a fixed time period every day, but real-time interest calculation cannot be provided for users during the batch running process. Only after the batch running is completed, users can know the interest that needs to be paid, thereby reducing the user Experience, the data batch processing method provided in this embodiment can provide 7*24 hours of full real-time interest calculation services for the financial field.

[0068] The data batch processing method provided in this embodiment is consistent with that in Embodiment 2. In addition, a real-time interest calculation method is also provided, and the real-time interest calculation is performed by a separate processing process, such as image 3 shown, including:

[0069] S301. A separate processing request for a certain user interest is detected;

[0070] S302. Read the data entry for calculating the user interest;

[0071] S303. Determine whether...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a batch processing method and a batch processing system for data. The preemptive processing is performed by a plurality of batch processing processes on the pending data of a data center, and the completion of the batch processing task is not influenced by the fault of some batch processing process; and in the process of the batch processing, the data can be processed in real time without batch processing interference by performing the individual processing process, so that the requirements of users for full real-time data service are satisfied. The batch processing method and the batch processing system for data are especially suitable for batch processing task of credit products, the hardware cost can be reduced, the reliability of the financial level data processing can be reached, and real time interest calculating service is provided during the performing of the run-batch process, so that 7*24 hours full real time data service is provided for users.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data batch processing method and system. Background technique [0002] For the calculation of the interest of credit products, the interest of the new day is generally calculated by running batches every morning, and the batches are calculated by batch processing. The traditional way of running batches to calculate interest has the following shortcomings: [0003] (1) In order to ensure that running batches can be completed on time and with high quality, and to achieve the reliability of financial-level data processing, it is necessary to execute batch running tasks on high-performance hardware, and exchange higher hardware costs for lower hardware failure rates. For example, a computer composed of X86 architecture processor chip components is priced at 100,000 RMB. The high hardware cost leads to high financial service prices, and it is difficult to serve the general public at ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50G06Q40/02
CPCG06F9/5027G06Q40/03
Inventor 郑伟涛郭懿心韦德志
Owner TENPAY PAID TECH
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More