Multi-server data processing method and device, computer equipment and storage medium
A multi-server, data processing technology, applied in the field of data processing, can solve the problems of rerunning data, unexecutable jobs, fault tolerance space and low processing efficiency, and achieves the effect of improving efficiency and fault tolerance rate
Pending Publication Date: 2022-05-13
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] The current way of processing transaction details files has the following problems: traditional batch jobs can only be run on one server, and the job will not be executable after the server goes down. If the job needs to be rerun due to data problems, all data will be rerun
The processing of transaction detail files does not have enough room for error tolerance and the processing efficiency is low
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0047] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.
[0048] In one embodiment, such as figure 1As shown, a multi-server data processing method is provided. In this embodiment, the method is applied to a terminal for illustration. It can be understood that the method can also be applied to a server, and can also be applied to a system including a terminal and a server. It is realized through the interaction between the terminal and the server. In this embodiment, the method includes the following steps:
[0049] In step 102, the first server acquires the correspondence between servers and data fragments, and the corresponde...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a multi-server data processing method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: a first server obtains a corresponding relationship between the server and a data fragment, wherein the corresponding relationship between the server and the data fragment is determined based on a data file and a fragment number; the first server obtains the data file from the second server, and determines a target data fragment corresponding to the first server from the data file according to a corresponding relationship between the server and the data fragment; and the first server processes the target data fragment. By the adoption of the method, the multiple first servers can be called, each first server obtains the data file from the second server, then the target data fragment in charge of each first server is determined according to the corresponding relation between the servers and the data fragments, each first server traverses the data file, and the target data fragment is obtained. And only the data in the corresponding target data fragment range is processed, so that the data processing efficiency and the error-tolerant rate can be improved.
Description
technical field [0001] The present application relates to the technical field of data processing, in particular to a multi-server data processing method, device, computer equipment, storage medium and computer program product. Background technique [0002] With the development of the economy and the large-scale application of mobile Internet technology, the frequency of customer transactions is getting higher and higher, and the scale of transactions is getting larger and larger. Due to the limited computing power of a single server, the pressure on the server increases, the more time the bank spends on generating bills, and the later the generation of bills is completed, the single-node architecture can no longer meet the needs of customers for the timeliness of receiving bills. The traditional method of generating bank statements in the industry is to receive the transaction details file on a single server. Each line in the file is the transaction details of a customer, an...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F16/16G06F16/182
CPCG06F16/16G06F16/182
Inventor 孙佳正顾佳骏吴炜黄荣清
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA