Batch transfer file processing method and device

Abstract

The invention discloses a batch transfer file processing method and device, and relates to the technical field of financial science and technology, and the method comprises the steps: obtaining batch transfer files; disassembling the batch transfer file into a plurality of transaction instructions, and extracting instruction influence factors; according to the instruction processing duration in the idle period, obtaining the system operation performance levels of the batch transfer file moment and the current moment, and generating a first prediction instruction processing duration and a second prediction instruction processing duration; and automatically identifying and calling corresponding standby server resources according to the first prediction instruction processing duration and the second prediction instruction processing duration, so that the problem that the batch transfer file processing prediction waiting time is invisible to a user and is difficult to estimate can be solved, the user is prevented from repeatedly modifying a submitted instruction, the operation time and the labor cost are saved, and the user experience is improved. And the batch transfer file processing efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of financial technology, and in particular to a method and device for processing batch transfer files. Background Art

[0002] This section is intended to provide a background or context to the embodiments of the invention recited in the claims. No admission is made that the description herein is prior art by inclusion in this section.

[0003] When initiating batch transfer business, corporate finance personnel usually use batch tools to input payment information to generate large files, upload batch packages through corporate online banking channels, and wait for the collection instructions to be processed. However, corporate online banking currently does not provide a dynamic prediction of the processing time of large files, and only displays static results after two stages: first, after the large file parsing is completed, the instruction status is updated from "unchecked" to "checked" or "checked failed"; second, after the instruction account processing is completed, the status of each instruction in the batch can be viewed, which is updated from "waiting for bank processing" to "processed successfully" or "processed failed". Under the current instruction processing mode, users cannot accurately know the time when the corresponding batch file instruction parsing and the instructions in the batch package are all processed. They can only confirm the processing progress by repeatedly querying the instruction status. On the one hand, this method requires financial personnel to repeatedly use U shield to log in to corporate online banking to check the progress, which causes inconvenience to the actual work of financial personnel; on the other hand, it is easy to cause corporate finance personnel to ignore the final verification of instruction processing results after submitting instructions, and fail to initiate a second deduction in time when the deduction instruction fails, affecting the timely arrival of corporate income.

[0004] At the same time, due to differences in server performance, instruction queuing process, system load and other factors in different time periods, the processing time of batch transfer files will also fluctuate greatly, which may easily lead to transaction congestion during peak business periods, resulting in the inability to complete the processing of corporate users' batch transfer instructions, affecting the users' actual business development. Summary of the invention

[0005] The embodiment of the present invention provides a batch transfer file processing method, which is used to solve the problem that the predicted waiting time of batch transfer file processing is invisible to users and difficult to estimate, avoids users from repeatedly modifying submission instructions, saves operation time and labor costs, and improves the efficiency of batch transfer file processing. The method includes:

[0006] Get batch transfer files;

[0007] Decomposing the batch transfer file into multiple transaction instructions, and extracting the instruction impact factor of each transaction instruction; the instruction impact factor is a transaction parameter that affects the instruction processing time;

[0008] Determine, according to the instruction impact factor, the instruction processing duration when the system operation performance level of the batch transfer file processing system is an idle period; the idle period indicates that the server resource occupancy rate of the batch transfer file processing system is lower than a first occupancy rate threshold;

[0009] Generate a first predicted instruction processing time of the batch transfer file according to the instruction processing time when the system operation performance level is an idle period and the system operation performance level at the time of obtaining the batch transfer file;

[0010] Generate a second predicted instruction processing duration according to the instruction processing duration when the system operation performance level is an idle period and the system operation performance level at the current moment;

[0011] According to the first predicted instruction processing time and the second predicted instruction processing time, the corresponding backup server resources are automatically identified and called.

[0012] The embodiment of the present invention further provides a batch transfer file processing device, which is used to solve the problem that the predicted waiting time for batch transfer file processing is invisible to users and difficult to estimate, avoids users from repeatedly modifying submission instructions, saves operation time and labor costs, and improves the efficiency of batch transfer file processing. The device includes:

[0013] Acquisition module, used to obtain batch transfer files;

[0014] A disassembly module is used to disassemble the batch transfer file into multiple transaction instructions and extract the instruction impact factor of each transaction instruction; the instruction impact factor is a transaction parameter that affects the instruction processing time;

[0015] A determination module, configured to determine, based on the instruction impact factor, an instruction processing duration when the system operation performance level of the batch transfer file processing system is an idle period; the idle period indicates that the server resource occupancy rate of the batch transfer file processing system is lower than a first occupancy rate threshold;

[0016] A first prediction module, used to generate a first predicted instruction processing time of the batch transfer file according to the instruction processing time when the system operation performance level is an idle period and the system operation performance level at the time of obtaining the batch transfer file;

[0017] A second prediction module, used for generating a second predicted instruction processing duration according to the instruction processing duration when the system operation performance level is an idle period and the system operation performance level at a current moment;

[0018] The calling module is used to automatically identify and call corresponding backup server resources according to the first predicted instruction processing time and the second predicted instruction processing time.

[0019] An embodiment of the present invention further provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned batch transfer file processing method when executing the computer program.

[0020] An embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned batch transfer file processing method is implemented.

[0021] An embodiment of the present invention further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the above-mentioned batch transfer file processing method is implemented.

[0022] Compared with the technical solution of using a batch tool to process batch files and display static results in the prior art, the embodiment of the present invention obtains a batch transfer file; decomposes the batch transfer file into multiple transaction instructions, and extracts the instruction impact factor of each transaction instruction; the instruction impact factor is a transaction parameter that affects the instruction processing time; according to the instruction impact factor, the instruction processing time when the system operation performance level of the batch transfer file processing system is an idle period is determined; the idle period represents that the server resource occupancy rate of the batch transfer file processing system is lower than the first occupancy rate threshold; according to the instruction processing time when the system operation performance level is the idle period and the system operation performance level at the time of obtaining the batch transfer file, a first predicted instruction processing time of the batch transfer file is generated; according to the instruction processing time when the system operation performance level is the idle period and the system operation performance level at the current time, a second predicted instruction processing time is generated; according to the first predicted instruction processing time and the second predicted instruction processing time, the corresponding standby server resources are automatically identified and called, which can solve the problem that the predicted waiting time of batch transfer file processing is invisible to users and difficult to estimate, avoid users from repeatedly modifying and submitting instructions, save operation time and labor costs, and improve the efficiency of batch transfer file processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0024] Figure 1 Flow chart of a method for processing batch transfer files in an embodiment of the present invention;

[0025] Figure 2It is a flowchart of a specific example of a method for processing batch transfer files in an embodiment of the present invention;

[0026] Figure 3 Schematic diagram of a batch transfer file processing device in an embodiment of the present invention;

[0027] Figure 4 Schematic diagram of a specific example of a batch transfer file processing device in an embodiment of the present invention;

[0028] Figure 5 Schematic diagram of a computer device in an embodiment of the present invention. DETAILED DESCRIPTION

[0029] To make the purpose, technical solution and advantages of the embodiments of the present invention more clear, the embodiments of the present invention are further described in detail below in conjunction with the accompanying drawings. Here, the exemplary embodiments of the present invention and their descriptions are used to explain the present invention, but are not intended to limit the present invention.

[0030] The embodiment of the present invention overcomes the shortcoming of the opacity of large file processing time in the existing batch transfer business, provides a batch transfer file processing method and a step of dynamically displaying the estimated transaction processing time to corporate online banking users, supports pre-checking the accuracy of batch files in the file parsing stage, and can dynamically allocate resources to improve processing time efficiency according to real-time monitoring of production performance, helping users save time cost losses such as multiple submissions of batch files, repeated inquiries on processing progress, and slow processing of dynamic accounts, ensuring that the transaction closed loop can be completed within the estimated time efficiency, and effectively improving user experience and processing efficiency.

[0031] Figure 1 FIG. 1 is a flow chart of a method for processing batch transfer files in an embodiment of the present invention. Figure 1 As shown, the batch transfer file processing method includes:

[0032] Step 101, obtaining a batch transfer file;

[0033] Step 102, decomposing the batch transfer file into multiple transaction instructions, and extracting the instruction impact factor of each transaction instruction; the instruction impact factor is a transaction parameter that affects the instruction processing time;

[0034] Step 103, determining the instruction processing time when the system operation performance level of the batch transfer file processing system is an idle period according to the instruction impact factor; the idle period indicates that the server resource occupancy rate of the batch transfer file processing system is lower than a first occupancy rate threshold;

[0035] Step 104, generating a first predicted instruction processing time for the batch transfer file according to the instruction processing time when the system operation performance level is in an idle period and the system operation performance level at the time of obtaining the batch transfer file;

[0036] Step 105, generating a second predicted instruction processing duration according to the instruction processing duration when the system operation performance level is an idle period and the system operation performance level at the current moment;

[0037] Step 106, automatically identifying and calling corresponding backup server resources according to the first predicted instruction processing time and the second predicted instruction processing time.

[0038] Figure 2 FIG. 1 is a flowchart of a specific example of a method for processing batch transfer files in an embodiment of the present invention. Figure 2 As shown, the embodiment of the present invention mainly involves a 4-layer structure, including: a file transmission parsing layer, a processing time estimation layer, a production performance real-time monitoring layer and a system resource scheduling and allocation layer. The functions of each layer are as follows:

[0039] (1) File transfer parsing layer: transfers batch files from the user end to the large file parsing unit, completes file instruction information parsing and file error pre-checking, and converts and disassembles batch files into single transaction instructions.

[0040] (2) Time prediction and estimation layer: Obtain and disassemble the factors affecting the processing time of dynamic accounts in the instruction information, namely the instruction influencing factors, establish a deep learning model of correlation coefficients based on historical data training, traverse the instructions, calculate the batch processing time, and dynamically update it.

[0041] (3) Real-time performance monitoring layer: monitors the usage of service-related software and hardware resources and the progress of full instruction processing in real time during system operation, and analyzes the current system performance status.

[0042] (4) Resource scheduling and allocation layer: Based on the real-time monitoring results of system performance and the estimated waiting time of batch instructions, it is determined how to dynamically schedule the main resources and backup resources in the resource pool.

[0043] In the embodiment of the present invention, the steps of using the file transmission parsing layer, the processing time estimation layer, the production performance real-time monitoring layer and the system resource scheduling and allocation layer structure can be as follows:

[0044] Step 1: The corporate user uploads a large batch transfer file through the corporate online banking front-end page and submits a transaction instruction. The batch transfer file processing system receives the file and transmits it to the large file parsing processing unit;

[0045] Step 2, in order to improve the accuracy of batch files, the batch files are pre-checked in the file parsing stage. After obtaining the batch transfer file, it also includes: parsing the transaction instruction field in the batch transfer file; checking whether there is an error in the transaction instruction field; if there is, generating an error reason and prompting the user to resubmit; if not, executing to split the batch transfer file into multiple transaction instructions. The batch transfer file processing system pre-parses the fields such as currency, date, total amount, total number of transactions, etc. in the total information part at the top of the batch file, and checks and verifies common error types, including one or more of the following: incorrect file type, non-conformance of the format of each field, mismatch between the field input value and the dictionary item, mismatch between the total amount and the total number of transactions and the information entered on the user page, the number of transactions exceeds the threshold, the date information is inconsistent with the actual situation, and the required field information is missing; if the pre-check is wrong, the file check error will be returned in the pre-parsing stage, and the error reason will be fed back to the user and prompted to resubmit; if the pre-check is correct, the batch file main body detailed instruction information will be checked, and the batch transfer file will be split into multiple transaction instructions;

[0046] Step 3, the system parses the detailed instruction information fields, matches them with the back-end instruction detail table fields one by one, verifies the format and content requirements of each field, and checks the matching relationship between the payment information and the current enterprise account table information, sends the instruction information to the time prediction and estimation unit, and sorts the instructions to the accounting processing system for dynamic account processing;

[0047] Step 4, in order to improve the accuracy of the calculation of the processing time of a single batch of instructions in the idle state of the thread, the instruction impact factor that affects the processing speed is extracted for calculation. The system disassembles the instruction impact factor, which is the transaction parameter that affects the instruction processing time. The static duration of the batch instruction dynamic account processing time is calculated based on the batch instruction information. The instruction impact factor includes: the number of transactions, transaction amount, recipient category, recipient bank, error duration, one or any combination:

[0048] (1) Number of transactions N;

[0049] (2) Transaction amount A;

[0050] (3) Recipient category K: including public accounts / public cards / debit cards / credit cards / current passbooks, etc.;

[0051] (4) Recipient bank type B: including intra-bank and inter-bank;

[0052] (5) Error value E: Error time randomly generated by other factors such as file size and type.

[0053] Step 5, determining the instruction processing time when the system operation performance level of the batch transfer file processing system is an idle period based on the instruction impact factor, which may include: using a correlation coefficient deep learning model to determine the correlation coefficient between the instruction impact factor and the instruction processing time; the correlation coefficient deep learning model is generated by training the deep learning model based on historical batch transfer data; and determining the instruction processing time when the system operation performance level of the batch transfer file processing system is an idle period based on the instruction impact factor and the correlation coefficient between the instruction impact factor and the instruction processing time.

[0054] The formula for calculating the processing time of a single batch of instructions in the idle state of the thread can be obtained from the instruction impact factor:

[0055]

[0056] where ω k (k=1,2,3,4) is the correlation coefficient between each instruction influencing factor and the processing time, which is obtained by training the influence degree of each instruction influencing factor on the processing time in the existing historical transaction data using the deep learning model algorithm.

[0057] By using a deep learning model algorithm, the influence of each instruction influencing factor on the duration in historical transaction data is trained to obtain a correlation coefficient, which can improve the accuracy of instruction processing duration during the idle period of the computing system.

[0058] Step 6, before determining the instruction processing time when the system operation performance level of the batch transfer file processing system is an idle period, the following may also be included:

[0059] Monitor the operating performance of the batch transfer file processing system in real time, and determine the system operating performance level at the time of obtaining the batch transfer file and at the current time; the system operating performance level represents the resource occupancy and file processing efficiency of the batch transfer file processing system. The system monitors and determines the current operating performance level in real time.

[0060] In this embodiment, real-time monitoring of the operating performance of the batch transfer file processing system and determination of the system operating performance level at the time of obtaining the batch transfer file and at the current time include:

[0061] Real-time monitoring of the server resource usage rate and number of instructions in the thread queue to be processed of the batch transfer file processing system;

[0062] Determine the system performance level at the time of obtaining the batch transfer file based on the server resource occupancy rate of the system, the number of instructions to be processed in the thread queue, and the time of obtaining the batch transfer file;

[0063] The system performance level at the current moment is determined based on the system's server resource occupancy rate, the number of thread queued instructions to be processed, and the current moment.

[0064] In this embodiment, the system operation performance level at the current moment is determined according to the server resource occupancy rate of the system, the number of instructions queued for processing by threads, and the current moment, including:

[0065] If at the current moment, the server resource occupancy rate of the batch transfer file processing system is lower than the first occupancy rate threshold, and the number of thread queued instructions to be processed is 0, it is determined that the system operation performance level at the current moment is in the idle period;

[0066] If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the first occupancy rate threshold and the second occupancy rate threshold, and the number of instructions to be processed in the thread queue is lower than the first queue threshold, it is determined that the system operation performance level at the current moment is in the off-peak period;

[0067] If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the second occupancy rate threshold and the third occupancy rate threshold, and the number of instructions to be processed in the thread queue is between the first queue threshold and the second queue threshold, it is determined that the system operation performance level at the current moment is in the equilibrium period;

[0068] If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the third occupancy rate threshold and the fourth occupancy rate threshold, and the number of instructions to be processed in the thread queue is between the second queue threshold and the third queue threshold, it is determined that the system operation performance level at the current moment is at the peak period;

[0069] If at the current moment, the server resource occupancy rate of the batch transfer file processing system exceeds the fourth threshold, and the number of thread queued instructions to be processed is higher than the third queue threshold, it is determined that the system operation performance level at the current moment is in a congestion period.

[0070] For example, the grading rules and related determination factors may include:

[0071] (1) Idle period: The server resource utilization rate is less than 20%, and the number of concurrent threads can support the current pending instructions to be processed, without queuing; and the average queuing time t1 during this period is monitored;

[0072] (2) Off-peak period: The server resource utilization rate is between 20% and 40%, the number of threads waiting to be processed is small, and the processing speed of dynamic accounts is fast; and the average queuing time t2 during this period is monitored;

[0073] (3) Balanced period: The server resource utilization rate is between 40% and 60%, the number of threads waiting to be processed is moderate, and the dynamic account processing speed is medium; and the average queue time t3 during this period is monitored;

[0074] (4) Peak period: The server resource utilization rate is between 60% and 80%, there are many threads waiting to be processed, and the processing speed of dynamic accounts is slow; and the average queue time t4 during this period is monitored;

[0075] (5) Congestion period: The server resource utilization rate exceeds 80%, the thread queue for processing instructions is close to the maximum load, and the dynamic account processing speed is slow. The average queue time t5 during this period is monitored and obtained.

[0076] By monitoring the usage of service-related software and hardware resources and the progress of full instruction processing during system operation in real time, the current system performance status can be analyzed so that resources can be dynamically allocated to improve processing efficiency based on real-time monitoring of production performance.

[0077] Step 7, determine the average queuing time corresponding to each system performance level, and generate a first predicted instruction processing time for the batch transfer file based on the instruction processing time when the system performance level is in the idle period and the average queuing time corresponding to the system performance level at the time of obtaining the batch transfer file.

[0078] The system determines the operating performance level at the time of obtaining batch transfer files, and uses the average queuing time t of each level n , and then the processing time of the first predicted instruction of this batch is obtained:

[0079] T=T1+t n

[0080] The system pushes the estimated waiting time T to the client and refreshes the remaining waiting time in real time as time goes by.

[0081] Since payroll service is a mature business product of banks, the system performance and business volume are stable. The instruction processing time of batch transfer files is predicted based on the average queuing time corresponding to the system performance level, making the calculation scientific.

[0082] Step 8: The system measures the current batch file queue processing speed in real time every 3 minutes to calculate the second predicted instruction processing time T' of the current batch instruction;

[0083] Step 9, automatically identifying and calling corresponding backup server resources according to the first predicted instruction processing time and the second predicted instruction processing time, including: determining the difference between the first predicted instruction processing time and the second predicted instruction processing time; automatically identifying and calling corresponding backup server resources according to the difference.

[0084] The system calculates the difference α between the estimated total processing time T and the current actual processing time T':

[0085] α=T′-T

[0086] Step 10, automatically identifying and calling corresponding backup server resources according to the difference, including: if the difference is a negative number, not calling the backup server resources; if the difference is greater than zero and less than the first difference threshold, calling the backup server resources in the resource pool corresponding to the difference; if the difference is between the first difference threshold and the second difference threshold, calling the backup server resources in the resource pool corresponding to the difference, and expanding the number of concurrent threads corresponding to the difference.

[0087] The corresponding backup resource scheduling plan is automatically triggered and executed according to the α value to ensure that all account movement instructions in the batch can be processed within the customer's expected waiting time. The scheduling resource ratio, concurrency number and other parameters in each level of the plan can be automatically configured:

[0088] (1) If α≤0, the actual processing time is within the estimated total time, and no resources need to be scheduled;

[0089] (2) If the α value is small, a small amount of backup server resources in the resource pool are dispatched;

[0090] (3) If the α value is moderate, it means that the system performance congestion level has changed to a certain extent. The medium-sized backup server resources in the resource pool are scheduled and the corresponding number of concurrent servers is increased;

[0091] (4) If the α value is large, it means that the system performance congestion level has a large jump, and most of the backup server resources in the resource pool are called, and the corresponding concurrency number is increased;

[0092] The corresponding backup resource scheduling plan is automatically triggered and executed based on the predicted difference, ensuring that all account movement instructions in the batch can be processed within the customer's expected waiting time.

[0093] Step 11, if the congestion period lasts for a long time and the processing time of some batch instructions has exceeded the estimated waiting time, the corresponding batch instructions are screened out according to the timeout duration, and these batch instructions are processed first after the scheduled backup server resources are turned on.

[0094] The following are specific embodiments of the method of the present invention:

[0095] Step 1, real-time performance detection layer, through monitoring and analysis of historical data, under the given five system performance, statistics are made on the queue time (t1-t5) between batches corresponding to each gear (idle, low-peak, balanced, peak, and congested). Since payroll agency is a mature business product of the bank, the system performance and business volume are stable, and t1-t5 are close to five fixed values;

[0096] Step 2, the customer logs in to the corporate online banking and submits the payroll package, batch number is HEZ001;

[0097] Step 3, the file transfer parsing layer parses the file and captures the relevant values ​​(number of transactions, amount, recipient, bank type, etc.) required to calculate the time for payroll payment, and calculates the theoretical batch transfer file processing time T1 under idle conditions;

[0098] Step 4, the time prediction and estimation layer registers the performance level of the system when the batch HEZ001 is submitted. In the embodiment, the system is currently in the equilibrium period, and the overall processing time of the batch displayed to the customer is T1+t3;

[0099] Step 5: As time goes by, the transaction volume processed in the system increases. At this time, the system performance reaches its peak. At this time, the processing queue time of HEZ001 shifts to t4.

[0100] Step 6, at this time, the real-time performance detection module detects that the system's queuing time for processing wage payment has risen to t4, exceeding the original t3 value, and the difference is α;

[0101] Step 7, in the resource scheduling and allocation module, the corresponding backup performance resources are automatically identified and started according to the α value to improve the system processing speed for the customer. At this time, the resource scheduling module enables the backup server and splits the HEZ001 instructions to be processed. Some of the instructions are marked and sent to the routing server, which sends the instructions to be processed to the backup server to improve the processing speed.

[0102] In one embodiment, the batch transfer file processing method further includes:

[0103] Real-time display of the first predicted instruction processing time. Real-time display of the first predicted instruction processing time solves the problem that the predicted waiting time for batch transfer file processing is invisible to users and difficult to estimate.

[0104] The present invention also provides a batch transfer file processing device, as described in the following embodiments. Since the principle of the device to solve the problem is similar to that of the batch transfer file processing method, the implementation of the device can refer to the implementation of the batch transfer file processing method, and the repeated parts will not be repeated.

[0105] Figure 3 Schematic diagram of a batch transfer file processing device according to an embodiment of the present invention, comprising:

[0106] An acquisition module 301 is used to acquire a batch transfer file;

[0107] The disassembly module 302 is used to disassemble the batch transfer file into multiple transaction instructions and extract the instruction impact factor of each transaction instruction; the instruction impact factor is a transaction parameter that affects the instruction processing time;

[0108] The determination module 303 is used to determine the instruction processing time when the system operation performance level of the batch transfer file processing system is an idle period according to the instruction impact factor; the idle period indicates that the server resource occupancy rate of the batch transfer file processing system is lower than the first occupancy rate threshold;

[0109] A first prediction module 304, configured to generate a first predicted instruction processing time for a batch transfer file according to the instruction processing time when the system operation performance level is an idle period and the system operation performance level at the time of obtaining the batch transfer file;

[0110] The second prediction module 305 is used to generate a second predicted instruction processing duration according to the instruction processing duration when the system operation performance level is an idle period and the system operation performance level at the current moment;

[0111] The calling module 306 is used to automatically identify and call corresponding standby server resources according to the first predicted instruction processing time and the second predicted instruction processing time.

[0112] Figure 4 FIG. 1 is a schematic diagram of a specific example of a batch transfer file processing device according to an embodiment of the present invention. Figure 4 As shown, in one embodiment, the batch transfer file processing device further includes:

[0113] The checking module 401 is used to parse the transaction instruction field in the batch transfer file and check whether there is any error in the transaction instruction field.

[0114] In one embodiment, the checking module 401 is specifically used for:

[0115] Check whether the file type is correct, whether the format of each field complies with the specification, whether the field input value matches the dictionary item, whether the total amount information and total number of transactions match the input information, whether the number of transactions exceeds the threshold, whether the date information is the same as the actual date information, and whether the required field information is missing;

[0116] If it exists, generate the error reason and prompt the user to resubmit;

[0117] If it does not exist, the batch transfer file will be split into multiple transaction instructions.

[0118] In one embodiment, the instruction influencing factors include: the number of transactions, the transaction amount, the payee category, the payee bank type, and the error duration, or any combination thereof.

[0119] In one embodiment, the determination module 303 is specifically used to determine the correlation coefficient between the instruction impact factor and the instruction processing time using a correlation coefficient deep learning model; the correlation coefficient deep learning model is generated by training a deep learning model based on historical batch transfer data; based on the instruction impact factor and the correlation coefficient between the instruction impact factor and the instruction processing time, the instruction processing time when the system operating performance level of the batch transfer file processing system is the idle period is determined.

[0120] The batch transfer file processing device also includes: a real-time monitoring module, which is used to monitor the operating performance of the batch transfer file processing system in real time, and determine the system operating performance level at the time of obtaining the batch transfer file and the current time; the system operating performance level represents the resource occupancy degree and file processing efficiency of the batch transfer file processing system.

[0121] In one embodiment, the real-time monitoring module is specifically used to:

[0122] Real-time monitoring of the server resource usage rate and number of instructions in the thread queue to be processed of the batch transfer file processing system;

[0123] Determine the system performance level at the time of obtaining the batch transfer file based on the server resource occupancy rate of the system, the number of instructions to be processed in the thread queue, and the time of obtaining the batch transfer file;

[0124] The system performance level at the current moment is determined based on the system's server resource occupancy rate, the number of thread queued instructions to be processed, and the current moment.

[0125] In this embodiment, the real-time monitoring module is specifically used for:

[0126] If at the current moment, the server resource occupancy rate of the batch transfer file processing system is lower than the first occupancy rate threshold, and the number of thread queued instructions to be processed is 0, it is determined that the system operation performance level at the current moment is in the idle period;

[0127] If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the first occupancy rate threshold and the second occupancy rate threshold, and the number of instructions to be processed in the thread queue is lower than the first queue threshold, it is determined that the system operation performance level at the current moment is in the off-peak period;

[0128] If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the second occupancy rate threshold and the third occupancy rate threshold, and the number of instructions to be processed in the thread queue is between the first queue threshold and the second queue threshold, it is determined that the system operation performance level at the current moment is in the equilibrium period;

[0129] If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the third occupancy rate threshold and the fourth occupancy rate threshold, and the number of instructions to be processed in the thread queue is between the second queue threshold and the third queue threshold, it is determined that the system operation performance level at the current moment is at the peak period;

[0130] If at the current moment, the server resource occupancy rate of the batch transfer file processing system exceeds the fourth threshold, and the number of thread queued instructions to be processed is higher than the third queue threshold, it is determined that the system operation performance level at the current moment is in a congestion period.

[0131] In one embodiment, the first prediction module 304 is specifically used for:

[0132] Determine the average queue time corresponding to each system operation performance level;

[0133] A first predicted instruction processing time for the batch transfer file is generated according to the instruction processing time when the system operation performance level is an idle period and the average queuing time corresponding to the system operation performance level at the time of obtaining the batch transfer file.

[0134] In one embodiment, the calling module 306 is specifically used to:

[0135] Determine a difference between the first predicted instruction processing time and the second predicted instruction processing time;

[0136] Automatically identify and call corresponding backup server resources based on the difference.

[0137] In this embodiment, the calling module 306 is specifically used for:

[0138] When the difference is negative, the backup server resources are not called;

[0139] When the difference is greater than zero and less than a first difference threshold, calling a number of standby server resources corresponding to the difference in the resource pool;

[0140] When the difference is between the first difference threshold and the second difference threshold, a number of standby server resources corresponding to the difference are called from the resource pool to increase the number of concurrent threads corresponding to the difference.

[0141] like Figure 4 As shown, in one embodiment, the batch transfer file processing device further includes:

[0142] The display module 402 is used to display the first predicted instruction processing time, and update the display of the first predicted instruction processing time in real time according to the second predicted instruction processing time.

[0143] In summary, compared with the technical solution of using batch tools to process batch files and display static results in the prior art, the embodiment of the present invention obtains a batch transfer file; decomposes the batch transfer file into multiple transaction instructions, and extracts the instruction impact factor of each transaction instruction; the instruction impact factor is a transaction parameter that affects the instruction processing time; according to the instruction impact factor, the instruction processing time when the system operation performance level of the batch transfer file processing system is an idle period is determined; the idle period indicates that the server resource occupancy rate of the batch transfer file processing system is lower than the first occupancy rate threshold, and the number of instructions to be processed in the thread queue is 0; according to the system operation performance, etc. The first predicted instruction processing time of the batch transfer file is generated according to the instruction processing time when the system performance level is an idle period and the system performance level at the time of obtaining the batch transfer file; the second predicted instruction processing time is generated according to the instruction processing time when the system performance level is an idle period and the system performance level at the current moment; according to the first predicted instruction processing time and the second predicted instruction processing time, the corresponding backup server resources are automatically identified and called, which can solve the problem that the predicted waiting time for batch transfer file processing is invisible to users and difficult to estimate, avoid users from repeatedly modifying and submitting instructions, save operation time and labor costs, and improve the efficiency of batch transfer file processing.

[0144] On the one hand, the embodiment of the present invention provides a processing time estimation model based on batch instruction information and queuing process, which solves the pain point problem that the estimated waiting time for current large-scale batch transfers is invisible to customers and difficult to estimate, and avoids customers from repeatedly modifying and submitting instructions by introducing a large file pre-check mechanism, saving operation time and labor costs; on the other hand, it provides a method for automatically triggering resource scheduling based on real-time monitoring of system performance, which solves the pain point problem of large fluctuations and long processing time of large batch files, can effectively improve the efficiency of instruction queuing processing during peak congestion periods, save customer waiting time, and significantly optimize the user experience of large-scale batch transfer services.

[0145] An embodiment of the present invention further provides a computer device, Figure 5 Schematic diagram of a computer device in an embodiment of the present invention. The computer device 500 includes a memory 510, a processor 520, and a computer program 530 stored in the memory 510 and executable on the processor 520. When the processor 520 executes the computer program 530, the above-mentioned batch transfer file processing method is implemented.

[0146] An embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned batch transfer file processing method is implemented.

[0147] An embodiment of the present invention further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the above-mentioned batch transfer file processing method is implemented.

[0148] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0149] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0150] These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0151] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0152] The specific embodiments described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for processing batch transfer files, characterized in that: include: Get batch transfer files; Decompose the batch transfer file into multiple transaction instructions and extract the instruction impact factor of each transaction instruction; The instruction impact factor is a transaction parameter that affects the instruction processing time; Determine, according to the instruction impact factor, the instruction processing duration when the system operation performance level of the batch transfer file processing system is an idle period; the idle period indicates that the server resource occupancy rate of the batch transfer file processing system is lower than a first occupancy rate threshold; Generate a first predicted instruction processing time of the batch transfer file according to the instruction processing time when the system operation performance level is an idle period and the system operation performance level at the time of obtaining the batch transfer file; Generate a second predicted instruction processing duration according to the instruction processing duration when the system operation performance level is an idle period and the system operation performance level at the current moment; According to the first predicted instruction processing time and the second predicted instruction processing time, the corresponding backup server resources are automatically identified and called.

2. The method according to claim 1, characterized in that After obtaining the batch transfer file, it also includes: Parse the transaction instruction field in the batch transfer file; Check the transaction instruction field for errors; If it exists, generate the error reason and prompt the user to resubmit; If it does not exist, the batch transfer file will be split into multiple transaction instructions.

3. The method according to claim 2, characterized in that Check the transaction instruction fields for errors, including one or more of the following: Check whether the file type is correct, whether the format of each field complies with the specifications, whether the field input value matches the dictionary item, whether the total amount information and total number of transactions match the entered information, whether the number of transactions exceeds the threshold, whether the date information is the same as the actual date information, and whether the required field information is missing.

4. The method according to claim 1, characterized in that The instruction influencing factors include: the number of transactions, the transaction amount, the type of the payee, the type of the payee bank, and the error duration, or any combination thereof.

5. The method according to claim 1, characterized in that According to the instruction impact factor, the instruction processing time when the system operation performance level of the batch transfer file processing system is in the idle period is determined, including: Determine the correlation coefficient between the instruction influencing factor and the instruction processing time using a correlation coefficient deep learning model; the correlation coefficient deep learning model is generated by training the deep learning model based on historical batch transfer data; According to the instruction impact factor and the correlation coefficient between the instruction impact factor and the instruction processing time, the instruction processing time when the system operation performance level of the batch transfer file processing system is an idle period is determined.

6. The method according to claim 1, characterized in that Before determining the instruction processing time length when the system operation performance level of the batch transfer file processing system is an idle period, it also includes: Monitor the operating performance of the batch transfer file processing system in real time to determine the system operating performance level at the time of obtaining the batch transfer file and at the current time; the system operating performance level represents the resource usage and file processing efficiency of the batch transfer file processing system.

7. The method according to claim 6, characterized in that Monitor the operating performance of the batch transfer file processing system in real time, and determine the system operating performance level at the time of obtaining the batch transfer file and at the current time, including: Real-time monitoring of the server resource usage rate and number of instructions in the thread queue to be processed of the batch transfer file processing system; Determine the system performance level at the time of obtaining the batch transfer file based on the server resource occupancy rate of the system, the number of instructions to be processed in the thread queue, and the time of obtaining the batch transfer file; The system performance level at the current moment is determined based on the system's server resource occupancy rate, the number of thread queued instructions to be processed, and the current moment.

8. The method according to claim 7, characterized in that The system performance level at the current moment is determined based on the system's server resource usage, the number of instructions in the thread queue to be processed, and the current moment, including: If at the current moment, the server resource occupancy rate of the batch transfer file processing system is lower than the first occupancy rate threshold, and the number of thread queued instructions to be processed is 0, it is determined that the system operation performance level at the current moment is in the idle period; If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the first occupancy rate threshold and the second occupancy rate threshold, and the number of instructions to be processed in the thread queue is lower than the first queue threshold, it is determined that the system operation performance level at the current moment is in the off-peak period; If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the second occupancy rate threshold and the third occupancy rate threshold, and the number of instructions to be processed in the thread queue is between the first queue threshold and the second queue threshold, it is determined that the system operation performance level at the current moment is in the equilibrium period; If at the current moment, the server resource occupancy rate of the batch transfer file processing system is between the third occupancy rate threshold and the fourth occupancy rate threshold, and the number of instructions to be processed in the thread queue is between the second queue threshold and the third queue threshold, it is determined that the system operation performance level at the current moment is at the peak period; If at the current moment, the server resource occupancy rate of the batch transfer file processing system exceeds the fourth threshold, and the number of thread queued instructions to be processed is higher than the third queue threshold, it is determined that the system operation performance level at the current moment is in a congestion period.

9. The method according to claim 1, characterized in that Generating a first predicted instruction processing time of the batch transfer file according to the instruction processing time when the system operation performance level is an idle period and the system operation performance level at the time of obtaining the batch transfer file includes: Determine the average queue time corresponding to each system operation performance level; A first predicted instruction processing time for the batch transfer file is generated according to the instruction processing time when the system operation performance level is an idle period and the average queuing time corresponding to the system operation performance level at the time of obtaining the batch transfer file.

10. The method according to claim 1, characterized in that According to the first predicted instruction processing time and the second predicted instruction processing time, the corresponding standby server resources are automatically identified and called, including: Determine a difference between the first predicted instruction processing time and the second predicted instruction processing time; Automatically identify and call corresponding backup server resources based on the difference.

11. The method according to claim 10, characterized in that Automatically identify and call corresponding backup server resources based on the difference, including: If the difference is negative, the backup server resources are not called; If the difference is greater than zero and less than the first difference threshold, call the number of standby server resources corresponding to the difference in the resource pool; If the difference is between the first difference threshold and the second difference threshold, a number of standby server resources corresponding to the difference is called from the resource pool to increase the number of concurrent threads corresponding to the difference.

12. The method according to claim 1, characterized in that Also includes: Display the first predicted instruction processing time in real time.

13. A batch transfer file processing device, characterized in that: include: Acquisition module, used to obtain batch transfer files; The disassembly module is used to disassemble the batch transfer file into multiple transaction instructions and extract the instruction impact factor of each transaction instruction; The instruction impact factor is a transaction parameter that affects the instruction processing time; A determination module, configured to determine, based on the instruction impact factor, an instruction processing duration when the system operation performance level of the batch transfer file processing system is an idle period; the idle period indicates that the server resource occupancy rate of the batch transfer file processing system is lower than a first occupancy rate threshold; A first prediction module, used to generate a first predicted instruction processing time of the batch transfer file according to the instruction processing time when the system operation performance level is an idle period and the system operation performance level at the time of obtaining the batch transfer file; A second prediction module, used for generating a second predicted instruction processing duration according to the instruction processing duration when the system operation performance level is an idle period and the system operation performance level at a current moment; The calling module is used to automatically identify and call corresponding backup server resources according to the first predicted instruction processing time and the second predicted instruction processing time.

14. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 12 is implemented.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

Images