File processing control method, device, equipment, storage medium and program product
By acquiring the file processing plan and automatically retrying the index file, the problem of processing anomalies caused by incomplete data files of financial institutions was solved, and an automated file processing workflow was achieved.
Patent Information
- Application Number
- CN202310478752.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-28
- Publication Date
- 2026-01-13
- Estimated Expiration
- 2043-04-28
AI Technical Summary
When financial institutions process data files, their business systems may be unable to process them normally or in a timely manner due to incomplete data, thus requiring manual intervention.
A file processing method is provided, which obtains the file processing plan, first retrieves the target index file and data file from the upstream system, and processes the index file if it is successfully retrieved; if it is not successfully retrieved, it automatically retryes to retrieve the index file, thus avoiding manual intervention.
It enables automatic retries and processing when data files are incomplete, ensuring that business systems can recover automatically, reducing manual intervention, and improving the system's automation capabilities.
Smart Images

Figure CN116541344B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data processing technology, and in particular to a control method, apparatus, device, storage medium, and program product for document processing. Background Technology
[0002] With the popularization and development of the internet and online applications, commercial banks and other financial institutions are moving more and more of their business online. At the same time, these financial institutions also have data files from multiple channels, resulting in a large volume of data files that need to be processed.
[0003] Currently, many financial institutions' business systems typically use real-time processing to process received data files. However, in practice, there may be issues such as incomplete data files corresponding to a particular business transaction, which can prevent the transaction from being processed normally or in real-time, thus requiring manual intervention to recover. Summary of the Invention
[0004] Therefore, it is necessary to provide a control method, apparatus, device, storage medium, and program product that can achieve automatic operation of file processing in response to the above-mentioned technical problems.
[0005] Firstly, this application provides control over document processing. The method includes:
[0006] Obtain the file processing plan;
[0007] According to the file processing plan, obtain the corresponding target index file from the upstream system;
[0008] The target data file to be processed is determined from the upstream system according to the file processing plan;
[0009] When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed.
[0010] If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan.
[0011] In one embodiment, processing the target data file includes:
[0012] The target data file is parsed to obtain the parsing results, and the downstream system corresponding to the target data file is determined.
[0013] The parsing results are used to generate a file to be processed corresponding to the downstream system, and the file to be processed is sent to the downstream system.
[0014] In one embodiment, parsing the target data file to obtain the parsing result includes:
[0015] Determine the type of the target data file;
[0016] The corresponding parsing program is invoked according to the type to parse the target data file and obtain the parsing result.
[0017] In one embodiment, the step of calling the corresponding parsing program to parse the target data file according to the type and obtaining the parsing result includes:
[0018] When multiple target data files of the same type exist, the instance corresponding to each target data file is controlled to preempt the parsing program.
[0019] The control state of the parsing program is changed to the parsing identifier, and the corresponding parsing program is called to parse the target data file to be parsed for which the control state has been changed to the parsing identifier, so as to obtain the parsing result.
[0020] In one embodiment, before generating the file to be processed corresponding to the downstream system from the parsing result, the method further includes:
[0021] Perform anomaly checks on the parsing results;
[0022] If abnormal data is found in the analysis results, the location of the abnormal data is determined and the corresponding prompt information is displayed.
[0023] In one embodiment, obtaining the corresponding target index file from the upstream system according to the file processing plan includes:
[0024] The index file to be acquired is determined from the upstream system according to the file processing plan;
[0025] Determine the business scope of the upstream system, and verify the index file to be obtained based on the business scope;
[0026] After successful verification, the index file to be obtained is used as the target index file.
[0027] Secondly, this application also provides a control device for document processing. The device includes:
[0028] The first acquisition module is used to acquire the file processing plan;
[0029] The second acquisition module is used to acquire the corresponding target index file from the upstream system according to the file processing plan;
[0030] The determination module is used to determine the target data file to be processed from the upstream system according to the file processing plan;
[0031] The processing module is used to obtain the target data file from the upstream system and process the target data file when the index file corresponding to the target data file is successfully obtained.
[0032] The processing module is further configured to, when the index file corresponding to the target data file is not successfully obtained, execute the following step through the second acquisition module: obtain the corresponding index file from the upstream system according to the file processing plan.
[0033] Thirdly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to perform the following steps:
[0034] Obtain the file processing plan;
[0035] According to the file processing plan, obtain the corresponding target index file from the upstream system;
[0036] The target data file to be processed is determined from the upstream system according to the file processing plan;
[0037] When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed.
[0038] If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan.
[0039] Fourthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, performs the following steps:
[0040] Obtain the file processing plan;
[0041] According to the file processing plan, obtain the corresponding target index file from the upstream system;
[0042] The target data file to be processed is determined from the upstream system according to the file processing plan;
[0043] When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed.
[0044] If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan.
[0045] Fifthly, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, performs the following steps:
[0046] Obtain the file processing plan;
[0047] According to the file processing plan, obtain the corresponding target index file from the upstream system;
[0048] The target data file to be processed is determined from the upstream system according to the file processing plan;
[0049] When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed.
[0050] If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan.
[0051] The aforementioned file processing control method, apparatus, device, storage medium, and program product automatically execute the following steps: First, it obtains a file processing plan; second, it retrieves a corresponding target index file from an upstream system based on the file processing plan; third, it determines a target data file to be processed from the upstream system based on the file processing plan; fourth, if the index file corresponding to the target data file is successfully retrieved, it retrieves the target data file from the upstream system and processes the target data file; fifth, if the index file corresponding to the target data file is not successfully retrieved, it returns to the step of retrieving the corresponding index file from the upstream system according to the file processing plan. Through this method, the present application first obtains the target index file and determines the target data file according to the file processing plan; if the index file corresponding to the target data file is successfully retrieved, it retrieves the target data file from the upstream system and processes the target data file; if the index file corresponding to the target data file is not successfully retrieved, it returns to the step of retrieving the corresponding index file from the upstream system according to the file processing plan. This allows for automatic execution without manual intervention when normal processing or immediate processing is not possible. Attached Figure Description
[0052] Figure 1 This is an application environment diagram of a file processing control method in one embodiment;
[0053] Figure 2This is a flowchart illustrating a control method for file processing in one embodiment;
[0054] Figure 3 This is a detailed flowchart illustrating the steps involved in processing the target data file in one embodiment.
[0055] Figure 4 This is a flowchart illustrating the control method for file processing in another embodiment;
[0056] Figure 5 This is a structural block diagram of a file processing control device in one embodiment;
[0057] Figure 6 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation
[0058] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0059] The file processing control method provided in this application embodiment can be applied to, for example... Figure 1 The application environment shown is as follows. The upstream system 100, server 200, and downstream system 300 are defined as follows: upstream system 100 is the system that triggers financial transactions, and downstream system 300 is the system that processes these transactions. In practice, two financial institutions can act as each other's upstream and downstream systems. For example, upstream system 100 can be a financial institution that triggers financial transactions, which may include, but are not limited to, registering a financial account or purchasing investment products. After triggering a financial transaction, the financial institution sends the corresponding data file to server 200. Server 200 processes the data file sent by upstream system 100 and then sends it to downstream system 300. Downstream system 300 processes the received data, for example, registering an account based on the account registration data file or purchasing an investment product. Upstream system 100, server 200, and downstream system 300 can be, but are not limited to, various personal computers, laptops, smartphones, tablets, and servers. The upstream system 100, server 200, and downstream system 300 can be implemented using independent personal computers, laptops, smartphones, tablets, and servers, or a cluster of multiple personal computers (laptops, smartphones, tablets, or servers). Server 200 can interface with multiple upstream systems 100 and multiple downstream systems 300, meaning server 200 can communicate with multiple upstream systems 100 and downstream systems 300 respectively.
[0060] In one embodiment, such as Figure 2 As shown, a file processing control method is provided, including the following steps:
[0061] Step 210: Obtain the file processing plan.
[0062] This embodiment applies the method to... Figure 1 Taking the server as an example, the file processing plan is manually configured based on each business function. Each upstream system can trigger multiple types of business processes. Each business type has a corresponding file processing plan, which includes identifiers for index files and data files. The index file must at least include the identifier of the data file and its location. It should be noted that an upstream system can have multiple business processes, thus multiple file processing plans are stored on the server.
[0063] Step 220: Obtain the corresponding target index file from the upstream system according to the file processing plan.
[0064] During business processing, users can trigger specific business operations through the upstream system, such as registering an account. After triggering the business operation, the upstream system in this application will generate corresponding business data in the form of files. Specifically, the upstream system will generate corresponding index files and data files. The generation of index files and data files during the business operation facilitates the verification of data files based on the index files, thereby determining whether the files generated by the business operation are complete and simplifying management.
[0065] After obtaining the file processing plan, the server periodically polls the upstream system to obtain the corresponding target index file from the upstream system according to the file processing plan.
[0066] Step 230: Determine the target data file to be processed from the upstream system according to the file processing plan.
[0067] The server periodically polls the upstream system to determine the target data file to be processed based on the file processing plan.
[0068] It should be noted that the steps of determining the target data file to be processed and obtaining the target index file are not sequential.
[0069] Step 240: When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed.
[0070] Specifically, after determining the target data file, if the target index file corresponding to the target data file is successfully obtained, the target data file is retrieved from the upstream system. Then, the target data file is processed, including forwarding it to the downstream system so that the downstream system can perform corresponding business processing based on the target data file.
[0071] Furthermore, in some embodiments, in order to ensure that the corresponding business can be processed normally, since the target index file corresponds to the business, it is also possible to determine whether the target data file is complete based on the target index file. Only after the target data file is complete can the corresponding business be implemented.
[0072] If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan.
[0073] Specifically, after determining the target data file, if the target index file corresponding to the target data file is not successfully obtained, it means that the service cannot be executed. In this case, return to step 220 and re-execute the above steps. In this way, when encountering problems such as incomplete data files corresponding to a certain service, which cause the service to be unable to be processed normally or in a timely manner, the corresponding target index file and target data file can be automatically obtained again until the service is executed.
[0074] The aforementioned file processing control method, apparatus, device, storage medium, and program product automatically execute the following steps: First, it obtains a file processing plan; second, it retrieves a corresponding target index file from an upstream system based on the file processing plan; third, it determines a target data file to be processed from the upstream system based on the file processing plan; fourth, if the index file corresponding to the target data file is successfully retrieved, it retrieves the target data file from the upstream system and processes the target data file; fifth, if the index file corresponding to the target data file is not successfully retrieved, it returns to the step of retrieving the corresponding index file from the upstream system according to the file processing plan. Through this method, the present application first obtains the target index file and determines the target data file according to the file processing plan; if the index file corresponding to the target data file is successfully retrieved, it retrieves the target data file from the upstream system and processes the target data file; if the index file corresponding to the target data file is not successfully retrieved, it returns to the step of retrieving the corresponding index file from the upstream system according to the file processing plan. This allows for automatic execution without manual intervention when normal processing or immediate processing is not possible.
[0075] In one embodiment, the document processing plan may further include a task execution time, which specifies that the above steps are performed according to the document plan within a fixed time period.
[0076] In one embodiment, such as Figure 3 As shown, processing the target data file includes:
[0077] Step 241: Parse the target data file, obtain the parsing result, and determine the downstream system corresponding to the target data file;
[0078] Step 242: Generate a file to be processed corresponding to the downstream system from the parsing results, and send the file to be processed to the downstream system.
[0079] Specifically, the server parses the obtained target data file to obtain the parsing results, which at least include key information for business processing. The downstream system corresponding to the target data file is determined. Specifically, the target data file is obtained based on a file processing plan, which is manually set according to business needs. These business processes are executed by different upstream and downstream systems; therefore, the downstream system corresponding to the target data file can be determined based on the target data file. Then, a file to be processed corresponding to the downstream system is generated based on the parsing results. Finally, the file to be processed is sent to the downstream system. Upon receiving the file to be processed, the downstream system can then perform business processing based on it.
[0080] In one embodiment, parsing the target data file to obtain the parsing result includes:
[0081] Determine the type of the target data file;
[0082] The corresponding parsing program is invoked according to the type to parse the target data file and obtain the parsing result.
[0083] Specifically, different systems executing different business processes generate target data files of varying types; that is, there are multiple types of target data files. Therefore, during the parsing process, the type of the target data file is first determined, and then the corresponding parsing program is called to parse the target data file according to its type to obtain the parsing result.
[0084] This application defines dependencies such as different file types, different file processing methods, and different file-owning organizations to ensure that subsequent file processing is paused if the preceding file processing is not completed, preventing the push of incorrect files and facilitating the monitoring of file processing.
[0085] In one embodiment, the step of calling the corresponding parsing program to parse the target data file according to the type and obtaining the parsing result includes:
[0086] When multiple target data files of the same type exist, the instance corresponding to each target data file is controlled to preempt the parsing program.
[0087] The control state of the parsing program is changed to the parsing identifier, and the corresponding parsing program is called to parse the target data file to be parsed for which the control state has been changed to the parsing identifier, so as to obtain the parsing result.
[0088] Specifically, in practical applications, multiple target data files of the same type may exist, but there is only one parsing program. To avoid errors caused by parallel processing during parsing, this embodiment instantiates each target data file to be parsed. Each instantiated target data file then preempts the parsing program. The control state of the instance that successfully preempts the parsing program changes to a parsing flag. Finally, the corresponding parsing program is called on the target data file whose control state has changed to the parsing flag to obtain the parsing result. After parsing is completed, the control state of that instance changes to parsing complete, and other instances continue to preempt the parsing program, and so on.
[0089] Furthermore, during the parsing process, the target data file can be pre-verified, and parsing can only proceed after the pre-verification passes.
[0090] An example, a 01 file parser:
[0091] Pre-validation method: Determine if the current date is a working day; do not execute if it is a non-working day.
[0092] Parsing method: Obtain the file to be parsed (01 file) based on the file name and file path, and convert the file into a binary stream using GBK encoding; starting from the specified line of the file, convert each line into an entity class and store it in the 01 business table; query the platform's financial transaction account based on the legal person number and investment and financial transaction account, and add a corresponding platform financial transaction account if no such account exists.
[0093] 03 File parser:
[0094] Pre-verification method: Determine whether the 01 file of the cooperating bank for the current working day has been successfully entered into the database;
[0095] Parsing method: Obtain the 03 file to be parsed based on the file name and file path, convert the file into a binary stream using GBK encoding; starting from the specified line of the file, convert each line into an entity class and generate a platform application number, which is then stored in the 03 business table.
[0096] 05 File parser:
[0097] Pre-verification method: 02 File insertion
[0098] Parsing method: Obtain the file to be parsed (05) based on the file name and file path, and convert the file into a binary stream using GBK encoding; starting from the specified line of the file, convert each line into an entity class and store it in the 05 business table.
[0099] 06 File parser:
[0100] Pre-verification method: 06 File insertion into the database
[0101] Parsing method: Obtain the 06 file to be parsed based on the file name and file path, convert the file into a binary stream using GBK encoding, and convert each line into an entity class starting from a specified line in the file and store it in the 06 business table.
[0102] In one embodiment, before generating the file to be processed corresponding to the downstream system from the parsing result, the method further includes:
[0103] Perform anomaly checks on the parsing results;
[0104] If abnormal data is found in the analysis results, the location of the abnormal data is determined and the corresponding prompt information is displayed.
[0105] Specifically, in this embodiment, in order to quickly locate the reason why a certain business is not executed or not executed in a timely manner, after obtaining the parsing result, this application performs anomaly data check on the parsing result. If there is abnormal data in the parsing result, the location of the abnormal data is determined and the corresponding prompt information is displayed, so that any technical personnel can repair it according to the location of the abnormal data.
[0106] In one embodiment, obtaining the corresponding target index file from the upstream system according to the file processing plan includes:
[0107] The index file to be acquired is determined from the upstream system according to the file processing plan;
[0108] Determine the business scope of the upstream system, and verify the index file to be obtained based on the business scope;
[0109] After successful verification, the index file to be obtained is used as the target index file.
[0110] Specifically, in the process of obtaining the target index file, the index file to be obtained is first determined from the upstream system according to the file processing plan, as well as the business scope of the upstream system. Then, the index file to be obtained is verified according to the business scope. After the verification is passed, the index file to be obtained is obtained as the target index file.
[0111] In one embodiment, such as Figure 4As shown, the server first obtains a file processing plan, determines the files to be downloaded based on the plan, including index files and data files, selects the corresponding download method (which corresponds to the upstream system), downloads the index file first, stores it locally after downloading, and then verifies the index file. Specifically, the verification of the index file is performed according to the business scope configured by the organization. If it is correct, the download status is updated to "download successful"; otherwise, the download status is updated to "download unsuccessful".
[0112] Once the target data file to be downloaded is determined, it is confirmed whether the target index file corresponding to the target data file has been successfully downloaded. If so, the target data file is downloaded to the local machine and parsed. Otherwise, the file processing plan is re-polled to obtain the target index file and the target data file.
[0113] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.
[0114] Based on the same inventive concept, this application also provides a control device for implementing the control method for file processing described above. The solution provided by this device is similar to the implementation described in the above method; therefore, the specific limitations in one or more embodiments of the control device for file processing provided below can be found in the limitations of the control method for file processing described above, and will not be repeated here.
[0115] In one embodiment, such as Figure 5 As shown, a document processing control device is provided, comprising:
[0116] The first acquisition module 510 is used to acquire the file processing plan;
[0117] The second acquisition module 520 is used to acquire the corresponding target index file from the upstream system according to the file processing plan;
[0118] The determination module 530 is used to determine the target data file to be processed from the upstream system according to the file processing plan;
[0119] The processing module 540 is used to obtain the target data file from the upstream system and process the target data file when the index file corresponding to the target data file is successfully obtained.
[0120] The processing module 540 is further configured to, when the index file corresponding to the target data file is not successfully obtained, execute the following step through the second acquisition module: obtain the corresponding index file from the upstream system according to the file processing plan.
[0121] In one embodiment, the processing module 540 is further configured to:
[0122] The target data file is parsed to obtain the parsing results, and the downstream system corresponding to the target data file is determined.
[0123] The parsing results are used to generate a file to be processed corresponding to the downstream system, and the file to be processed is sent to the downstream system.
[0124] In one embodiment, the processing module 540 is further configured to:
[0125] Determine the type of the target data file;
[0126] The corresponding parsing program is invoked according to the type to parse the target data file and obtain the parsing result.
[0127] In one embodiment, the processing module 540 is further configured to:
[0128] When multiple target data files of the same type exist, the instance corresponding to each target data file is controlled to preempt the parsing program.
[0129] The control state of the parsing program is changed to the parsing identifier, and the corresponding parsing program is called to parse the target data file to be parsed for which the control state has been changed to the parsing identifier, so as to obtain the parsing result.
[0130] In one embodiment, the device further includes:
[0131] The inspection module (not shown in the figure) is used to check the parsing results for abnormal data.
[0132] The prompt module (not shown in the figure) is used to determine the location of abnormal data and display the corresponding prompt information if abnormal data is found in the parsing results.
[0133] In one embodiment, the second acquisition module 520 is used for:
[0134] The index file to be acquired is determined from the upstream system according to the file processing plan;
[0135] Determine the business scope of the upstream system, and verify the index file to be obtained based on the business scope;
[0136] After successful verification, the index file to be obtained is used as the target index file.
[0137] Each module in the aforementioned file processing control device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each module.
[0138] In one embodiment, a computer device is provided, which may be the server described in the above embodiments, and its internal structure diagram may be as follows: Figure 6 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage media. The database stores data such as file processing plans, target index files, and target data files. The network interface communicates with external terminals via a network connection. When executed by the processor, the computer program implements a file processing control method.
[0139] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0140] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:
[0141] Obtain the file processing plan;
[0142] According to the file processing plan, obtain the corresponding target index file from the upstream system;
[0143] The target data file to be processed is determined from the upstream system according to the file processing plan;
[0144] When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed.
[0145] If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan.
[0146] In one embodiment, the processor, when executing a computer program, also performs the following steps:
[0147] The target data file is parsed to obtain the parsing results, and the downstream system corresponding to the target data file is determined.
[0148] The parsing results are used to generate a file to be processed corresponding to the downstream system, and the file to be processed is sent to the downstream system.
[0149] In one embodiment, the processor, when executing a computer program, also performs the following steps:
[0150] Determine the type of the target data file;
[0151] The corresponding parsing program is invoked according to the type to parse the target data file and obtain the parsing result.
[0152] In one embodiment, the processor, when executing a computer program, also performs the following steps:
[0153] When multiple target data files of the same type exist, the instance corresponding to each target data file is controlled to preempt the parsing program.
[0154] The control state of the parsing program is changed to the parsing identifier, and the corresponding parsing program is called to parse the target data file to be parsed for which the control state has been changed to the parsing identifier, so as to obtain the parsing result.
[0155] In one embodiment, the processor, when executing a computer program, also performs the following steps:
[0156] Perform anomaly checks on the parsing results;
[0157] If abnormal data is found in the analysis results, the location of the abnormal data is determined and the corresponding prompt information is displayed.
[0158] In one embodiment, the processor, when executing a computer program, also performs the following steps:
[0159] The index file to be acquired is determined from the upstream system according to the file processing plan;
[0160] Determine the business scope of the upstream system, and verify the index file to be obtained based on the business scope;
[0161] After successful verification, the index file to be obtained is used as the target index file.
[0162] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:
[0163] Obtain the file processing plan;
[0164] According to the file processing plan, obtain the corresponding target index file from the upstream system;
[0165] The target data file to be processed is determined from the upstream system according to the file processing plan;
[0166] When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed.
[0167] If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan.
[0168] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0169] The target data file is parsed to obtain the parsing results, and the downstream system corresponding to the target data file is determined.
[0170] The parsing results are used to generate a file to be processed corresponding to the downstream system, and the file to be processed is sent to the downstream system.
[0171] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0172] Determine the type of the target data file;
[0173] The corresponding parsing program is invoked according to the type to parse the target data file and obtain the parsing result.
[0174] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0175] When multiple target data files of the same type exist, the instance corresponding to each target data file is controlled to preempt the parsing program.
[0176] The control state of the parsing program is changed to the parsing identifier, and the corresponding parsing program is called to parse the target data file to be parsed for which the control state has been changed to the parsing identifier, so as to obtain the parsing result.
[0177] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0178] Perform anomaly checks on the parsing results;
[0179] If abnormal data is found in the analysis results, the location of the abnormal data is determined and the corresponding prompt information is displayed.
[0180] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0181] The index file to be acquired is determined from the upstream system according to the file processing plan;
[0182] Determine the business scope of the upstream system, and verify the index file to be obtained based on the business scope;
[0183] After successful verification, the index file to be obtained is used as the target index file.
[0184] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:
[0185] Obtain the file processing plan;
[0186] According to the file processing plan, obtain the corresponding target index file from the upstream system;
[0187] The target data file to be processed is determined from the upstream system according to the file processing plan;
[0188] When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed.
[0189] If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan.
[0190] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0191] The target data file is parsed to obtain the parsing results, and the downstream system corresponding to the target data file is determined.
[0192] The parsing results are used to generate a file to be processed corresponding to the downstream system, and the file to be processed is sent to the downstream system.
[0193] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0194] Determine the type of the target data file;
[0195] The corresponding parsing program is invoked according to the type to parse the target data file and obtain the parsing result.
[0196] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0197] When multiple target data files of the same type exist, the instance corresponding to each target data file is controlled to preempt the parsing program.
[0198] The control state of the parsing program is changed to the parsing identifier, and the corresponding parsing program is called to parse the target data file to be parsed for which the control state has been changed to the parsing identifier, so as to obtain the parsing result.
[0199] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0200] Perform anomaly checks on the parsing results;
[0201] If abnormal data is found in the analysis results, the location of the abnormal data is determined and the corresponding prompt information is displayed.
[0202] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:
[0203] The index file to be acquired is determined from the upstream system according to the file processing plan;
[0204] Determine the business scope of the upstream system, and verify the index file to be obtained based on the business scope;
[0205] After successful verification, the index file to be obtained is used as the target index file.
[0206] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.
[0207] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0208] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.
Claims
1. A control method for file processing, characterized in that, The method includes: Obtain the file processing plan; According to the file processing plan, obtain the corresponding target index file from the upstream system; The target data file to be processed is determined from the upstream system according to the file processing plan; When the index file corresponding to the target data file is successfully obtained, the target data file is obtained from the upstream system and processed. If the index file corresponding to the target data file is not successfully obtained, return to the step: obtain the corresponding index file from the upstream system according to the file processing plan; The step of obtaining the corresponding target index file from the upstream system according to the file processing plan includes: The index file to be acquired is determined from the upstream system according to the file processing plan; Determine the business scope of the upstream system, and verify the index file to be obtained based on the business scope; After successful verification, the index file to be obtained is used as the target index file.
2. The method according to claim 1, characterized in that, The processing of the target data file includes: The target data file is parsed to obtain the parsing results, and the downstream system corresponding to the target data file is determined. The parsing results are used to generate a file to be processed corresponding to the downstream system, and the file to be processed is sent to the downstream system.
3. The method according to claim 2, characterized in that, The process of parsing the target data file to obtain the parsing result includes: Determine the type of the target data file; The corresponding parsing program is invoked according to the type to parse the target data file and obtain the parsing result.
4. The method according to claim 3, characterized in that, The step of calling the corresponding parsing program to parse the target data file according to the type and obtaining the parsing result includes: When multiple target data files of the same type exist, the instance corresponding to each target data file is controlled to preempt the parsing program. The control state of the parsing program is changed to the parsing identifier, and the corresponding parsing program is called to parse the target data file to be parsed for which the control state has been changed to the parsing identifier, so as to obtain the parsing result.
5. The method according to claim 2, characterized in that, Before generating the file to be processed corresponding to the downstream system from the parsing result, the method further includes: Perform anomaly checks on the parsing results; If abnormal data is found in the analysis results, the location of the abnormal data is determined and the corresponding prompt information is displayed.
6. A document processing control device, characterized in that, The device includes: The first acquisition module is used to acquire the file processing plan; The second acquisition module is used to acquire the corresponding target index file from the upstream system according to the file processing plan; The determination module is used to determine the target data file to be processed from the upstream system according to the file processing plan; The processing module is used to obtain the target data file from the upstream system and process the target data file when the index file corresponding to the target data file is successfully obtained. The processing module is further configured to, when the index file corresponding to the target data file is not successfully obtained, execute the following step through the second acquisition module: obtain the corresponding index file from the upstream system according to the file processing plan; The second acquisition module is used for: The index file to be acquired is determined from the upstream system according to the file processing plan; Determine the business scope of the upstream system, and verify the index file to be obtained based on the business scope; After successful verification, the index file to be obtained is used as the target index file.
7. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 5.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5.
9. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 5.
Citation Information
Patent Citations
System and method for eliminating redundancy file of file storage system
CN101079034A
Data processing method and device, and computer readable storage medium
CN108958881A