A financial document processing system and method
By enabling cross-datacenter file aggregation and processing in the financial document processing system, the operational limitations of file interaction between multiple data centers are resolved, the system's flexibility and service quality are improved, access costs are reduced, and real-time feedback on upload results is provided.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- NETSUNION CLEARING CORP
- Filing Date
- 2024-11-29
- Publication Date
- 2026-06-05
AI Technical Summary
In existing financial document processing systems, the financial documents in SFTP service clusters across multiple data centers are not entirely identical, necessitating the pre-agreed operational restrictions for file interaction within the same data center.
Each data center's file aggregation server retrieves financial files from the file upload directory of the SFTP cluster across all data centers and uploads them to its own file aggregation directory. The file processing server processes the files in the aggregation directory and then uploads them to the file download directory, thus enabling file interaction across data centers.
This avoids the operational limitations of needing to pre-agree on the same data center for financial document exchange, improves the access flexibility and service quality of product institutions and sales agencies, reduces access costs, and reduces anomaly handling time by providing feedback on uploaded results through file return.
Smart Images
Figure CN122160370A_ABST
Abstract
Description
Technical Field
[0001] This article relates to data processing technology, particularly a financial document processing system and method. Background Technology
[0002] The financial document (e.g., investment document) processing system is a system that runs in a dedicated network environment and interacts with product institutions and distributors by deploying the Secure File Transfer Protocol (SFTP) service in a public network environment. The system provides financial documents to product institutions and distributors through an SFTP service cluster in multiple data centers.
[0003] In related technologies, the source of financial files in the SFTP service cluster of each data center in the financial document processing system is the financial files uploaded by the corresponding product institution or sales agent.
[0004] However, the financial documents in the SFTP service clusters of multiple data centers in this financial document processing system are not completely identical. Therefore, when product institutions and sales agencies that have business dealings need to interact on financial documents, there will be corresponding operational restrictions that require pre-agreeing on the same data center for financial document interaction. Summary of the Invention
[0005] This application provides a financial document processing system and method that can avoid the operational limitations of needing to pre-agree on the same data center for financial document interaction.
[0006] On the one hand, this application provides a financial document processing system, including:
[0007] Each of the data centers' file processing servers is used to process financial files in its own SFTP cluster's file aggregation directory and upload the processed financial files to its own SFTP cluster's file download directory.
[0008] Each of the data centers' file aggregation servers is used to retrieve financial files from the file upload directories of the SFTP clusters of all data centers and upload the retrieved financial files to its own SFTP cluster's file aggregation directory.
[0009] Each of the data centers' file processing servers is used to process financial files in its own SFTP cluster's file aggregation directory and upload the processed financial files to its own SFTP cluster's file download directory.
[0010] On the other hand, this application provides a financial document processing method, applied to the aforementioned financial document processing system, comprising:
[0011] Each of the data centers’ file aggregation servers retrieves financial files from the file upload directory of the SFTP cluster of all data centers and uploads the retrieved financial files to its own SFTP cluster’s file aggregation directory.
[0012] Each of the data center's file processing servers processes the financial files in its own SFTP cluster's file aggregation directory and uploads the processed financial files to its own SFTP cluster's file download directory.
[0013] Compared with related technologies, this application includes a file aggregation server in each data center obtaining financial files from the file upload directories of the SFTP clusters of all data centers and uploading the obtained financial files to the file aggregation directory of its own SFTP cluster. A file processing server in each data center processes the financial files in its own SFTP cluster's file aggregation directory and uploads the processed financial files to its own SFTP cluster's file download directory. Therefore, by aggregating the financial files uploaded from multiple data centers, product institutions and sales agencies can access any data center to interact with financial files, thereby avoiding the operational limitation of needing to pre-agree on the same data center for financial file interaction.
[0014] Other features and advantages of this application will be set forth in the following description, and will be apparent in part from the description, or may be learned by practicing the application. Other advantages of this application can be realized and obtained by means of the solutions described in the description and the accompanying drawings. Attached Figure Description
[0015] The accompanying drawings are used to provide an understanding of the technical solutions of this application and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of this application and do not constitute a limitation on the technical solutions of this application.
[0016] Figure 1 This application provides a schematic diagram of the structure of a financial document processing system as an embodiment of the present application.
[0017] Figure 2 A schematic diagram of the structure of a financial document processing system based on existing technology;
[0018] Figure 3 This application provides a schematic diagram of the structure for an SFTP service leased line connection and deployment.
[0019] Figure 4 This is a schematic diagram of the structure of a file aggregation server provided in an embodiment of this application;
[0020] Figure 5 This application provides a schematic diagram of the file aggregation service provided by a file aggregation server in an embodiment of the present application.
[0021] Figure 6 This is a schematic diagram of the structure of a file processing server provided in an embodiment of this application;
[0022] Figure 7 This application provides a schematic diagram of the file processing service provided by a file processing server in an embodiment of the present application.
[0023] Figure 8 This is a flowchart illustrating a financial document processing method provided in an embodiment of this application. Detailed Implementation
[0024] This application describes several embodiments, but these descriptions are exemplary and not restrictive, and it will be apparent to those skilled in the art that many more embodiments and implementations are possible within the scope of the embodiments described herein. Although many possible combinations of features are shown in the drawings and discussed in the detailed description, many other combinations of the disclosed features are also possible. Unless specifically limited, any feature or element of any embodiment may be used in combination with, or may replace, any feature or element of any other embodiment.
[0025] This application includes and contemplates combinations of features and elements known to those skilled in the art. The embodiments, features, and elements disclosed in this application may also be combined with any conventional features or elements to form a unique inventive scheme as defined by the claims. Any feature or element of any embodiment may also be combined with features or elements from other inventive schemes to form another unique inventive scheme as defined by the claims. Therefore, it should be understood that any feature shown and / or discussed in this application may be implemented individually or in any suitable combination. Therefore, the embodiments are not limited except by the limitations imposed by the appended claims and their equivalents. Furthermore, various modifications and changes may be made within the scope of the appended claims.
[0026] Furthermore, in describing representative embodiments, the specification may have presented methods and / or processes as a specific sequence of steps. However, the method or process should not be limited to the specific order of steps described herein, to the extent that it does not depend on such a specific order. As will be understood by those skilled in the art, other sequences of steps are also possible. Therefore, the specific order of steps set forth in the specification should not be construed as a limitation of the claims. Moreover, the claims concerning the method and / or process should not be limited to the steps performed in the written order, and those skilled in the art will readily understand that these orders can be varied and still remain within the spirit and scope of the embodiments of this application.
[0027] This application provides a financial document processing system, such as... Figure 1 As shown, it includes: multiple data centers (two data centers, namely data center A and data center B, are used as examples in the figure), each of the data centers includes: an SFTP cluster, a file aggregation server, and a file processing server; each of the SFTP clusters includes: a file aggregation directory, a file upload directory, and a file download directory; the file aggregation server of each data center is connected to the SFTP clusters of other data centers;
[0028] Each of the data centers' file aggregation servers is used to retrieve financial files from the file upload directories of the SFTP clusters of all data centers and upload the retrieved financial files to its own SFTP cluster's file aggregation directory.
[0029] Each of the data centers' file processing servers is used to process financial files in its own SFTP cluster's file aggregation directory and upload the processed financial files to its own SFTP cluster's file download directory.
[0030] In related technologies, financial document processing systems, such as Figure 2 As shown, it includes: multiple data centers, each of which includes: an SFTP cluster, a file aggregation server, and a file processing server; each of the SFTP clusters includes: a file upload directory, a file aggregation directory, and a file download directory.
[0031] like Figure 2 As shown, the sending institution uploads financial files to the file upload directory in the SFTP cluster. The file aggregation server retrieves the financial files from the file upload directory of the SFTP cluster in its corresponding data center and uploads the retrieved financial files to the file aggregation directory of its own SFTP cluster. The file aggregation directory downloads the financial files from its own SFTP cluster's file aggregation directory and then uploads them to the file download directory for downloading institutions.
[0032] In this context, the sending institution may be a product provider or a distributor, and similarly, the receiving institution may be either a product provider or a distributor. However, when the sending institution is a product provider, the receiving institution is a distributor, and vice versa. A product provider is responsible for services such as safeguarding investor accounts, maintaining transaction records, distributing dividends, issuing investor account reports, and registering the number of shares of the financial product. A distributor is a legal entity or natural person that sells financial products. Financial documents are used by product providers and distributors when sending business data according to business rules.
[0033] In existing financial document processing systems, the financial documents in the SFTP service clusters of data centers only originate from the uploading institutions. The financial documents across multiple data center SFTP service clusters are not entirely identical. Therefore, when product institutions and sales agents with business dealings need to interact on financial documents, there is a corresponding operational limitation requiring pre-agreed access to the same data center for document exchange. However, the financial document processing system provided in this application involves each data center's file aggregation server retrieving financial documents from the file upload directories of all data center SFTP clusters and uploading them to its own SFTP cluster's file aggregation directory. Each data center's file processing server processes the financial documents in its own SFTP cluster's file aggregation directory and uploads the processed documents to its own SFTP cluster's file download directory. Therefore, by aggregating financial documents uploaded from multiple data centers, product institutions and sales agents can access any data center for document exchange, thus avoiding the operational limitation of needing to pre-agreed access to the same data center.
[0034] In one exemplary instance, the financial document includes an index file and a data file.
[0035] In one exemplary instance, the financial documents further include a key file, wherein the same batch of financial documents corresponds to the same key file.
[0036] Financial documents are divided into index files and data files. Each financial document exchange must include both an index file and a data file. The index file indicates a list of all data file names for this exchange, with one data file name per line. The data files contain all financial transaction data for this exchange, with one financial transaction data record per line. Financial transaction data for different business types are stored in different data files.
[0037] The filename of the index file can be represented as: "OFI / OFP / OFX / OFJ / OFC / OFK / OFG" + "_" + file creator's internal code + "_" + file recipient's internal code + "_" + file batch + ".TXT". An example filename of the index file can be: OFI_xxx_yyy_20220628.TXT.
[0038] The format of the index file can be shown in Table 1 below.
[0039]
[0040] Table 1
[0041] Here is an example of an index file:
[0042] OFDCFIDX 01
[0044] Xxx
[0045] Yyy 20220628 003
[0048] OFD_xxx_yyy_20220628_001.TXT
[0049] OFD_xxx_yyy_20220628_002.TXT
[0050] OFD_xxx_yyy_20220628_003.TXT
[0051] The data file names are as follows: "OFD" + "_" + file creator's internal code + "_" + file recipient's internal code + "_" + file batch + "_" + file type code +
[0052] The filename is ".TXT". An example of a data file name is:
[0053] OFD_xxx_yyy_20220628_001.TXT.
[0054] The data file format can be as shown in Table 2.
[0055]
[0056]
[0057] The following is an example of a data file for Table 2:
[0058] OFDCFDAT01
[0059] Xxx
[0060] Yyy 20220628 000 001 005
[0065] filed-1filed-2filed-3filed-4filed-5
[0066] 00000009 Wealth Management Business Data 1 Wealth Management Business Data 2 Wealth Management Business Data 3 Wealth Management Business Data 4 Wealth Management Business Data 5 Wealth Management Business Data 6 Wealth Management Business Data 7 Wealth Management Business Data 8 Wealth Management Business Data 9 OFDCFEND
[0067] In one exemplary instance, each of the data center's file aggregation servers retrieves financial files from the file upload directories of all data center SFTP clusters and uploads the retrieved financial files to its own SFTP cluster's file aggregation directory, including:
[0068] The file aggregation server in each of the data centers obtains the filenames of the index files in all financial files from the file upload directory of the SFTP cluster in all data centers;
[0069] The filenames of the obtained index files are summarized and deduplicated to obtain the filenames of the processed index files.
[0070] Download the corresponding index file based on the filename of the processed index file;
[0071] For each of the obtained index files, the following processing is performed:
[0072] The index file is parsed, and if the index file is successfully parsed, the corresponding data file and key file are downloaded based on the parsed index file;
[0073] The index file, the corresponding data file, and the key file are packaged together to obtain the financial file corresponding to the index file, and then uploaded to the file aggregation directory of its own SFTP cluster.
[0074] In one exemplary instance, each of the data center's file aggregation servers is further configured to:
[0075] The filenames of the data files in the financial files uploaded to the file aggregation directory of its own SFTP cluster are stored in the cache.
[0076] In one exemplary instance, each of the data center's file aggregation servers is further configured to:
[0077] Retrieve the index file from the newly added financial files from the file upload directory of the SFTP cluster in its own data center or a data center outside its own data center;
[0078] The index file is parsed, and if the index file is successfully parsed, the data file and key file of the newly added financial file are downloaded based on the parsed index file;
[0079] Determine whether the filename of the data file in the newly added financial file exists in the cache;
[0080] If the filename of the data file in the newly added financial file does not exist in the cache, the newly added financial file is uploaded to the file aggregation directory of its own SFTP cluster, and the filename of the data file in the newly added financial file is stored in the cache.
[0081] For example, the newly added financial file is a financial file recently uploaded by the sending institution to the file upload directory of the SFTP cluster in the data center. Determining whether the filename of the newly added financial file does not exist in the cache can indicate whether the newly added financial file has been uploaded to the file aggregation directory.
[0082] In one exemplary instance, the file aggregation server in each data center is further configured to:
[0083] The upload time information of the financial file when it is uploaded to the file summary directory of its own SFTP cluster is obtained and stored in the cache;
[0084] Based on the upload time information of the financial files in the cache, the filenames of data files whose upload time is more than a preset time away from the current time are periodically obtained and deleted.
[0085] For example, periodically retrieving the filenames of data files whose upload time is more than a preset time ago can ensure that the storage amount in the cache remains within a certain range.
[0086] In one exemplary instance, each of the data center's file processing servers processes financial files in its own SFTP cluster's file aggregation directory and uploads the processed financial files to its own SFTP cluster's file download directory, including:
[0087] Each of the data centers' file processing servers downloads the financial documents from its own SFTP cluster's file aggregation directory and performs file processing; wherein, the file processing includes at least: file validity checking, and also includes: business processing adapted to the financial documents;
[0088] Once the financial file has been successfully processed, it is uploaded to the file download directory of its own SFTP cluster, grouped together according to the same recipient.
[0089] In one exemplary instance, each of the file processing servers in the data center is further configured to:
[0090] Retrieve the upload results of financial files obtained from the file upload directories of the SFTP clusters across all data centers;
[0091] The uploaded financial files are grouped together according to the sender of the financial files, and the upload results are written to the disk and uploaded to the file upload directory of its own SFTP cluster.
[0092] In related technologies, product institutions or distributors cannot perceive the upload results of financial documents after they have been uploaded. However, the financial document processing system provided in this application can obtain the upload results of financial documents from the file upload directories of the SFTP clusters in all data centers, and write the upload results to a return file uploaded to its own SFTP cluster's file upload directory, thereby enabling the uploading institution to know the upload results of the financial document processing system.
[0093] In one exemplary instance, the processing results include: successful upload results and failed upload results, wherein the failed upload results include: the reason for the upload failure.
[0094] In one exemplary instance, the successful processing result is the result of successfully uploading the financial file to the file download directory of the SFTP cluster in the data center.
[0095] The failure handling result is the result generated when the financial file is not successfully uploaded to the file download directory of the SFTP cluster in the data center.
[0096] In one exemplary instance, the reasons for failure include: the index file in the financial file failed to be parsed, the financial file did not successfully undergo file processing, and the financial file could not be successfully uploaded to the file download directory.
[0097] For example, for financial documents that cannot be uploaded to the file download directory, the financial document processing system provided in this application embodiment not only writes the failed upload result in the return file, but also records the corresponding failure reason, thereby helping the sending institution to better understand the reasons for the failure.
[0098] In one exemplary instance, the location of the backup file uploaded to the file upload directory and the location of the financial file uploaded to the file upload directory are located in two different subdirectories of the file upload directory.
[0099] The financial document processing system provided in this application embodiment can specifically be a wealth management agency document processing system. In this system, the financial documents are specifically wealth management documents, and the system comprises four parts:
[0100] SFTP Service Leased Line Connection and Deployment: Connection and deployment methods for SFTP in multiple data centers in a leased line environment.
[0101] Financial documents: Text files containing financial business data processed by the financial agency document processing system.
[0102] Document aggregation service: Aggregates financial documents uploaded by product institutions or sales agents via SFTP in multiple centers.
[0103] Document processing service: Process the financial documents compiled by the system according to business needs. After processing, upload them to the SFTP of all data centers for product institutions or sales agencies to download and process. At the same time, write the financial document processing results to the return file and upload it to the institution directory of the document sending institution.
[0104] SFTP service leased line connection and deployment methods can be as follows: Figure 3 As shown, this deployment method has the following characteristics:
[0105] 1. The financial management agency document processing system is deployed in multiple data centers.
[0106] 2. An SFTP cluster is deployed in each data center. The financial management and distribution document processing system provides services to product institutions and distribution agencies through the SFTP cluster in this data center.
[0107] 3. Product agencies and distributors connect to the SFTP cluster via dedicated lines.
[0108] 4. Product agencies and distributors can not only connect to the SFTP cluster of this data center via a dedicated line, but also connect to the SFTP clusters of other data centers via a dedicated line. When the SFTP cluster of this data center fails, financial documents can be exchanged and processed through the SFTP clusters of other data centers.
[0109] 5. Supports expansion of data centers. When adding a data center, a financial management and sales document processing system and an SFTP cluster need to be deployed in that data center. The SFTP cluster can be accessed by other data centers, and the data center can also access the SFTP clusters of other data centers.
[0110] The file aggregation service can be provided by a file aggregation server, and the structural diagram of the file aggregation server can be shown as follows. Figure 4 As shown, the file aggregation server has the following characteristics:
[0111] 1. Product providers or distributors upload financial documents to any data center.
[0112] 2. The file aggregation server connects to the SFTP clusters in all data centers and downloads financial files from the file upload directory in each SFTP cluster.
[0113] 3. The file aggregation server aggregates and merges all financial files from all data centers by filename.
[0114] 4. The file aggregation server uploads the aggregated and merged financial files to the file aggregation directory of this data center's SFTP, so that the receiving structure (product institution or sales agency) can download and process them.
[0115] Correspondingly, the process of providing file aggregation services through a file aggregation server can be as follows: Figure 5 As shown, it includes:
[0116] Step 101: Traverse all data centers to summarize and deduplicate the index files;
[0117] Step 102: Group the processed index files according to data centers;
[0118] Step 103: Traverse all data centers;
[0119] Step 104: Download the index file;
[0120] Step 105: Parse the index file and obtain the list of data files;
[0121] Step 106: Download the corresponding data file and key file;
[0122] Step 107: Determine if there are still unprocessed index files in the data center. If they exist, continue to step 104; otherwise, proceed to step 108.
[0123] Step 108: Upload the financial management documents to the document summary directory;
[0124] Step 109: Store the list of financial management files uploaded to the file summary directory in the current batch, along with their upload times, in the Redis cache.
[0125] File processing services can be provided by a file processing server. A schematic diagram of the file processing server's structure can be shown below. Figure 6 As shown, the file processing server has the following characteristics:
[0126] 1. The file processing server downloads all financial files from the summary directory for file processing.
[0127] 2. The file processing server uploads the processed financial files to the file download directory.
[0128] 3. The file processing server determines the file sender based on the filename rules, writes the processing result of the financial file to the return file, and uploads it to the file upload directory of the sending institution.
[0129] 4. The receiving institution downloads the financial documents from the document download directory.
[0130] 5. The financial document sending institution downloads the return file from the file upload directory.
[0131] Correspondingly, the file processing services provided by the file processing server can be such as Figure 7 As shown, it includes:
[0132] Step 201: Determine if the current institution has any pending financial management files in Redis. If they exist, proceed to step 202; otherwise, proceed to step 203.
[0133] Step 202: Determine whether the financial document to be processed has not been processed or has been updated. If it has not been processed or has been updated, proceed to step 204. If it has been processed or has not been updated, proceed to step 203.
[0134] Step 203: Determine if there is a mechanism to be processed. If it exists, proceed to step 201; otherwise, end.
[0135] Step 204: Parse the financial documents for business processing;
[0136] Step 205: Generate a return file based on the processing results.
[0137] The financial document processing system provided in this application embodiment, deployed in a multi-datacenter environment within a dedicated line, offers a reliable financial document processing service to product institutions and distribution agencies. By aggregating and merging financial documents from multiple data centers, this system enables product institutions and distribution agencies to support access and retrieval from any node, further improving service quality and reducing access costs. By returning files to the uploading institution, the system provides timely feedback on the processing results. When anomalies occur during processing, the uploading institution can promptly detect and resolve the issues, significantly reducing processing time. Furthermore, by internally recording the upload time of financial documents, the system supports the ability to process the same updated financial document repeatedly.
[0138] This application also provides a financial document processing method, applicable to the financial document processing system described in any of the above embodiments, such as... Figure 8 As shown, it includes:
[0139] Step 201: Each data center's file aggregation server retrieves financial files from the file upload directory of the SFTP cluster of all data centers and uploads the retrieved financial files to its own SFTP cluster's file aggregation directory.
[0140] Step 202: Each file processing server in the data center processes the financial files in its own SFTP cluster's file summary directory and uploads the processed financial files to its own SFTP cluster's file download directory.
[0141] In one exemplary instance, the financial files include: an index file and a data file; each data center's file aggregation server retrieves the financial files from the file upload directories of all data centers' SFTP clusters and uploads the obtained financial files to its own SFTP cluster's file aggregation directory, including:
[0142] First, the file aggregation server in each of the data centers obtains the filenames of the index files in all financial files from the file upload directory of the SFTP cluster in all data centers;
[0143] Secondly, the filenames of the obtained index files are summarized and deduplicated to obtain the filenames of the processed index files;
[0144] Next, download the corresponding index file based on the filename of the processed index file;
[0145] Finally, each of the obtained index files is processed as follows:
[0146] The index file is parsed, and if the index file is successfully parsed, the corresponding data file and key file are downloaded based on the parsed index file;
[0147] The index file, the corresponding data file, and the key file are packaged together to obtain the financial file corresponding to the index file, and then uploaded to the file aggregation directory of its own SFTP cluster.
[0148] In one exemplary instance, the financial document processing method provided in this application embodiment further includes:
[0149] The filenames of the data files in the financial files uploaded to the file aggregation directory of its own SFTP cluster are stored in the cache.
[0150] In one exemplary instance, the financial document processing method provided in this application embodiment further includes:
[0151] First, each of the data centers’ file aggregation servers retrieves the index file from the file upload directory of the newly added financial files from its own data center or the SFTP cluster of a data center outside its own data center.
[0152] Next, the index file is parsed, and if the index file is successfully parsed, the data file and key file of the newly added financial file are downloaded according to the parsed index file;
[0153] Next, determine whether the filename of the data file in the newly added financial file exists in the cache;
[0154] Finally, if the filename of the data file in the newly added financial file does not exist in the cache, the newly added financial file is uploaded to the file aggregation directory of its own SFTP cluster, and the filename of the data file in the newly added financial file is stored in the cache.
[0155] In one exemplary instance, the financial document processing method provided in this application embodiment further includes:
[0156] First, each of the data centers' file aggregation servers obtains the upload time information when the financial files are uploaded to the file aggregation directory of its own SFTP cluster and stores it in the cache;
[0157] Secondly, based on the upload time information of the financial files in the cache, the filenames of data files whose upload time is more than a preset time away from the current time are periodically obtained and deleted.
[0158] In one exemplary instance, each of the data center's file processing servers processes financial files in its own SFTP cluster's file aggregation directory and uploads the processed financial files to its own SFTP cluster's file download directory, including:
[0159] First, each of the data centers' file processing servers downloads the financial documents from its own SFTP cluster's file aggregation directory and performs file processing; wherein, the file processing includes at least: file validity checking, and also includes: business processing adapted to the financial documents;
[0160] Secondly, once the financial files have been successfully processed, they are grouped together according to the recipient and uploaded to the file download directory of the SFTP cluster.
[0161] In one exemplary instance, the financial document processing method provided in this application embodiment further includes:
[0162] First, the file processing server in each of the data centers obtains the upload results of the financial files from the file upload directory of the SFTP cluster in all data centers;
[0163] Secondly, the uploaded results of the financial files are written to a disk file and uploaded to the file upload directory of its own SFTP cluster, based on the fact that the senders of the financial files are the same.
[0164] In one exemplary instance, the processing results include: successful upload results and failed upload results, wherein the failed upload results include: the reason for the upload failure.
[0165] In one exemplary instance, the successful processing result is the result of successfully uploading the financial file to the file download directory of the SFTP cluster in the data center.
[0166] The failure handling result refers to the result generated when the financial file is not successfully uploaded to the file download directory of the SFTP cluster in the data center.
[0167] In one exemplary instance, the reasons for failure include: the index file in the financial file failed to be parsed, the financial file did not successfully undergo file processing, and the financial file could not be successfully uploaded to the file download directory.
[0168] In one exemplary instance, the location of the backup file uploaded to the file upload directory and the location of the financial file uploaded to the file upload directory are located in two different subdirectories of the file upload directory.
[0169] The financial document processing method provided in this application embodiment involves each data center's file aggregation server retrieving financial documents from the file upload directory of the SFTP cluster of all data centers and uploading the obtained financial documents to its own SFTP cluster's file aggregation directory. Each data center's file processing server processes the financial documents in its own SFTP cluster's file aggregation directory and uploads the processed financial documents to its own SFTP cluster's file download directory. Therefore, by aggregating financial documents uploaded from multiple data centers, product institutions and sales agencies can access any data center to interact with financial documents, thereby avoiding the operational limitation of needing to pre-agree on the same data center for financial document interaction.
[0170] It will be understood by those skilled in the art that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit (ASIC). Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.
Claims
1. A financial document processing system, characterized in that, include: Multiple data centers, each of which includes: an SFTP cluster, a file aggregation server, and a file processing server; each SFTP cluster includes: a file aggregation directory, a file upload directory, and a file download directory; the file aggregation server of each data center is connected to the SFTP clusters of other data centers; Each of the data centers' file aggregation servers is used to retrieve financial files from the file upload directories of the SFTP clusters of all data centers and upload the retrieved financial files to its own SFTP cluster's file aggregation directory. Each of the data centers' file processing servers is used to process financial files in its own SFTP cluster's file aggregation directory and upload the processed financial files to its own SFTP cluster's file download directory.
2. The system according to claim 1, characterized in that, The financial files include: index files and data files; each data center's file aggregation server retrieves the financial files from the file upload directory of the SFTP cluster of all data centers, and uploads the obtained financial files to its own SFTP cluster's file aggregation directory, including: The file aggregation server in each of the data centers obtains the filenames of the index files in all financial files from the file upload directory of the SFTP cluster in all data centers; The filenames of the obtained index files are summarized and deduplicated to obtain the filenames of the processed index files. Download the corresponding index file based on the filename of the processed index file; For each of the obtained index files, the following processing is performed: The index file is parsed, and if the index file is successfully parsed, the corresponding data file and key file are downloaded based on the parsed index file; The index file, the corresponding data file, and the key file are packaged together to obtain the financial file corresponding to the index file, and then uploaded to the file aggregation directory of its own SFTP cluster.
3. The system according to claim 2, characterized in that, The file aggregation server in each of the aforementioned data centers is also used for: The filenames of the data files in the financial files uploaded to the file aggregation directory of its own SFTP cluster are stored in the cache.
4. The system according to claim 3, characterized in that, The file aggregation server in each of the aforementioned data centers is also used for: Retrieve the index file from the newly added financial files from the file upload directory of the SFTP cluster in its own data center or a data center outside its own data center; The index file is parsed, and if the index file is successfully parsed, the data file and key file of the newly added financial file are downloaded based on the parsed index file; Determine whether the filename of the data file in the newly added financial file exists in the cache; If the filename of the data file in the newly added financial file does not exist in the cache, the newly added financial file is uploaded to the file aggregation directory of its own SFTP cluster, and the filename of the data file in the newly added financial file is stored in the cache.
5. The system according to claim 3 or 4, characterized in that, The file aggregation server in each data center is also used for: The upload time information of the financial file when it is uploaded to the file summary directory of its own SFTP cluster is obtained and stored in the cache; Based on the upload time information of the financial files in the cache, the filenames of data files whose upload time is more than a preset time away from the current time are periodically obtained and deleted.
6. The system according to claim 2, characterized in that, Each of the data center's file processing servers processes the financial files in its own SFTP cluster's file aggregation directory and uploads the processed financial files to its own SFTP cluster's file download directory, including: Each of the data centers' file processing servers downloads the financial documents from its own SFTP cluster's file aggregation directory and performs file processing; wherein, the file processing includes at least: file validity checking, and also includes: business processing adapted to the financial documents; Once the financial file has been successfully processed, it is uploaded to the file download directory of its own SFTP cluster, grouped together according to the same recipient.
7. The system according to claim 6, characterized in that, The file processing server in each of the aforementioned data centers is also used for: Retrieve the upload results of financial files obtained from the file upload directories of the SFTP clusters across all data centers; The uploaded financial files are grouped together according to the sender of the financial files, and the upload results are written to the disk and uploaded to the file upload directory of its own SFTP cluster.
8. The system according to claim 7, characterized in that, The processing results include: successful upload results and failed upload results, and the failed upload results include: the reason for the upload failure; The successful processing result is the result of successfully uploading the financial file to the file download directory of the SFTP cluster in the data center. The failure handling result is the result generated when the financial file is not successfully uploaded to the file download directory of the SFTP cluster in the data center. The reasons for the failure include: failure to parse the index file in the financial file, failure of the financial file to undergo file processing, and failure to upload the financial file to the file download directory.
9. The system according to claim 7, characterized in that, The location of the backup file uploaded to the file upload directory and the location of the financial file uploaded to the file upload directory are respectively located in two different subdirectories of the file upload directory.
10. A method for processing financial documents, characterized in that, The financial document processing system described in any one of 1-9 above includes: Each of the data centers’ file aggregation servers retrieves financial files from the file upload directory of the SFTP cluster of all data centers and uploads the retrieved financial files to its own SFTP cluster’s file aggregation directory. Each of the data center's file processing servers processes the financial files in its own SFTP cluster's file aggregation directory and uploads the processed financial files to its own SFTP cluster's file download directory.