A data file generation method, device, equipment and storage medium

Abstract

The present invention discloses a data file generation method, apparatus, device, and storage medium. The method comprises: receiving original transaction information, wherein the original transaction information carries identification information; filtering the original transaction information according to a preset push range to obtain target transaction information; obtaining transaction subject information from at least one transaction subject system by invoking a real-time interface based on the identification information; and generating a first target data file based on the target transaction information and the transaction subject information. The technical solution of the present invention ensures that data used for enterprise statistical analysis or external supervision is timely and accurate.

Description

Technical Field

[0001] The embodiments of the present invention relate to the interdisciplinary technical fields of software engineering, information security and data processing, and in particular to a data file generation method, apparatus, device and storage medium. Background Art

[0002] As the operating time of an enterprise increases and the business scale expands, the amount of data stored by the enterprise also increases. Processing and summarizing various different data is an essential step in enterprise decision-making analysis.

[0003] In existing technology solutions, data is collected from various systems, organized and stored in a data warehouse. The data warehouse then extracts and processes the data, converts it into the required format, and sends it to an exchange platform. The exchange platform receives the corresponding signal file and transmits the data via a predetermined route to the corresponding reporting system. The reporting system then processes the data, generates a reporting file, and sends it to the regulatory agency.

[0004] Data warehouses greatly facilitate the integration and utilization of data across multiple systems. However, on this platform where vast amounts of diverse data are stored, any change in data specifications or parameters requires corresponding adjustments to all systems across the data supply and demand chain that use or process this data. If, for objective or subjective reasons, a system fails to make adjustments simultaneously, data inconsistencies will occur across all systems. These data inconsistencies are generally easier to detect the more widespread the differences. Changes to specific data are less frequent and less widespread, making them less easily detected. Furthermore, data warehouses consume significant time to load, organize, and store data. If resource or other issues arise during these intermediate steps, all subsequent processes must wait, significantly impacting data timeliness. Summary of the Invention

[0005] The embodiments of the present invention provide a data file generation method, apparatus, device and storage medium to ensure that data used for enterprise statistical analysis or external supervision is timely and accurate.

[0006] In a first aspect, an embodiment of the present invention provides a method for generating a data file, comprising:

[0007] receiving original transaction information, wherein the original transaction information carries identification information;

[0008] Filtering the original transaction information according to a preset push range to obtain target transaction information;

[0009] Acquiring transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

[0010] A first target data file is generated according to the target transaction information and the transaction subject information.

[0011] In a second aspect, an embodiment of the present invention further provides a data file generating device, the device comprising:

[0012] A first receiving module is configured to receive original transaction information, wherein the original transaction information carries identification information;

[0013] A screening module, configured to screen the original transaction information according to a preset push range to obtain target transaction information;

[0014] an acquisition module, configured to acquire transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

[0015] The first generating module is configured to generate a first target data file according to the target transaction information and the transaction subject information.

[0016] In a third aspect, an embodiment of the present invention further provides an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, a data file generation method as described in any one of the embodiments of the present invention is implemented.

[0017] In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements a data file generation method as described in any one of the embodiments of the present invention.

[0018] The embodiments of the present invention receive original transaction information, wherein the original transaction information carries identification information; filter the original transaction information according to a preset push range to obtain target transaction information; obtain transaction subject information from at least one transaction subject system by calling a real-time interface based on the identification information; and generate a first target data file based on the target transaction information and the transaction subject information. The technical solution of the present invention can ensure that data used for enterprise statistical analysis or external supervision is timely and accurate. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without paying any creative work.

[0020] Figure 1 This is a flow chart of a data file generation method provided in Example 1 of the present invention;

[0021] Figure 2 This is a flowchart of generating new link data in a data file generation method provided in Example 1 of the present invention;

[0022] Figure 3 This is a schematic diagram of a process of forming a new link and an original link and comparing them in a data file generation method provided in the first embodiment of the present invention;

[0023] Figure 4 This is a flowchart of comparing a first target data file with a second target data file in a data file generation method provided in Example 1 of the present invention;

[0024] Figure 5 This is a structural diagram of a data file generating device provided by the second embodiment of the present invention;

[0025] Figure 6 This is a schematic structural diagram of an electronic device provided by Embodiment 3 of the present invention;

[0026] Figure 7 This is a structural diagram of a computer-readable storage medium containing a computer program provided in a fourth embodiment of the present invention. DETAILED DESCRIPTION

[0027] The present invention will be further described in detail below with reference to the accompanying drawings and examples. It will be understood that the specific embodiments described herein are intended only to illustrate the present invention and are not intended to limit the present invention. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present invention, not all of the structures. Furthermore, the embodiments of the present invention and the features of the embodiments may be combined with one another unless otherwise specified.

[0028] It should be mentioned before discussing exemplary embodiments in more detail that some exemplary embodiments are described as processes or methods depicted as flow charts. Although flow charts describe various operations (or steps) as sequential processes, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of various operations can be rearranged. When its operation is completed, the process can be terminated, but can also have additional steps not included in the accompanying drawings. The process can correspond to methods, functions, procedures, subroutines, subprograms, etc. In addition, the features in the embodiments of the present invention and the embodiments can be combined with each other without conflict.

[0029] The term "including" and its variations used in the present invention are open inclusions, that is, "including but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment."

[0030] It should be noted that similar reference numerals and letters represent similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings. At the same time, in the description of the present invention, the terms "first", "second", etc. are used only to distinguish the description and should not be understood as indicating or implying relative importance.

[0031] Example 1

[0032] Figure 1 This is a flow chart of a data file generation method provided by the first embodiment of the present invention. This embodiment is applicable to data file generation. The method can be executed by the data file generation device in the embodiment of the present invention. The device can be implemented in software and / or hardware. Figure 1 As shown, the method specifically includes the following steps:

[0033] S101. Receive original transaction information.

[0034] Among them, the original transaction information carries identification information.

[0035] It's important to note that raw transaction information refers to transaction data, such as a customer purchasing a certain item from a certain merchant using a certain bank card on a certain date. Raw transaction information carries identifying information, such as the bank card and transaction information (such as the bank card number and transaction ID).

[0036] In actual operation, the reporting system can directly receive the original transaction information sent by the trading system, or the trading system can send the original transaction information to the exchange platform, and the reporting system receives the original transaction information forwarded by the exchange platform.

[0037] S102: Filter the original transaction information according to the preset push range to obtain target transaction information.

[0038] The push scope may be pre-set by the reporting system, for example, all transactions with a transaction amount greater than RMB 1,000, or all transactions before a certain date in a certain year.

[0039] In this embodiment, the target transaction information refers to the transaction information that meets the push range and is obtained by filtering the original transaction information according to the preset push range.

[0040] In actual operation, the reporting system filters the original transaction information according to the pre-set push range of the reporting system to obtain the target transaction information. For example, the push range may be all transaction information with a transaction amount greater than 1,000 yuan. After filtering the original transaction information, all transaction information with a transaction amount greater than 1,000 yuan is the target transaction information.

[0041] S103: Acquire transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information.

[0042] In this embodiment, the real-time interface called is the ESB real-time data interface. ESB stands for Enterprise Service Bus, which is an enterprise service bus that can provide a series of standard interfaces to uniformly handle service call relationships between systems and achieve true loose coupling between business systems.

[0043] It should be explained that the transaction subject system refers to the system that stores the entities involved in the transaction (customer information and financial card information, etc.), and there can be one or more transaction subject systems. Transaction subject information refers to the customer's personal information (cardholder ID, country, and ID card information, etc.) and financial card information (bank card type, issuing institution, and the institution code of the issuing branch, etc.) involved in the original transaction information. For example, if the original transaction information shows that a customer purchased a certain item from a certain merchant using a certain bank card on a certain date in a certain year, the transaction subject information stored in the subject system will be the bank card information and the cardholder's personal information involved in the transaction.

[0044] In actual operation, the reporting system obtains transaction subject information from at least one transaction subject system by calling the ESB real-time data interface based on the identification information carried in the original transaction information.

[0045] S104: Generate a first target data file according to the target transaction information and the transaction subject information.

[0046] In this embodiment, the first target data file refers to the data file generated for reporting and supervision.

[0047] During actual operation, the reporting system filters the original transaction information according to the preset push range to obtain target transaction information, obtains transaction subject information from at least one transaction subject system by calling the ESB real-time interface based on the identification information carried by the original transaction information, and generates a first target data file based on the target transaction information and the transaction subject information.

[0048] Optionally, generating the first target data file according to the target transaction information and the transaction subject information includes:

[0049] The target transaction information and transaction subject information are spliced ​​together to obtain the target data.

[0050] It should be noted that splicing means that after the reporting system obtains the target transaction information, it obtains the transaction subject information matching the target transaction information from at least one transaction subject system by calling the real-time interface based on the identification information carried by the target transaction information (the original transaction information carries identification information, and the target transaction information is obtained by filtering the original transaction information according to the preset push range, so the target transaction information also carries identification information), and splices the transaction information contained in the target transaction information with the customer personal information and financial card information contained in the transaction subject information. The data formed after splicing is the target data.

[0051] A first target data file is generated according to the data collection rule and the target data.

[0052] It should be explained that data collection rules are daily data collection specifications set by the target organization and pre-stored in the reporting system.

[0053] Specifically, the target institution is required to generate a data interface file and submit data via a dedicated network line through a message transmission system. The target institution has specific requirements for the reporting specifications of various business data. Different business data must be reported in different categories, and the coding standards for various data types must be unified. Therefore, according to the data collection rules, the target data must be generated into a data interface file that meets the requirements of the target institution for submission.

[0054] Optionally, after generating the first target data file according to the target transaction information and the transaction subject information, the method further includes:

[0055] A second target data file is received.

[0056] It should be noted that the second target data file refers to the data collected from different systems in the existing technology received by the reporting system, which is uniformly organized and stored in the data warehouse, and extracted and processed by the data warehouse market (different systems correspond to different markets, which are equivalent to sub-databases), converted into the required format, and sent to the exchange platform. The exchange platform receives the corresponding signal file and transmits the data to the corresponding reporting system according to the established route. Finally, the reporting system processes the data to generate a reporting file and sends the data file to the target organization.

[0057] The first target data file and the second target data file are sorted according to the keyword.

[0058] For example, the keyword may be a transaction number.

[0059] In this embodiment, sorting refers to sorting both the first target data file and the second target data file according to the keyword. For example, if the first target data file contains data files with transaction numbers 001-099, and the second target data file also contains data files with transaction numbers 001-099, then both the first target data file and the second target data file are sorted in the order from 001 to 099.

[0060] If there is a difference between the sorted first target data file and the sorted second target data file, prompt information is generated according to the difference between the sorted first target data file and the sorted second target data file.

[0061] The prompt information refers to indication information generated when there is a difference between the first target data file and the second target data file, and may be, for example, a text prompt, or digital or graphic information.

[0062] In actual operation, after obtaining the first and second target data files, to ensure data accuracy, the reporting system will analyze the keywords in the first and second target data files, sort the files by keywords, and perform a line-by-line comparison to generate a difference file. If data inconsistencies occur, the reporting system will issue an early warning notification to relevant business and technical personnel to ensure that data discrepancies can be manually intervened before T+0.5 days, and the correction of problematic data and the optimization of data logic of the corresponding links can be carried out as soon as possible.

[0063] To ensure timely data submission, the reporting system processes the second target data file in the morning at the normal batch time, generates the reporting file, and sends it to the target organization. If the exchange platform cannot deliver the second target data file on time, the first target data file is processed in the warehouse, generated into the reporting file, and sent to the target organization. This dual-target data file comparison ensures the timeliness and accuracy of reported data.

[0064] Optionally, receiving the second target data file includes:

[0065] Receive a second target data file forwarded by the exchange platform, wherein the second target data file is a first data file stored in the data warehouse, the first data file is a data file generated based on first data, and the first data is data obtained from the transaction system and at least one transaction subject system.

[0066] Exemplarily, the second target data file forwarded by the exchange platform is accepted, wherein the second target data file is the first data file generated by the data warehouse market based on the screening and splicing of the first data, the first data is the data stored in the data warehouse after the data warehouse parses the first data file, and the first data file is a file generated by extracting and formatting data from the transaction system and the transaction subject system.

[0067] It should be noted that the exchange platform refers to the above-mentioned exchange platform, which is used to transmit data files.

[0068] In this embodiment, the data warehouse can be understood as a database, which is a subject-oriented, integrated, and relatively stable data set created to solve the online analytical processing and data mining of data between different systems. It can store large amounts of data for analysis and allows the use of multiple access technologies.

[0069] The transaction system refers to the system within the source information system that stores transaction information. The source information system includes three systems: the transaction system, the customer system, and the financial card system. The transaction system stores the original transaction information described in S101 above, the customer system stores customer personal information (such as cardholder ID, country, and ID card), and the financial card system stores transaction bank card information (such as bank card type, issuing institution code, and issuing branch location code).

[0070] The data warehouse obtains first data from the trading system and at least one trading entity system. The data warehouse parses and stores a first data file generated based on the first data in the warehouse basic information database. The data warehouse then extracts and processes the data and converts it into the required format to obtain a second target data file. The data warehouse then sends the second target data file to the exchange platform. The exchange platform then transmits the received second target data file to the corresponding reporting system via a predetermined route.

[0071] Optionally, receive raw transaction information, including:

[0072] Receive original transaction information sent by the trading system;

[0073] or,

[0074] Receive the original transaction information forwarded by the exchange platform.

[0075] The reporting system may directly receive the original transaction information sent by the trading system, or the trading system may send the original transaction information to the exchange platform and the reporting system may receive the original transaction information forwarded by the exchange platform.

[0076] The original transaction information is the previous day's transaction information pushed by the transaction system.

[0077] It's important to clarify that the previous day's transaction information refers to all transaction information from the previous day as pushed by the trading system. Since banks use daily settlement internally, the source information system pushes all data from the previous day required for regulatory reporting to the exchange platform at dawn each day. The exchange platform then distributes the data files to the reporting system and, in accordance with the rules established by the reporting system, sends them to the target institution to ensure timely data reporting.

[0078] The technical solution of this embodiment receives original transaction information containing identification information; filters the original transaction information according to a preset push range to obtain target transaction information; obtains transaction subject information from at least one transaction subject system by calling a real-time interface based on the identification information; and generates a first target data file based on the target transaction information and the transaction subject information. This ensures that data used for enterprise statistical analysis or external supervision is timely and accurate.

[0079] As an exemplary description of this embodiment, Figure 2 This is a flowchart for generating new link data in a data file generation method provided in Example 1 of the present invention. The new link is the link consisting of the source information system, the exchange platform, and the reporting system. Correspondingly, the original link is the link consisting of the source information system, the data warehouse, the exchange platform, and the reporting system.

[0080] like Figure 2 As shown, a process of generating new link data in a data file generation method includes the following operations:

[0081] The transaction system in the source information system extracts all original transaction information that should be reported on the previous day and sends it to the exchange platform.

[0082] The exchange platform pushes the raw transaction information to a designated directory on the exchange platform. Each line in the file represents a transaction message, and each field in the transaction message is separated by a specified delimiter. The file format and character set settings must also follow the specified format (the format and routing information are pre-agreed between the source information system and the exchange platform).

[0083] After the exchange platform receives the signal flag file indicating the completion of the transaction system operation in the source information system (the transaction system will send a signal flag file after sending data files to the exchange platform. When the exchange platform receives the signal flag file, it means that all data file transmissions are completed), it starts the file scheduling job. The files to be transmitted from the transaction system in the source information system are sent to the file collection directory of the reporting system in the specified format (the format and routing information are agreed in advance between the exchange platform and the reporting system). The reporting system uses Quartz (an open source job scheduling framework written entirely in Java, which allows program developers to schedule jobs based on time intervals for job scheduling in Java applications) to execute the file collection task in batches at the specified time point, store the original transaction information in the data table, and start screening to eliminate transactions that do not need to be reported and positive and negative hedging transactions in the original transaction information of the previous day, and generate the target transaction information that needs to be reported.

[0084] According to the target transaction information that needs to be reported after screening, and based on the identification information carried by the original transaction information, the ESB real-time data interface is called one by one to obtain the financial card information, cardholder customer information, issuing institution and other information related to the transaction corresponding to the target transaction information from the transaction subject system in the source information system.

[0085] The target transaction information to be reported and the transaction subject information obtained by the ESB are concatenated and stored in the same data table, and the first target data file is generated according to the daily data collection specifications. At this point, the new link data is generated.

[0086] As an exemplary description of this embodiment, Figure 3 This is a schematic diagram of the process of forming a new link and comparing the original link in a data file generation method provided in Example 1 of the present invention. This preferred embodiment provides a detailed description of the process of forming the first target data file and the second target data file, as well as comparing the first target data file and the second target data file to generate prompt information.

[0087] In the original chain, the source information system transmits data in batches to the data warehouse. The data warehouse uses batch operations to normalize and store the data. The data mart then filters and extracts the basic data, combines it with other information, and generates a second target data file. This file is then transmitted to the exchange platform, which then distributes it to the reporting system. Due to factors such as the data quality of each system on the original chain, the frequency of logical updates, hidden issues with existing data, and the length of the chain transmission path, the data processed through the data warehouse chain is of poor quality.

[0088] In order to improve the accuracy of data reporting, an embodiment of the present invention proposes a method for adding data sources to the reporting system, directly supplying the source information system data to the reporting system, and replicating the data screening and splicing logic of the data warehouse to the reporting system to generate a first target data file as a new link for data supply. The new link eliminates intermediate nodes such as the data warehouse, avoiding the impact of changes in the basic information and data model information of the data warehouse on the final data. At the same time, changes in any node in the intermediate process between the original link and the new link can be reflected in the final data comparison, which is convenient for timely discovery and correction. The method of simultaneous data supply of dual links provides an additional data supply channel on the basis of maintaining the stable data supply of the original link, which is used for emergency backup, detection of anomalies, etc., to ensure the timeliness and integrity of the data.

[0089] Figure 3 The source information system 1 is the transaction system, the source information systems 2 and 3 are the customer system and the financial card system, the data information 1 is the transaction information, and the data information 2 and 3 are the customer information and the financial card information.

[0090] like Figure 3 As shown, the process of forming a new link and comparing the original link in a data file generation method is as follows:

[0091] Transaction information of the new link ( Figure 3 The vertical data information 1) is sent from the exchange platform to the reporting system, customer information and bank card information ( Figure 3 The vertical data information 2 and 3) are transmitted to the reporting system through the enterprise service bus. The reporting system batch executes the file collection task at the specified time point of the Quartz scheduled task, stores the customer information and financial card information in the detailed data table, and forms the first target data file.

[0092] To ensure stable data reporting and supervision, the original link will not be significantly modified in logic, and the original data flow will be retained. Figure 3 The horizontal data information 1, 2 and 3) is formed by screening and splicing the basic data that has been stored in the warehouse in the data warehouse market, and then sent to the reporting system through the exchange platform to form the second target data file.

[0093] After acquiring the data files for both links, a cron (a scheduled task execution tool under Linux that can execute scheduled tasks at a specified time and frequency, and can execute most commands under Linux) scheduled tasks are configured to compare the data files using Linux commands. Before comparing the files, the first and second target data files must be sorted according to keywords. The file contents are then compared line by line, skipping identical data lines. The difference data lines, or data lines that exist in one file but not in the other, are output to the specified comparison result file. If there are no difference lines between the two files, the result file is empty. If there are difference lines between the two files, the difference lines are saved in the result file, and an error report is generated based on the difference, and data processing and reporting are performed.

[0094] Data warehouse data processing logic is complex, and data accuracy relies heavily on this logic, data model design, and underlying data. By shortening the data transmission link, we mitigate the significant discrepancies with source information systems caused by data conversion, while also minimizing data transmission links. This improves the integrity and accuracy of data reporting and ensures error-free data reporting. We subsequently implemented a dual-link synchronous data comparison system, with the two links acting as a primary and backup, ensuring data stability and enhancing the ability to respond to data failures.

[0095] As an exemplary description of this embodiment, Figure 4 This is a flowchart of comparing a first target data file and a second target data file in a data file generation method provided in Example 1 of the present invention. This preferred embodiment provides a detailed description of the comparison process of the first target data file and the second target data file.

[0096] like Figure 4 As shown, a process of comparing a first target data file and a second target data file in a data file generation method includes the following operations:

[0097] After generating the first target data file, the first target data file is sorted by keyword. After generating the second target data file, the second target data file is sorted by keyword. The first target data file and the second target data file are then compared line by line. If there are any different lines between the two files, the different data lines, or the data lines that exist in one file but not in the other, are output to the specified comparison result file, which contains the different lines. If there are no different lines between the two files, the result file is empty.

[0098] To ensure that business and technical personnel are promptly informed of any file comparison discrepancies, this embodiment of the present invention configures a scheduled Quartz task after the data comparison results are generated to notify the system of the results. This task first determines whether the comparison result file is empty. If so, the data between the two links is identical, and the program notifies the system of a normal dual-link comparison. If the file is valid, the program parses the data comparison results, extracts the keywords and fields of the difference data, and notifies the relevant personnel of the difference information.

[0099] To ensure timely data submission, regardless of any discrepancies in the comparison results, the program will prioritize the storage of the second target data file sent from the original link before 7:00 a.m. that day to generate the submission file, and the first batch will be sent to the target institution to ensure the normal submission of large quantities of data. If a discrepancy is found in the data comparison that day, the relevant personnel should promptly investigate the cause of the discrepancy upon receiving the anomaly notification. After making corrections as appropriate, the corrected data can be resubmitted before 12:00 p.m. that day to ensure that data issues are resolved that day.

[0100] In the event of a single-link data delivery delay or non-delivery, the dual-link comparison method can promptly activate the backup link after an alert indicates that the second target data file on the original link has not arrived. The backup link collects the first target data file from the new link, stores it in the database, and generates a reporting file for priority submission. Dual-link reporting ensures complementary reporting between the primary and backup links, ensuring normal data delivery to regulators and enhancing the robustness of the data reporting pathway.

[0101] The timeliness requirements for regulatory data reporting are high, and the dual-link comparison method can complete data accuracy verification before the data is stored. If abnormal data is found during the verification, the early warning mechanism will be triggered, and the relevant person in charge can be notified to check and correct the data, which shortens the time for manual maintenance of the data and ensures that the data can be maintained and reported within the time limit required by the supervision. The embodiment of the present invention improves the quality of data reported for supervision, and through the dual-link comparison technology, it ensures the consistency, integrity, timeliness and security of the data in the dual-link parallel process.

[0102] Example 2

[0103] Figure 5 This is a schematic diagram of the structure of a data file generation device provided by the second embodiment of the present invention. This embodiment is applicable to the case of data file generation. The device can be implemented in software and / or hardware. The device can be integrated into any device that provides data file generation function, such as Figure 5 As shown, the data file generating device specifically includes: a first receiving module 210 , a screening module 220 , an acquiring module 230 and a first generating module 240 .

[0104] The first receiving module 210 is configured to receive original transaction information, wherein the original transaction information carries identification information;

[0105] A screening module 220 is configured to screen the original transaction information according to a preset push range to obtain target transaction information;

[0106] An acquisition module 230 is configured to acquire transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

[0107] The first generating module 240 is configured to generate a first target data file according to the target transaction information and the transaction subject information.

[0108] Furthermore, the first generating module 240 includes:

[0109] a splicing unit, configured to splice the target transaction information and the transaction subject information to obtain target data;

[0110] A generating unit is configured to generate a first target data file according to a data collection rule and the target data.

[0111] Furthermore, the above device also includes:

[0112] a second receiving module, configured to receive a second target data file after generating the first target data file according to the target transaction information and the transaction subject information;

[0113] A sorting module is used to sort the first target data file and the second target data file according to a keyword after generating the first target data file according to the target transaction information and the transaction subject information; wherein the keyword includes: transaction number.

[0114] The second generating module is configured to generate a prompt message based on the difference between the sorted first target data file and the sorted second target data file if there is a difference between the sorted first target data file and the sorted second target data file after generating the first target data file based on the target transaction information and the transaction subject information.

[0115] Furthermore, the second receiving module is specifically configured to:

[0116] Receive a second target data file forwarded by the exchange platform, wherein the second target data file is a first data file stored in the data warehouse, the first data file is a data file generated based on first data, and the first data is data obtained from the transaction system and at least one transaction entity system.

[0117] Furthermore, the first receiving module 210 includes:

[0118] A first receiving unit, configured to receive original transaction information sent by the transaction system;

[0119] or,

[0120] The second receiving unit is configured to receive original transaction information forwarded by the exchange platform, wherein the original transaction information is the previous day's transaction information pushed by the trading system.

[0121] The above-mentioned product can execute the data file generation method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of executing the data file generation method.

[0122] The technical solution of this embodiment receives original transaction information containing identification information; filters the original transaction information according to a preset push range to obtain target transaction information; obtains transaction subject information from at least one transaction subject system by calling a real-time interface based on the identification information; and generates a first target data file based on the target transaction information and the transaction subject information. This ensures that data used for enterprise statistical analysis or external supervision is timely and accurate.

[0123] Example 3

[0124] Figure 6 This is a structural diagram of an electronic device provided in Example 3 of the present invention. Figure 6 A block diagram of an electronic device 312 suitable for implementing embodiments of the present invention is shown. Figure 6 The electronic device 312 shown is only an example and should not limit the functionality and scope of use of the embodiments of the present invention. The device 312 is a typical computing device capable of generating data files.

[0125] like Figure 6 As shown, electronic device 312 is implemented as a general purpose computing device. Components of electronic device 312 may include, but are not limited to, one or more processors 316, storage device 328, and bus 318 connecting various system components (including storage device 328 and processor 316).

[0126] Bus 318 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. Examples of these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnect (PCI) bus.

[0127] The electronic device 312 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device 312, including volatile and non-volatile media, removable and non-removable media.

[0128] The storage device 328 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 330 and / or cache memory 332. The electronic device 312 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 334 may be used to read and write non-removable, non-volatile magnetic media ( Figure 6 Not shown, often called a "hard drive"). Although Figure 6 Not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a Compact Disc-Read Only Memory (CD-ROM), a Digital Video Disc-Read Only Memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to bus 318 via one or more data medium interfaces. Storage device 328 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the data file generation functions of various embodiments of the present invention.

[0129] A program 336 having a set (at least one) of program modules 326 may be stored, for example, in a storage device 328. Such program modules 326 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may include an implementation of a network environment. Program modules 326 generally implement the functions and / or methods of the embodiments described herein.

[0130] The electronic device 312 can also communicate with one or more external devices 314 (e.g., a keyboard, pointing device, camera, display 324, etc.), one or more devices that enable a user to interact with the electronic device 312, and / or any device that enables the electronic device 312 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). This communication can occur via an input / output (I / O) interface 322. Furthermore, the electronic device 312 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 320. As shown, the network adapter 320 communicates with other modules of the electronic device 312 via a bus 318. It should be understood that, although not shown, other hardware and / or software modules can be used in conjunction with the electronic device 312, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, Redundant Arrays of Independent Disks (RAID) systems, tape drives, and data backup storage systems.

[0131] The processor 316 executes various functional applications and data processing by running the programs stored in the storage device 328, such as implementing the data file generation method provided in the above embodiment of the present invention;

[0132] receiving original transaction information, wherein the original transaction information carries identification information;

[0133] Filtering the original transaction information according to a preset push range to obtain target transaction information;

[0134] Acquiring transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

[0135] A first target data file is generated according to the target transaction information and the transaction subject information.

[0136] Example 4

[0137] Figure 7Schematic diagram of the structure of a computer-readable storage medium containing a computer program provided in a fourth embodiment of the present invention. This embodiment of the present invention provides a computer-readable storage medium 61 on which a computer program 610 is stored. When the program is executed by one or more processors, the data file generation method provided in all embodiments of the present invention is implemented as follows:

[0138] receiving original transaction information, wherein the original transaction information carries identification information;

[0139] Filtering the original transaction information according to a preset push range to obtain target transaction information;

[0140] Acquiring transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information;

[0141] A first target data file is generated according to the target transaction information and the transaction subject information.

[0142] Any combination of one or more computer-readable media can be used. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, device or device.

[0143] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0144] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0145] In some embodiments, the client and server can communicate using any currently known or future developed network protocol, such as HTTP (Hypertext Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0146] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0147] The computer program code for performing the operations of the present invention can be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0148] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0149] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a unit does not necessarily limit the unit itself.

[0150] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0151] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0152] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the concept of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. A data file generation method, characterized in that: include: receiving original transaction information, wherein the original transaction information carries identification information; Filtering the original transaction information according to a preset push range to obtain target transaction information; Acquiring transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information; generating a first target data file according to the target transaction information and the transaction subject information; the first target data file is a data file generated for reporting and supervision; After generating a first target data file according to the target transaction information and the transaction subject information, the method further includes: receiving a second target data file; sorting the first target data file and the second target data file according to keywords; If there is a difference between the sorted first target data file and the sorted second target data file, prompt information is generated according to the difference between the sorted first target data file and the sorted second target data file.

2. The method according to claim 1, characterized in that Generating a first target data file according to the target transaction information and the transaction subject information includes: Splicing the target transaction information and the transaction subject information to obtain target data; A first target data file is generated according to the data collection rule and the target data.

3. The method according to claim 1, characterized in that The keywords include: transaction number.

4. The method according to claim 1, wherein Receiving the second target data file includes: Receive a second target data file forwarded by the exchange platform, wherein the second target data file is a first data file stored in the data warehouse, the first data file is a data file generated based on first data, and the first data is data obtained from the transaction system and at least one transaction entity system.

5. The method according to claim 1, wherein Receive raw transaction information, including: Receive original transaction information sent by the trading system; or, Receive original transaction information forwarded by the exchange platform, wherein the original transaction information is the previous day's transaction information pushed by the trading system.

6. A data file generating device, characterized in that: include: A first receiving module is configured to receive original transaction information, wherein the original transaction information carries identification information; A screening module, configured to screen the original transaction information according to a preset push range to obtain target transaction information; an acquisition module, configured to acquire transaction subject information from at least one transaction subject system by calling a real-time interface according to the identification information; A first generating module is configured to generate a first target data file based on the target transaction information and the transaction subject information; the first target data file is a data file generated for reporting and supervision; The device further comprises: a second receiving module, configured to receive a second target data file after generating the first target data file according to the target transaction information and the transaction subject information; a sorting module, configured to sort the first target data file and the second target data file according to keywords after generating the first target data file according to the target transaction information and the transaction subject information; The second generating module is configured to generate a prompt message based on the difference between the sorted first target data file and the sorted second target data file if there is a difference between the sorted first target data file and the sorted second target data file after generating the first target data file based on the target transaction information and the transaction subject information.

7. The device according to claim 6, characterized in that The first generation module includes: a splicing unit, configured to splice the target transaction information and the transaction subject information to obtain target data; A generating unit is configured to generate a first target data file according to a data collection rule and the target data.

8. An electronic device, characterized in that: include: one or more processors; a memory for storing one or more programs; When the one or more programs are executed by the one or more processors, the processors are enabled to implement the method according to any one of claims 1 to 5.

9. A computer-readable storage medium containing a computer program, wherein the computer program is stored thereon, characterized in that: When the program is executed by one or more processors, the method according to any one of claims 1 to 5 is implemented.

Images