Bill data processing method, device, equipment, medium and computer program product

Abstract

The present application relates to the field of big data technology, and provides a method, device, computer equipment, storage medium and computer program product for processing bill data. The present application can improve the efficiency of responding to bill-related report requirements and can be applied to the financial field. The method includes: importing the bill data stored in the bill system into the public area of ​​the data lake so that the public area of ​​the data lake loads the bill data into the source data table, instructing the private area of ​​the data lake to wait for the public area of ​​the data lake to load the bill data into the source data table, and then processing the various bill information tables contained in the source data table into multiple wide tables and storing them according to various bill behaviors and based on corresponding preset dimensions and indicators. When receiving a report generation request sent by a terminal, the multiple wide tables stored in the private area of ​​the data lake are provided to the terminal, so that the terminal can generate the report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

Description

Technical Field

[0001] The present application relates to the field of big data technology, and in particular to a method, apparatus, computer equipment, storage medium, and computer program product for processing bill data. Background Art

[0002] The bill business processing system needs to have a large number of statistical query and analysis functions. Such requirements require developers to arrange project plans and develop a corresponding query function for each requirement. This consumes a lot of development resources and cannot meet or realize business needs in a timely manner. Moreover, as the volume of online bill business increases year by year, the time consumed by online complex analysis is also gradually increasing.

[0003] The billing system provided by current technology still requires users such as sales representatives or analysts to submit requirements to developers. After the developer develops the module and puts it into production, the sales representative or analyst can use it to create corresponding reports. Moreover, each time a sales representative or analyst creates a report, he or she must face hundreds of bill business tables in the source application and sort out complex association logic. As a result, this technology has the technical problem of low efficiency in responding to bill-related reporting requirements. Summary of the Invention

[0004] Based on this, it is necessary to provide a method, device, computer equipment, storage medium and computer program product for processing bill data to address the above technical problems.

[0005] In a first aspect, the present application provides a method for processing bill data, which is applied to a bill data middle platform, and the method includes:

[0006] Import the bill data stored in the bill system into the public area of ​​the data lake, so that the public area of ​​the data lake loads the bill data into the posting source data table;

[0007] Instruct the private zone of the data lake to process and store the bill information tables contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators after the public zone of the data lake loads the bill data into the source data table;

[0008] When a report generation request sent by a terminal is received, multiple wide tables stored in the private area of ​​the data lake are provided to the terminal, so that the terminal can generate a report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0009] In one embodiment, importing the bill data stored in the bill system into the public area of ​​the data lake includes: obtaining source bill data exported from the bill system according to a set time period; obtaining incrementally changed bill data under current time conditions from the source bill data and forming an incremental file carrying the bill data; and sending the incremental file carrying the bill data to the public area of ​​the data lake.

[0010] In one embodiment, after obtaining the incrementally changed bill data under the current time condition from the source bill data and forming an incremental file carrying the bill data, the method further includes: generating a verification file corresponding to the incremental file;

[0011] The sending of the incremental file carrying the bill data to the public area of ​​the data lake includes: sending the incremental file and the verification file to the public area of ​​the data lake, so that after the public area of ​​the data lake receives the incremental file and the verification file, the incremental file is verified by using the verification file, and if the verification passes, the incremental file is imported into the posting source data table.

[0012] In one embodiment, the verification file records the file feature information of the incremental file; the public area of ​​the data lake is also used to extract the file feature information of the received incremental file as the information to be verified. If it is determined that the information to be verified is consistent with the file feature information recorded in the received verification file, it is determined that the verification is passed.

[0013] In one embodiment, before processing the various bill information tables contained in the source data table into multiple wide tables and storing them according to various bill behaviors and based on corresponding preset dimensions and indicators, the method also includes: performing bill business information analysis on the various bill behaviors to obtain the predetermined dimensions and predetermined indicators corresponding to each of the various bill behaviors; sending the predetermined dimensions and predetermined indicators corresponding to each of the various bill behaviors to the terminal; and forming the dimensions and indicators corresponding to each of the various bill behaviors based on the correction information of the predetermined dimensions and predetermined indicators corresponding to each of the various bill behaviors fed back by the terminal.

[0014] In one embodiment, the multiple wide tables include: a wide table of customer summary information per period, a wide table of institution summary information per period, a wide table of bill purchase transaction details per period, a wide table of bill sale transaction details per period, a wide table of bill inventory details per period, a wide table of bill pool business details, a wide table of bill endorsement transaction details, a wide table of bill circulation details per period, a wide table of bill acceptance details, a wide table of bill payment reminders, and a wide table of bill pledge details.

[0015] In a second aspect, the present application further provides a bill data processing device, which is applied to a bill data middle platform, and the device includes:

[0016] A data import module, configured to import the bill data stored in the bill system into the public area of ​​the data lake, so that the public area of ​​the data lake loads the bill data into the posting source data table;

[0017] A wide table processing module is used to instruct the private zone of the data lake to process and store the bill information tables contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators after the public zone of the data lake loads the bill data into the source data table.

[0018] The wide table providing module is used to provide the terminal with multiple wide tables stored in the private area of ​​the data lake when receiving a report generation request sent by the terminal, so that the terminal can generate the report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0019] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program: importing bill data stored in the bill system into the public area of ​​the data lake, so that the public area of ​​the data lake loads the bill data into a source data table; instructing the private area of ​​the data lake to process and store each bill information table contained in the source data table according to various bill behaviors and based on corresponding preset dimensions and indicators after the public area of ​​the data lake loads the bill data into the source data table; and upon receiving a report generation request sent by a terminal, providing the terminal with the multiple wide tables stored in the private area of ​​the data lake, so that the terminal can generate a report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0020] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the following steps: importing bill data stored in a bill system into a public area of ​​a data lake, so that the public area of ​​the data lake loads the bill data into a source data table; instructing a private area of ​​the data lake to process and store each bill information table contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators after the public area of ​​the data lake loads the bill data into the source data table; and upon receiving a report generation request sent by a terminal, providing the multiple wide tables stored in the private area of ​​the data lake to the terminal, so that the terminal generates a report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0021] In a fifth aspect, the present application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the following steps: importing bill data stored in a bill system into a public area of ​​a data lake, so that the public area of ​​the data lake loads the bill data into a source data table; instructing a private area of ​​the data lake to process and store each bill information table contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators after the public area of ​​the data lake loads the bill data into the source data table; and upon receiving a report generation request sent by a terminal, providing the multiple wide tables stored in the private area of ​​the data lake to the terminal, so that the terminal can generate a report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0022] The above-mentioned bill data processing method, device, computer equipment, storage medium and computer program product first imports the bill data stored in the bill system into the public area of ​​the data lake so that the public area of ​​the data lake loads the bill data into the source data table, and then instructs the private area of ​​the data lake to wait for the public area of ​​the data lake to load the bill data into the source data table. According to various bill behaviors and based on the corresponding preset dimensions and indicators, the various bill information tables contained in the source data table are processed into multiple wide tables and stored. When a report generation request is received from a terminal, the multiple wide tables stored in the private area of ​​the data lake are provided to the terminal so that the terminal can generate the report required by the user based on the multiple wide tables stored in the private area of ​​the data lake. This solution can pre-integrate the bill data stored in the bill system into multiple wide tables at one time according to various bill behaviors and based on the corresponding preset dimensions and indicators. Therefore, when users such as salesmen or analysts initiate report generation requests at the terminal, the pre-integrated multiple wide tables can be provided in a timely manner for users to quickly generate the required reports, thereby improving the efficiency of responding to bill-related report requirements. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 This is an application environment diagram of a method for processing bill data in one embodiment;

[0024] Figure 2 1 is a flow chart of a method for processing bill data in one embodiment;

[0025] Figure 3 A schematic diagram of a bill data middle platform processing bill data in one embodiment;

[0026] Figure 4 A schematic diagram of a bill data middle platform processing bill data in another embodiment;

[0027] Figure 5 is a structural block diagram of a bill data processing device in one embodiment;

[0028] Figure 6FIG. 1 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0030] The bill data processing method provided in the embodiment of the present application can be applied to Figure 1 In the illustrated application environment, the application environment includes a terminal 110, a bill data center 120, and a bill system 130. The terminal 110 can communicate with the bill data center 120 via a network, and the bill data center 120 can communicate with the bill system 130 via a network. Specifically, the bill data center 120 imports the bill data stored in the bill system 130 into the public area of ​​the data lake, so that the public area of ​​the data lake loads the bill data into the source data table. The bill data center 120 instructs the private area of ​​the data lake to process the bill information tables contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators, and store them. Therefore, when the bill data center 120 receives a report generation request sent by the terminal 110, the bill data center 120 provides the terminal 110 with the multiple wide tables stored in the private area of ​​the data lake, so that the terminal 110 can generate the user's required report based on the multiple wide tables stored in the private area of ​​the data lake.

[0031] In the above application environment, the terminal 110 can be but is not limited to various personal computers, laptops, smart phones and tablet computers, and the bill data center 120 and the bill system 130 can be implemented using independent servers or server clusters composed of multiple servers.

[0032] The following describes the bill data processing method of the present application in conjunction with the embodiments and corresponding drawings.

[0033] In one embodiment, Figure 2 As shown, a method for processing bill data is provided, which is applied to Figure 1 The bill data middleware 120 shown in FIG. 1 specifically includes the following steps:

[0034] Step S201: Import the bill data stored in the bill system into the public area of ​​the data lake, so that the public area of ​​the data lake loads the bill data into the source data table.

[0035] This step mainly involves the bill data middle station 120 importing the bill data stored in the bill system 130 into the data lake public area (Bdp) configured by the bill data middle station 120 itself. Specifically, daily bill data can be uploaded and stored in the bill system 130, such as the bill information details table, etc. However, since the online query load involved in the bill system 130 itself is relatively large and the query efficiency is low, in this step the bill data middle station 120 imports the bill data stored in the bill system 130 into the data lake public area configured by the bill data middle station 120 itself, so that the data lake public area loads the imported bill data into the source data table of the data lake public area, so as to ensure the efficiency of the query and processing of the existing bill data by the bill data middle station 120.

[0036] Step S202: After the public area of ​​the data lake has loaded the bill data into the source data table, the private area of ​​the data lake is instructed to process the bill information tables contained in the source data table into multiple wide tables according to the bill behavior and based on the corresponding preset dimensions and indicators, and store them.

[0037] This step is mainly for the bill data middle platform 120 to instruct its own configured data lake private area (Bdsp) to wait for the data lake public area (Bdp) to load the bill data into the source data table. After the job is successfully executed, the data lake private area starts to call the batch job to process the bill information tables contained in the source data table of the data lake public area (Bdp) according to the various bill behaviors and based on the corresponding preset dimensions and indicators into the corresponding multiple wide tables and store them. For example, refer to Figure 3 According to this processing method, the private area of ​​the data lake (Bdsp) can process the bill information tables in the public area of ​​the data lake (Bdp), such as the bill basic information table, bill endorsement information table, bill acceptance information table, bill purchase information table, bill sale information table, bill payment reminder table, and legal person customer information table, into multiple wide tables including: a wide table of customer summary information per period, a wide table of institution summary information per period, a wide table of bill purchase transaction details per period, a wide table of bill sale transaction details per period, a wide table of bill inventory details per period, a wide table of bill pool business details, a wide table of bill endorsement transaction details, a wide table of bill circulation details per period, a wide table of bill acceptance details, a wide table of bill payment reminders, and a wide table of bill pledge details.

[0038] Step S203: When a report generation request is received from a terminal, multiple wide tables stored in the private area of ​​the data lake are provided to the terminal, so that the terminal can generate a report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0039] Combine Figure 3In this step, the bill data middle platform 120 can receive the report generation request sent by the terminal 110. In response to the report generation request, the bill data middle platform 120 provides the terminal 110 with multiple wide tables stored in the aforementioned data lake private area (Bdsp). The terminal 110 can display the multiple wide tables for users such as salesmen or analysts to prepare and analyze reports and query and display charts corresponding to various reports based on their own needs, and conveniently prepare reports such as inventory analysis reports customized based on daily inventory wide tables. In this way, users can use simple operations such as dragging and dropping on the terminal 110 to select wide tables based on various wide tables provided by the bill data middle platform 120 to submit and display reports. There is no need to submit requirements to development, and no need to wait to implement statistical analysis reports and other functions.

[0040] The above-mentioned method for processing bill data first imports the bill data stored in the bill system into the public area of ​​the data lake so that the public area of ​​the data lake loads the bill data into the source data table, and then instructs the private area of ​​the data lake to wait for the public area of ​​the data lake to load the bill data into the source data table. According to various bill behaviors and based on the corresponding preset dimensions and indicators, the various bill information tables contained in the source data table are processed into multiple wide tables and stored. When a report generation request is received from a terminal, the multiple wide tables stored in the private area of ​​the data lake are provided to the terminal so that the terminal can generate the report required by the user based on the multiple wide tables stored in the private area of ​​the data lake. This solution can pre-integrate the bill data stored in the bill system into multiple wide tables at one time according to various bill behaviors and based on the corresponding preset dimensions and indicators. Therefore, when users such as salesmen or analysts initiate report generation requests at the terminal, the pre-integrated multiple wide tables can be provided in a timely manner for users to quickly make the required reports, thereby improving the efficiency of responding to bill-related report requirements.

[0041] In one embodiment, step S201 of importing the bill data stored in the bill system into the public area of ​​the data lake specifically includes:

[0042] Obtain the source bill data exported from the bill system according to the set time period; obtain the incremental bill data under the current time conditions from the source bill data and form an incremental file carrying the bill data; send the incremental file carrying the bill data to the public area of ​​the data lake.

[0043] The main feature of this embodiment is that the bill data middle station 120 can export the source bill data from the bill system 130 according to the set time period, that is, at regular intervals, and send the bill data with incremental changes under the current time conditions in the form of incremental files to be merged into the source table of the data lake public area (Bdp). Specifically, the set time period can be every day, and the current time condition can be the same day. For example, the bill data middle station 120 can export the source bill data in the bill system 130 in batches through a batch job every evening, and find the bill data with incremental changes on the same day in the source bill data according to the date field to generate a daily incremental file carrying the bill data with incremental changes on the same day, and then send the daily incremental file to the data lake public area (Bdp). The data lake public area (Bdp) can import the daily incremental file into the partition of the source data table for the same day. After the partition of the same day is successfully imported, the data lake public area merges the bill data of the partition of the same day with the bill data of day T-1 in the table according to the primary key to obtain the full data of the same day. The bill data middle platform 120 using the solution of this embodiment can efficiently, stably and accurately update the bill data in the public area of ​​the data lake in a timely manner, which is conducive to subsequent users to prepare accurate reports.

[0044] Furthermore, in one embodiment, after obtaining the incrementally changed bill data under the current time conditions from the source bill data and forming an incremental file carrying the bill data, the bill data middle platform 120 can further generate a verification file corresponding to the incremental file carrying the bill data, and at the same time as sending the incremental file carrying the bill data to the data lake public area, the verification file is also sent to the data lake public area, so that after the data lake public area receives the incremental file and the verification file, it uses the verification file to verify the incremental file, and if the verification passes, the received incremental file is imported into the source data table.

[0045] Specifically, for this embodiment, combined with Figure 4, the bill data middle station 120 can export the source bill data in the bill system 130 in batches through batch jobs every evening, and find the bill data with incremental changes on the day in the source bill data according to the date field to generate a daily incremental file carrying the bill data with incremental changes on the day. After the daily incremental file is generated, the bill data middle station 120 can move the incremental file to the intermediate directory and integrate it into a unified format with a date. Then the bill data middle station 120 can generate a verification file with the same name ending with CHK. In some embodiments, the verification file can record the file feature information of the incremental file, such as the file name, file size, and number of bill data records of the incremental file and other file-related information. Based on this, the bill data middle station 120 moves the incremental file and its verification file with the same name to the sending directory. When the gtp point-to-point sending task detects that a file appears in the sending directory, it can send the incremental file and its verification file with the same name to the receiving directory corresponding to the data lake public area (BDP), so that the data lake public area (BDP) can receive the incremental file and its verification file with the same name in its receiving directory. Specifically, after the data lake public area (BDP) receiving directory receives the incremental file and its verification file, it can extract the file feature information of the received incremental file as the information to be verified. If it is determined that the information to be verified is consistent with the file feature information recorded in the received verification file, it is determined that the verification has passed. Exemplarily, after the data lake public area (BDP) receives the incremental file and its verification file, it checks whether the file feature information recorded in the verification file, such as the file name, file size, and number of bill data records, is consistent with the file name, file size, and number of bill data records (information to be verified) in the actual received incremental file. If they are consistent, the data lake public area (BDP) will import it into the partition of the source data table for the current day. After the current day's partition is successfully imported, the data lake public area will merge the bill data of the current day's partition with the bill data corresponding to day T-1 in the table according to the primary key to obtain the full data for the current day. At this point, the bill data middle station 120 has completely migrated the data in the bill system 130 to the data lake public area (BDP), so that the data lake private area (Bdsp) can process these data into various wide tables for the terminal to generate the required reports. This embodiment can improve the accuracy of the bill data in the data lake public area by providing a verification file.

[0046] In some embodiments, before processing the bill information tables contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators and storing them in step S202, the method may further include the following steps:

[0047] Analyze bill business information of various bill behaviors to obtain predetermined dimensions and predetermined indicators corresponding to each bill behavior; send the predetermined dimensions and predetermined indicators corresponding to each bill behavior to the terminal; based on the correction information of the predetermined dimensions and predetermined indicators corresponding to each bill behavior fed back by the terminal, form the dimensions and indicators corresponding to each bill behavior.

[0048] The main feature of this embodiment is that the bill data center 120 can analyze the bill business information of various bill behaviors to obtain the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior. The predetermined dimensions and predetermined indicators are not directly used as dimensions and indicators for users to use when making reports. Instead, the bill data center 120 first sends the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior obtained by the analysis to the terminal 110. The user can provide correction information for the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior on the terminal 110. The correction information may include the user's modification of one or some predetermined dimensions and predetermined indicators. The terminal 110 then feeds back the correction information to the bill center. According to the data middle platform 120, the bill data middle platform 120 finally forms the dimensions and indicators corresponding to each type of bill behavior based on these trimmed information. For example, the bill data middle platform 120 can use the dimensions and indicators modified by the user for each type of bill behavior as the final dimensions and indicators corresponding to each type of bill behavior. This can ensure that the dimensions and indicators of each wide table used for users to generate reports are dimensions and indicators that can be understood by business personnel and other users. The dimensions and indicators can also be specifically displayed with Chinese names that can be understood by business personnel, so that there are no obstacles for business and analysts to use. In conjunction with BI report customization, the business can independently complete report generation and other operations without the support of developers.

[0049] In the above embodiment, the dimensions and indicators of various wide tables are described by taking the wide table of customer period summary information and the wide table of institution period summary information that can be included in these wide tables as examples:

[0050] Specifically, the broad table for periodic customer summary information can be a broad table for daily customer summary information. This broad table is a customer-specific indicator table that incorporates customer-related indicators. It processes customer-related information from the bill system daily, such as whether there are borrowers, the daily issuance amount (bills issued), the daily bank bill acceptance amount, the daily receipt amount (bills issued), the daily endorsement amount, the daily endorsed amount, the daily bill pool custody amount, the daily bill pool pledge amount, the daily bill pool custody balance, the daily bill pool pledge financing amount, the daily discount amount to our bank, the daily discount amount to other banks, and the daily payment reminder amount. The broad table for daily customer summary information covers statistical information for all customer dimensions and time periods (for the current day, month, or year). For customer-specific queries, businesses only need to select the corresponding indicator to create a report, eliminating the need to develop a separate functional module for each requirement. If adjustments are needed to the developed report, they can be made directly. Secondly, the wide table of daily customer summary information is the result of T-1 batch processing. When customizing the business, you can directly select the required dimensions and indicators without having to deal with complex association logic. When querying the business, the system no longer needs to spend time calculating and can quickly find the processed indicators.

[0051] Among them, the wide table of summary information of each period of the institution can specifically be the wide table of daily summary information of the institution. The wide table of daily summary information of the institution is an indicator table of the institution dimension. The indicators related to the institution are included in this table, and the information related to the institution in the bill system is processed every day, such as: summary date, institution code, affiliated second-level bank, affiliated first-level bank, affiliated branch, discount balance, rediscount balance, buy-back balance, sell-back balance, rediscount balance, discount transaction volume, rediscount buyout transaction volume, rediscount buyout transaction volume (outside the system), buy-back transaction volume, rediscount sell-out transaction volume, rediscount sell-out transaction volume (outside the system), sell-back transaction volume, rediscount transaction volume, number of discount customers, number of rediscount buyout transaction customers, number of rediscount buyout transaction customers (outside the system), number of buy-back transaction customers, number of rediscount sell-out transaction customers, rediscount sell-out Number of trading customers (outside the system), number of sell-repurchase transaction customers, number of discount transactions, number of rediscount buyout transactions, number of rediscount buyout transactions (outside the system), number of buy-back transactions, number of rediscount sell-out transactions, number of rediscount sell-out transactions (outside the system), number of sell-back transactions, number of rediscount transactions, non-performing asset ratio of bills, number of non-performing assets, balance of non-performing assets, number of overdue assets, amount of overdue assets, interest income from discounting from the beginning of the year to date, price difference income from discounting from the beginning of the year to date, interest income from rediscounting from the beginning of the year to date, price difference income from rediscounting from the beginning of the year to date, interest income from buy-back transactions from the beginning of the year to date, rate of return from discounting from the beginning of the year to date, rate of return from buy-back transactions from the beginning of the year to date, amount of bank bill acceptances, amount issued (issued), amount received (issued), endorsement amount, endorsed amount, amount presented for payment, amount of bills in custody in the bill pool, amount pledged in the bill pool, balance of bills in custody in the bill pool, etc. The wide table of daily summary information for institutions covers statistical information for each dimension and time period (current day / month / quarter / year). For any indicator query related to the bill institution dimension, businesses only need to select the corresponding indicator to create a report, eliminating the need to develop a functional module for each requirement. If adjustments to the developed report are necessary, they can be made directly. Furthermore, the wide table of daily customer summary information is the result of T-1 batch processing. When customizing a business, the required dimensions and indicators can be directly selected without having to deal with complex correlation logic. When performing business queries, the system no longer requires time-consuming calculations and can quickly retrieve processed indicators.

[0052] On the whole, the bill data processing method provided in this application realizes and strengthens the construction of the bill data middle platform, continuously accumulates reusable data capabilities, enables data to provide service capability support for bill products in operations, marketing, risk control, etc., and effectively plays the role of data in empowering business and promoting business development. Specifically, the method provided by this application can reduce the problem of repeated development in the construction of the bill system and improve the speed of realizing bill business needs. The big data bill middle-end data processing and storage method can develop all bill businesses at one time, and pre-divide the bill data into multiple wide tables according to various bill behaviors. Business personnel can subsequently use a simple drag-and-drop method to submit and display reports based on the integrated multiple wide tables on the terminal. There is no need to submit requirements to the development, and no need to wait to realize statistical analysis reports and other functions. For example, business personnel and data analysts often have report processing and query needs. This application can pre-integrate hundreds of business tables into more than a dozen wide tables according to bill behaviors, and implement complex association logic in batches of wide table processing, so that business personnel and data analysts do not have to face hundreds of business tables and complex logic, reducing the time spent by business personnel on manual data processing, and the query speed is also significantly improved. Moreover, various wide tables correspond to dimensions and indicators that business personnel can understand, and can be displayed with Chinese names that business personnel can understand, making it easy to use. Combined with report customization, it can independently complete functions such as report production, regulatory feedback, and daily queries without the support of developers.

[0053] It should be understood that, although the various steps in the flowcharts involved in the various embodiments described above are displayed in sequence according to the instructions of the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least a portion of the steps in the flowcharts involved in the various embodiments described above can include multiple steps or multiple stages, and these steps or stages are not necessarily executed and completed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a portion of steps or stages in other steps.

[0054] Based on the same inventive concept, embodiments of the present application also provide a bill data processing device for implementing the aforementioned bill data processing method. The solution provided by this device is similar to the solution described in the aforementioned method. Therefore, the specific limitations of one or more bill data processing device embodiments provided below can be found in the limitations of the bill data processing method described above and will not be further elaborated here.

[0055] In one embodiment, Figure 5As shown, a bill data processing device is provided, which can be applied to a bill data middle platform. The device 500 may include:

[0056] The data import module 501 is used to import the bill data stored in the bill system into the public area of ​​the data lake, so that the public area of ​​the data lake loads the bill data into the posting source data table;

[0057] The wide table processing module 502 is configured to instruct the private zone of the data lake to process and store the bill information tables contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators after the public zone of the data lake loads the bill data into the source data table.

[0058] The wide table providing module 503 is configured to provide the terminal with multiple wide tables stored in the private area of ​​the data lake upon receiving a report generation request sent by the terminal, so that the terminal can generate the report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0059] In one embodiment, the data import module 501 is used to obtain source bill data exported from the bill system according to a set time period; obtain bill data with incremental changes under current time conditions from the source bill data and form an incremental file carrying the bill data; and send the incremental file carrying the bill data to the public area of ​​the data lake.

[0060] In one embodiment, the data import module 501 is used to generate a verification file corresponding to the incremental file; send the incremental file and the verification file to the public area of ​​the data lake, so that after the public area of ​​the data lake receives the incremental file and the verification file, it uses the verification file to verify the incremental file, and if the verification passes, imports the incremental file into the source data table.

[0061] In one embodiment, the verification file records the file feature information of the incremental file; the public area of ​​the data lake is also used to extract the file feature information of the received incremental file as the information to be verified. If it is determined that the information to be verified is consistent with the file feature information recorded in the received verification file, it is determined that the verification is passed.

[0062] In one embodiment, the device 500 may also include: a dimension indicator forming unit, which is used to perform bill business information analysis on the various types of bill behaviors to obtain the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior; send the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior to the terminal; and form the dimensions and indicators corresponding to each type of bill behavior based on the correction information of the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior fed back by the terminal.

[0063] In one embodiment, the multiple wide tables include: a wide table of customer summary information per period, a wide table of institution summary information per period, a wide table of bill purchase transaction details per period, a wide table of bill sale transaction details per period, a wide table of bill inventory details per period, a wide table of bill pool business details, a wide table of bill endorsement transaction details, a wide table of bill circulation details per period, a wide table of bill acceptance details, a wide table of bill payment reminders, and a wide table of bill pledge details.

[0064] Each module in the aforementioned bill data processing device may be implemented in whole or in part through software, hardware, or a combination thereof. Each module may be embedded in or independent of a processor in a computer device in the form of hardware, or may be stored in a memory in the computer device in the form of software, so that the processor can call and execute the corresponding operations of each module.

[0065] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 6 As shown. The computer device includes a processor, a memory, and a network interface connected via a system bus. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The database of the computer device is used to store data such as bill data and wide tables. The network interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a method for processing bill data is implemented.

[0066] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0067] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0068] Import the bill data stored in the bill system into the public area of ​​the data lake, so that the public area of ​​the data lake loads the bill data into the source data table; instruct the private area of ​​the data lake to process the bill information tables contained in the source data table into multiple wide tables and store them according to various bill behaviors and based on corresponding preset dimensions and indicators after the public area of ​​the data lake loads the bill data into the source data table; when receiving a report generation request sent by the terminal, provide the terminal with the multiple wide tables stored in the private area of ​​the data lake, so that the terminal can generate the report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0069] In one embodiment, when the processor executes the computer program, it also implements the following steps: obtaining source bill data exported from the bill system according to a set time period; obtaining incrementally changed bill data under current time conditions from the source bill data and forming an incremental file carrying the bill data; and sending the incremental file carrying the bill data to the public area of ​​the data lake.

[0070] In one embodiment, when the processor executes the computer program, the processor also implements the following steps: generating a verification file corresponding to the incremental file; sending the incremental file and the verification file to the public area of ​​the data lake, so that after the public area of ​​the data lake receives the incremental file and the verification file, it uses the verification file to verify the incremental file, and if the verification passes, imports the incremental file into the source data table.

[0071] In one embodiment, the verification file records the file feature information of the incremental file; the public area of ​​the data lake is also used to extract the file feature information of the received incremental file as the information to be verified. If it is determined that the information to be verified is consistent with the file feature information recorded in the received verification file, it is determined that the verification is passed.

[0072] In one embodiment, when the processor executes the computer program, it also implements the following steps: performing bill business information analysis on the various types of bill behaviors to obtain predetermined dimensions and predetermined indicators corresponding to each type of bill behavior; sending the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior to the terminal; and forming the dimensions and indicators corresponding to each type of bill behavior based on the correction information of the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior fed back by the terminal.

[0073] In one embodiment, the multiple wide tables include: a wide table of customer summary information per period, a wide table of institution summary information per period, a wide table of bill purchase transaction details per period, a wide table of bill sale transaction details per period, a wide table of bill inventory details per period, a wide table of bill pool business details, a wide table of bill endorsement transaction details, a wide table of bill circulation details per period, a wide table of bill acceptance details, a wide table of bill payment reminders, and a wide table of bill pledge details.

[0074] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented: importing bill data stored in a bill system into a public area of ​​a data lake, so that the public area of ​​the data lake loads the bill data into a source data table; instructing a private area of ​​the data lake to process and store each bill information table contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators after the public area of ​​the data lake loads the bill data into the source data table; and upon receiving a report generation request sent by a terminal, providing the multiple wide tables stored in the private area of ​​the data lake to the terminal, so that the terminal can generate the report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0075] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining source bill data exported from the bill system according to a set time period; obtaining incrementally changed bill data under current time conditions from the source bill data and forming an incremental file carrying the bill data; and sending the incremental file carrying the bill data to the public area of ​​the data lake.

[0076] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: generating a verification file corresponding to the incremental file; sending the incremental file and the verification file to the public area of ​​the data lake, so that after the public area of ​​the data lake receives the incremental file and the verification file, it uses the verification file to verify the incremental file, and if the verification passes, imports the incremental file into the source data table.

[0077] In one embodiment, the verification file records the file feature information of the incremental file; the public area of ​​the data lake is also used to extract the file feature information of the received incremental file as the information to be verified. If it is determined that the information to be verified is consistent with the file feature information recorded in the received verification file, it is determined that the verification is passed.

[0078] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: performing bill business information analysis on the various types of bill behaviors to obtain predetermined dimensions and predetermined indicators corresponding to each type of bill behavior; sending the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior to the terminal; and forming the dimensions and indicators corresponding to each type of bill behavior based on the correction information of the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior fed back by the terminal.

[0079] In one embodiment, the multiple wide tables include: a wide table of customer summary information per period, a wide table of institution summary information per period, a wide table of bill purchase transaction details per period, a wide table of bill sale transaction details per period, a wide table of bill inventory details per period, a wide table of bill pool business details, a wide table of bill endorsement transaction details, a wide table of bill circulation details per period, a wide table of bill acceptance details, a wide table of bill payment reminders, and a wide table of bill pledge details.

[0080] In one embodiment, a computer program product is provided, comprising a computer program that, when executed by a processor, implements the following steps: importing bill data stored in a bill system into a public area of ​​a data lake, so that the public area of ​​the data lake loads the bill data into a source data table; instructing a private area of ​​the data lake to process and store each bill information table contained in the source data table into multiple wide tables according to various bill behaviors and based on corresponding preset dimensions and indicators after the public area of ​​the data lake loads the bill data into the source data table; and upon receiving a report generation request sent by a terminal, providing the multiple wide tables stored in the private area of ​​the data lake to the terminal, so that the terminal can generate a report required by the user based on the multiple wide tables stored in the private area of ​​the data lake.

[0081] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining source bill data exported from the bill system according to a set time period; obtaining incrementally changed bill data under current time conditions from the source bill data and forming an incremental file carrying the bill data; and sending the incremental file carrying the bill data to the public area of ​​the data lake.

[0082] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: generating a verification file corresponding to the incremental file; sending the incremental file and the verification file to the public area of ​​the data lake, so that after the public area of ​​the data lake receives the incremental file and the verification file, it uses the verification file to verify the incremental file, and if the verification passes, imports the incremental file into the source data table.

[0083] In one embodiment, the verification file records the file feature information of the incremental file; the public area of ​​the data lake is also used to extract the file feature information of the received incremental file as the information to be verified. If it is determined that the information to be verified is consistent with the file feature information recorded in the received verification file, it is determined that the verification is passed.

[0084] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: performing bill business information analysis on the various types of bill behaviors to obtain predetermined dimensions and predetermined indicators corresponding to each type of bill behavior; sending the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior to the terminal; and forming the dimensions and indicators corresponding to each type of bill behavior based on the correction information of the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior fed back by the terminal.

[0085] In one embodiment, the multiple wide tables include: a wide table of customer summary information per period, a wide table of institution summary information per period, a wide table of bill purchase transaction details per period, a wide table of bill sale transaction details per period, a wide table of bill inventory details per period, a wide table of bill pool business details, a wide table of bill endorsement transaction details, a wide table of bill circulation details per period, a wide table of bill acceptance details, a wide table of bill payment reminders, and a wide table of bill pledge details.

[0086] Those skilled in the art will understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be a general-purpose processor, a central processing unit, a graphics processing unit, a digital signal processor, a programmable logic unit, a data processing logic unit based on quantum computing, etc., but are not limited to these.

[0087] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0088] It should be noted that the bill data processing method and device provided in this application can be used for bill processing in the financial field, and can also be used for bill processing in any field other than the financial field. The application field of the bill data processing method and device provided in this application is not limited.

[0089] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0090] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A method for processing bill data, characterized in that: Applied to the bill data middle platform, the method includes: Importing bill data stored in the bill system into the public area of ​​the data lake so that the public area of ​​the data lake loads the bill data into the source data table, including: obtaining source bill data exported from the bill system according to a set time period; obtaining incremental bill data under the current time condition from the source bill data and forming an incremental file carrying the bill data; and sending the incremental file carrying the bill data to the public area of ​​the data lake; wherein, after forming an incremental file carrying the bill data, generating a verification file corresponding to the incremental file; and sending the incremental file carrying the bill data to the public area of ​​the data lake, comprising: sending the incremental file and the verification file to the public area of ​​the data lake, so that after the public area of ​​the data lake receives the incremental file and the verification file, the incremental file is verified using the verification file, and if the verification passes, the incremental file is imported into the posting source data table; Analyzing bill business information for each type of bill behavior to obtain predetermined dimensions and predetermined indicators corresponding to each type of bill behavior; sending the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior to a terminal; and forming the dimensions and indicators corresponding to each type of bill behavior based on correction information for the predetermined dimensions and predetermined indicators corresponding to each type of bill behavior fed back by the terminal; The bill data middleware instructs the private data lake area configured by it to wait until the public data lake area successfully loads the bill data into the source data table. Then, the private data lake area starts to call a batch job to process the bill information tables contained in the source data table into multiple wide tables according to the various bill behaviors and based on the corresponding preset dimensions and indicators, and store them. When a report generation request sent by the terminal is received, multiple wide tables stored in the private area of ​​the data lake are provided to the terminal, so that the terminal can generate the report required by the user according to the user's own needs and the multiple wide tables stored in the private area of ​​the data lake.

2. The method according to claim 1, characterized in that The verification file records the file feature information of the incremental file; the public area of ​​the data lake is also used to extract the file feature information of the received incremental file as the information to be verified. If it is determined that the information to be verified is consistent with the file feature information recorded in the received verification file, it is determined that the verification is passed.

3. The method according to any one of claims 1 to 2, characterized in that The multiple wide tables include: a wide table of customer summary information per period, a wide table of institution summary information per period, a wide table of bill purchase transaction details per period, a wide table of bill sale transaction details per period, a wide table of bill inventory details per period, a wide table of bill pool business details, a wide table of bill endorsement transaction details, a wide table of bill circulation details per period, a wide table of bill acceptance details, a wide table of bill payment reminders, and a wide table of bill pledge details.

4. A bill data processing device, characterized in that: Applied to the bill data middle platform, the device includes: The data import module is used to import the bill data stored in the bill system into the public area of ​​the data lake, so that the public area of ​​the data lake loads the bill data into the source data table, including: obtaining source bill data exported from the bill system according to a set time period; obtaining incremental bill data under the current time condition from the source bill data and forming an incremental file carrying the bill data; and sending the incremental file carrying the bill data to the public area of ​​the data lake; wherein, after forming an incremental file carrying the bill data, generating a verification file corresponding to the incremental file; and sending the incremental file carrying the bill data to the public area of ​​the data lake, comprising: sending the incremental file and the verification file to the public area of ​​the data lake, so that after the public area of ​​the data lake receives the incremental file and the verification file, the incremental file is verified using the verification file, and if the verification passes, the incremental file is imported into the posting source data table; A dimension indicator forming unit is configured to analyze bill business information of various bill behaviors to obtain predetermined dimensions and predetermined indicators corresponding to each of the bill behaviors; transmit the predetermined dimensions and predetermined indicators corresponding to each of the bill behaviors to a terminal; and form the dimensions and indicators corresponding to each of the bill behaviors based on correction information fed back by the terminal for the predetermined dimensions and predetermined indicators corresponding to each of the bill behaviors; A wide table processing module is used for the bill data middle platform to instruct the private area of ​​the data lake configured by itself to wait for the public area of ​​the data lake to successfully load the bill data into the source data table. The private area of ​​the data lake then starts to call a batch job to process and store the bill information tables contained in the source data table into multiple wide tables according to the various bill behaviors and based on corresponding preset dimensions and indicators. A wide table providing module is used to provide the terminal with multiple wide tables stored in the private area of ​​the data lake when receiving a report generation request sent by the terminal, so that the terminal can generate the report required by the user according to the user's own needs and the multiple wide tables stored in the private area of ​​the data lake.

5. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 3 are implemented.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 3 are implemented.

7. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 3 are implemented.

Images