Data taking and certificate issuing method and device based on bottom data, equipment and storage medium
By generating a fallback data retrieval task by acquiring data retrieval condition information and rule configuration information, the problem of insufficient scenario standardization in financial voucher production methods is solved, and efficient and accurate financial voucher generation is achieved.
Patent Information
- Application Number
- CN202111229782.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-10-22
- Publication Date
- 2026-01-06
- Estimated Expiration
- 2041-10-22
AI Technical Summary
Existing financial certificate preparation methods suffer from insufficient standardization when dealing with special data, resulting in the inability to accurately and promptly complete the data retrieval and certificate preparation for massive amounts of data.
By acquiring data retrieval condition information, extracting slice information and rule configuration information, a fallback data retrieval task is generated and distributed to the application server using a pre-built message middleware. The data retrieval task is executed on the server to obtain the business data table, perform filtering and deduplication, and finally generate financial vouchers.
It improved the efficiency of data retrieval and the accuracy and standardization of financial voucher production, and realized the automated generation of financial vouchers.
Smart Images

Figure CN113934556B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of artificial intelligence, and in particular to a method, apparatus, device, and storage medium for obtaining and creating certificates based on catch-all data. Background Technology
[0002] With the development of computer technology, more and more data relies on computer processing. In processing covert data, the precise calculations and rapid computation of computers are also needed to handle complex and massive amounts of data. In financial accounting systems, certificates are generated daily based on different covert data according to business needs.
[0003] Currently, financial accounting systems can only extract and generate certificates from normal business data. However, in reality, such as the insurance industry, a large amount of data is quite special and cannot be extracted and generated from it normally, leading to inaccurate financial certificate generation. Moreover, the volume of this special data is massive. It is impossible to complete the data extraction and certificate generation within the stipulated time. Furthermore, the data types involved in the business scenarios are diverse, making it impossible to process them uniformly using standardized rules. Therefore, existing financial certificate generation methods suffer from insufficient standardization across different scenarios. Summary of the Invention
[0004] The main objective of this invention is to address the problem of insufficient scenario standardization in existing financial certificate issuance methods.
[0005] The first aspect of this invention provides a method for data retrieval and certificate creation based on fallback data, comprising: acquiring data retrieval condition information, and extracting slice information and rule configuration information of business scenarios from the data retrieval condition information; generating a fallback data retrieval task based on the slice information and the rule configuration information, and distributing the fallback data retrieval task to the corresponding application server using a pre-built message middleware; executing the corresponding fallback data retrieval task on the application server and acquiring the business data table corresponding to the application server; performing fallback data retrieval on the business data table on the application server to obtain the fallback data corresponding to the application server; and using the fallback data for certificate creation processing to obtain the financial voucher corresponding to the application server.
[0006] Optionally, in a first implementation of the first aspect of the present invention, the step of extracting the slice information and the rule configuration information of the business scenario from the data retrieval condition information includes: extracting multiple slice fields from the data retrieval condition information and generating slice information using each slice field; extracting scenario identification information from the data retrieval condition information and matching the rule configuration information associated with the scenario identification information.
[0007] Optionally, in a second implementation of the first aspect of the present invention, after executing the corresponding fallback data retrieval task on the application server and obtaining the business data table corresponding to the application server, the method further includes: counting the amount of data in the business data table and determining whether the amount of data is greater than a preset data amount threshold; if it is greater, configuring the index nodes corresponding to each slice field and constructing a tree diagram using each index node; performing recursive pagination processing on the data in the business data table according to the tree diagram and the data amount threshold; and dividing the business data table into multiple new business data tables according to the result of the recursive classification processing.
[0008] Optionally, in a third implementation of the first aspect of the present invention, the step of performing a fallback retrieval of the business data table on the application server to obtain the fallback data corresponding to the application server includes:
[0009] Obtain a first filter table and a second filter table corresponding to the business data table on the application server; filter the business data table according to the first filter table, and determine the fallback data with the same slice field in the filtered business data table; perform deduplication processing on the fallback data with the same slice field, and use the deduplicated business data table as a temporary data table; filter the temporary data table according to the second filter table, and obtain the fallback data corresponding to the application server from the filtered temporary data table.
[0010] Optionally, in the fourth implementation of the first aspect of the present invention, the step of distributing the fallback data retrieval task to the corresponding application server using a pre-set message middleware includes: sending the fallback data retrieval task to the pre-set message middleware; publishing the fallback data retrieval task to the message queue corresponding to the message middleware according to the pre-set subscription information; selecting an application server that subscribes to the message queue; and sending the fallback data to the selected application server.
[0011] Optionally, in a fifth implementation of the first aspect of the present invention, the step of using the fallback data to perform certificate production processing to obtain the financial voucher corresponding to the application server includes: determining the business type corresponding to the application server, and obtaining a certificate production template corresponding to the business type and a configuration file corresponding to the certificate production template; reading the filling rules corresponding to the field names to be filled in the certificate production template from the configuration file; calculating the field values corresponding to each field name to be filled according to the filling rules and the fallback data; and inputting each field value into the corresponding field name to be filled in the certificate production template to generate the corresponding financial voucher.
[0012] A second aspect of the present invention provides a data retrieval and certificate creation device based on fallback data, comprising: an extraction module for acquiring data retrieval condition information and extracting slice information and rule configuration information of business scenarios from the data retrieval condition information; a generation module for generating a fallback data retrieval task based on the slice information and the rule configuration information, and distributing the fallback data retrieval task to a corresponding application server using a pre-set message middleware; an execution module for executing the corresponding fallback data retrieval task on the application server and acquiring a business data table corresponding to the application server; a data retrieval module for performing fallback data retrieval on the business data table on the application server to obtain fallback data corresponding to the application server; and a certificate creation module for performing certificate creation processing using the fallback data to obtain financial vouchers corresponding to the application server.
[0013] Optionally, in a first implementation of the second aspect of the present invention, the extraction module includes: a slice extraction unit, used to extract multiple slice fields from the data retrieval condition information and generate slice information using each slice field; and a rule extraction unit, used to extract scene identification information from the data retrieval condition information and match rule configuration information associated with the scene identification information.
[0014] Optionally, in a second implementation of the second aspect of the present invention, the data retrieval and certificate generation device based on fallback data further includes a pagination module, used for: counting the amount of data in the business data table and determining whether the amount of data is greater than a preset data amount threshold; if it is greater, configuring index nodes corresponding to each slice field and constructing a tree diagram using each index node; performing recursive pagination processing on the data in the business data table according to the tree diagram and the data amount threshold; and dividing the business data table into multiple new business data tables according to the result of the recursive classification processing.
[0015] Optionally, in a third implementation of the second aspect of the present invention, the data retrieval module includes: an acquisition unit, configured to acquire a first filter table and a second filter table corresponding to the business data table on the application server; a first filtering unit, configured to filter the business data table according to the first filter table and determine the fallback data with the same slice field in the filtered business data table; a deduplication unit, configured to deduplicate the fallback data with the same slice field and use the deduplicated business data table as a temporary data table; and a second filtering unit, configured to filter the temporary data table according to the second filter table and acquire the fallback data corresponding to the application server from the filtered temporary data table.
[0016] Optionally, in a fourth implementation of the second aspect of the present invention, the generation module includes: a publishing unit, configured to send the fallback data retrieval task to a preset message middleware, and publish the fallback data retrieval task to a message queue corresponding to the message middleware according to preset subscription information; and a sending unit, configured to select an application server that subscribes to the message queue, and send the fallback data to the selected application server.
[0017] Optionally, in a fifth implementation of the second aspect of the present invention, the certificate production module includes: a determining unit, configured to determine the business type corresponding to the application server, and obtain a certificate production template corresponding to the business type and a configuration file corresponding to the certificate production template; a reading unit, configured to read the filling rules corresponding to the field names to be filled in the certificate production template from the configuration file; a calculation unit, configured to calculate the field values corresponding to each of the field names to be filled according to the filling rules and the catch-all data; and a generating unit, configured to input each of the field values into the corresponding field names to be filled in the certificate production template to generate corresponding financial vouchers.
[0018] A third aspect of the present invention provides a data retrieval and certificate production device based on fallback data, comprising: a memory and at least one processor, wherein the memory stores instructions; the at least one processor invokes the instructions in the memory to cause the data retrieval and certificate production device based on fallback data to execute the aforementioned data retrieval and certificate production method based on fallback data.
[0019] A fourth aspect of the present invention provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the above-described method for obtaining evidence based on catch-all data.
[0020] In the technical solution provided by this invention, the range and method of data retrieval are determined by obtaining the data retrieval condition information, which are represented by slice information and rule configuration information, respectively. Then, a fallback data retrieval task is generated using the two information to perform fallback data retrieval on the corresponding application server. Finally, the fallback data obtained from the fallback data retrieval is used to create financial vouchers, thereby achieving automated generation of financial vouchers and improving the standardization of the voucher creation process. Attached Figure Description
[0021] Figure 1 This is a schematic diagram of the first embodiment of the data retrieval and certificate production method based on catch-all data in this invention.
[0022] Figure 2 This is a schematic diagram of the second embodiment of the data retrieval and certificate production method based on catch-all data in this invention.
[0023] Figure 3This is a schematic diagram of the third embodiment of the data retrieval and certificate production method based on catch-all data in this invention.
[0024] Figure 4 This is a schematic diagram of an embodiment of the data retrieval and certificate generation device based on fallback data in this invention.
[0025] Figure 5 This is a schematic diagram of another embodiment of the data retrieval and certificate production device based on fallback data in this invention.
[0026] Figure 6 This is a schematic diagram of an embodiment of the data retrieval and certificate production device based on fallback data in this invention. Detailed Implementation
[0027] This invention provides a method, apparatus, device, and storage medium for data retrieval and certificate creation based on fallback data. The method involves acquiring data retrieval condition information and extracting slice information and rule configuration information for business scenarios from the data retrieval condition information; generating fallback data retrieval tasks based on the slice information and rule configuration information; distributing these tasks to corresponding application servers using a pre-built message middleware; executing the corresponding fallback data retrieval tasks on the application servers and acquiring the corresponding business data tables; performing fallback data retrieval on the business data tables on the application servers to obtain the fallback data corresponding to the application servers; and using the fallback data for certificate creation to obtain the corresponding financial vouchers for the application servers. This invention improves the efficiency of fallback data retrieval while simultaneously enhancing the accuracy and standardization of financial certificate creation.
[0028] The terms “first,” “second,” “third,” “fourth,” etc. (if present) in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms “comprising” or “having,” and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0029] For ease of understanding, the specific process of the embodiments of the present invention is described below. Please refer to [link / reference]. Figure 1 The first embodiment of the data retrieval and certificate creation method based on catch-all data in this invention includes:
[0030] 101. Obtain data retrieval condition information, and extract the slice information and business scenario rule configuration information from the data retrieval condition information;
[0031] It is understood that the executing entity of this invention can be a data retrieval and certificate generation device based on fallback data, or it can be a terminal or a server; no specific limitation is made here. This embodiment of the invention will be described using a server as an example.
[0032] In this embodiment, during the backup data preparation stage, multiple slice fields are created for the backup data, including company segment, business time range, business data update time, etc. The data retrieval conditions here determine the data retrieval range and data retrieval method of the backup data. The data retrieval range is represented by slice information, and the data retrieval method is represented by rule configuration information of the business scenario. Among them, the slice information contains the target slice fields to determine the company, business time, update time, etc. of the data required for financial certificate issuance, and the rule configuration information contains the configuration rules of the data retrieval task to determine the data retrieval method.
[0033] 102. Generate fallback data retrieval tasks based on slice information and rule configuration information, and distribute the fallback data retrieval tasks to the corresponding application servers using a pre-built message middleware;
[0034] In this embodiment, based on the company segment, business time range, and business data update time determined in the slice information, and the data retrieval method determined in the rule configuration information, a specific fallback data retrieval task is generated. This task is then distributed to application servers subscribed to the corresponding topic queues via the existing message queue (MQ) to retrieve fallback data. For example, if the rule configuration information specifies that company segment 019999, within the business time range of 2021-01-01 to 2021-01-02, divides the business data update time range into 5-hour time slices according to the set time slices, the generated fallback data retrieval task is as follows:
[0035] Task 1: SummaryDno: 019999, startDate-endDate: 2021-01-01 to 2021-01-02, startLcd-endLcd: 2021-01-03 15:00:00 to 2021-01-03 20:00:00.
[0036] Task 2: SummaryDno: 019999, startDate-endDate: 2021-01-01 to 2021-01-02, startLcd-endLcd: 2021-01-03 23:00:00 to 2021-01-04 01:00:00.
[0037] Task 3: SummaryDno: 019999, startDate-endDate: 2021-01-01 to 2021-01-02, startLcd-endLcd: 2021-01-04 01:00:00 to 2021-01-04 06:00:00.
[0038] ...
[0039] 103. Execute the corresponding fallback data retrieval task on the application server and obtain the corresponding business data table from the application server;
[0040] In this embodiment, after the fallback data retrieval task is sent to the application server, the application server runs the fallback data retrieval task. Upon execution, it retrieves the business data tables stored in each application server. The corresponding business data table can be found through the various slice fields in the fallback data retrieval task. Different business tables are configured for different business scenarios, facilitating subsequent management and maintenance through configuration.
[0041] 104. Perform fallback data retrieval on the business data table on the application server to obtain the corresponding fallback data on the application server;
[0042] In this embodiment, each application server performs fallback data retrieval from various business data tables according to the fallback data retrieval task to obtain fallback data for financial certificate issuance. During the fallback data retrieval, a unique constraint is set on the fee table to prevent data duplication for certificate issuance. In the data retrieval process, the business data table is associated with the fee table, and conditional filtering is performed to exclude data that has already been retrieved, thus preventing duplicate data retrieval.
[0043] 105. Use catch-all data for certificate generation to obtain the financial vouchers corresponding to the application server.
[0044] In this embodiment, corresponding certificate templates are configured for different application server business types. The corresponding catch-all data needs to be filled in different locations to generate certificates for different application servers and obtain financial vouchers applicable to the application server.
[0045] In this embodiment of the invention, the range and method of data retrieval are determined by obtaining the data retrieval condition information, which are represented by slice information and rule configuration information, respectively. Then, a fallback data retrieval task is generated using both information and rules for the corresponding application server to perform fallback data retrieval. Finally, the fallback data obtained from the fallback data retrieval is used to create financial vouchers, thereby achieving automated generation of financial vouchers and improving the standardization of the voucher creation process.
[0046] Please see Figure 2 The second embodiment of the data retrieval and certificate creation method based on catch-all data in this invention includes:
[0047] 201. Obtain data retrieval condition information, extract multiple slice fields from the data retrieval condition information, and generate slice information using each slice field;
[0048] 202. Extract the scene identification information from the data retrieval condition information and match it with the rule configuration information associated with the scene identification information;
[0049] In this embodiment, the slice fields in the data retrieval condition information include the company segment SummaryDno, the business time range startDate-endDate, and the business data update time startLcd-endLcd. For example, if the company segment (e.g., organization code) of the target company is 019999, the business time range for data retrieval is from 2021-01-01 to 2021-01-02, and the corresponding business data update time is from 2021-01-03 15:00:00 to 2021-01-03 20:00:00, then the generated slice information is: "SummaryDno: 019999, startDate-endDate: 2021-01-01 to 2021-01-02, startLcd-endLcd: 2021-01-03 15:00:00 to 2021-01-03 20:00:00".
[0050] In addition, the rules for financial certificate issuance differ in different scenarios. Here, it is also necessary to match the corresponding rule configuration information based on the scenario identification information specified in the extraction conditions, such as the pre-set sequence code, in order to determine the method of financial certificate issuance. For example, the certificate issuance methods for scenarios such as repurchase, funds, bonds, deposits, wealth management products, foreign exchange forwards, foreign exchange spot, interest rate swaps, and cross-currency swaps are all different, and the corresponding rule configuration information is required to configure the certificate issuance method.
[0051] 203. Generate fallback data retrieval tasks based on slice information and rule configuration information, and distribute fallback data retrieval tasks to the corresponding application servers using a pre-built message middleware;
[0052] 204. Execute the corresponding fallback data retrieval task on the application server and obtain the corresponding business data table from the application server;
[0053] 205. Calculate the amount of data in the business data table and determine whether the amount of data exceeds the preset data volume threshold;
[0054] 206. If it is greater than, then configure the index nodes corresponding to each slice field, and use each index node to build a tree diagram;
[0055] 207. Based on the tree diagram and according to the data volume threshold, perform recursive pagination on the data in the business data table;
[0056] 208. Based on the results of the recursive classification process, divide the business data table into multiple new business data tables;
[0057] In this embodiment, for scenarios with large data volumes, a recursive pagination approach is adopted to perform data stratification and retrieval again, improving the efficiency of concurrent data processing. A pre-set data volume threshold is used as the basis for recursive pagination. For business data tables with a data volume exceeding this threshold, recursive pagination is required. Simultaneously, each subsequent recursive pagination segment is ensured to be smaller than the threshold, thus dividing the original business data table with a large data volume into multiple new business data tables with data volumes not exceeding the threshold.
[0058] 209. Obtain the first and second filter tables on the application server that correspond to the business data tables;
[0059] 210. Filter the business data table according to the first filter table, and determine the catch-all data with the same slice field in the filtered business data table;
[0060] 211. Perform deduplication on the catch-all data with the same slice field, and use the deduplicated business data table as a temporary data table;
[0061] 212. Filter the temporary data table according to the second filter table, and obtain the fallback data corresponding to the application server from the filtered temporary data table;
[0062] In this embodiment, the first filter table can filter business data based on the filtering dimensions involved in the first filtering conditions. For example, if the filtering dimensions involved in the first filter table are order volume, first quarter, and product A, the original data table is filtered based on order volume, first quarter, and product A. That is, the dimension columns of order volume, first quarter, and product A are selected from the business data table for deduplication. For example, each order may have many order status changes. Each order change will record a status data row in the business data table, resulting in multiple records for one order. When querying indicators such as order volume, order IDs with the same filtering dimension only need to be calculated once. Therefore, it is necessary to deduplicate the multiple records with the same order ID to obtain a temporary data table.
[0063] In addition, the temporary data table is filtered based on the second filter table. Since the temporary data table is obtained by filtering the original business data table and deduplicating it based on the first filter condition, filtering the temporary data table based on the second filter table in the filter condition speeds up the data filtering process and improves the data filtering efficiency.
[0064] 213. Use catch-all data for certificate generation to obtain the financial vouchers corresponding to the application server.
[0065] In this embodiment of the invention, different data retrieval conditions are configurable to facilitate subsequent management and maintenance. When the amount of data in the business data table to be processed is too large and exceeds the preset data volume threshold, the business data table can be paginated first, and then the data can be retrieved hierarchically to improve data retrieval efficiency. Then, the first filter table and the second filter table are used to deduplicate the catch-all data to prevent duplicate copying of financial vouchers and waste of computing resources.
[0066] Please see Figure 3 The third embodiment of the data retrieval and certificate creation method based on catch-all data in this invention includes:
[0067] 301. Obtain data retrieval condition information, and extract the slice information and business scenario rule configuration information from the data retrieval condition information;
[0068] 302. Generate a fallback data retrieval task based on slice information and rule configuration information;
[0069] 303. Send the fallback data retrieval task to the pre-defined message middleware, and publish the fallback data retrieval task to the message queue corresponding to the message middleware according to the pre-defined subscription information;
[0070] 304. Select the application server to subscribe to the message queue, and send the fallback data to the selected application server;
[0071] In this embodiment, the fallback data retrieval task is the content published by the producer in the message queue. Here, the message queue where the fallback data retrieval task is published is queried based on the publisher of the fallback data retrieval task and the subscription information registered in the message middleware. A single message queue can simultaneously receive fallback data retrieval tasks published by multiple producers and can simultaneously publish fallback data retrieval tasks to multiple consumers (i.e., application servers). The target message queue for the fallback data retrieval task is determined based on the registered subscription information, and the application server to which the message queue sends the task is then determined, thus triggering the delivery of the fallback data retrieval task. Furthermore, the number of application servers to which the task is delivered can be one or more; no specific limitation is made here.
[0072] 305. Execute the corresponding fallback data retrieval task on the application server and obtain the corresponding business data table from the application server;
[0073] 306. Perform fallback data retrieval on the business data table on the application server to obtain the corresponding fallback data on the application server;
[0074] 307. Determine the business type corresponding to the application server, and obtain the certificate template corresponding to the business type and the configuration file corresponding to the certificate template;
[0075] 308. Read the filling rules corresponding to the field names to be filled in the certificate template from the configuration file;
[0076] 309. Calculate the field values corresponding to each field name to be filled based on the filling rules and the catch-all data;
[0077] 310. Input the values of each field into the corresponding field names in the certificate template to generate the corresponding financial vouchers.
[0078] In this embodiment, the catch-all data to be issued has a corresponding business type. Different catch-all data can correspond to different business types. Different business types can produce different financial vouchers. During the development phase, voucher templates corresponding to the business types are pre-stored. Multiple fields can be set in the voucher template. The field settings in the voucher templates for different business types can be different.
[0079] The server also pre-stores configuration files. These configuration files record the value-filling rules corresponding to the certificate templates. The value-filling rules for different certificate templates can be recorded in the same configuration file or in different configuration files. Based on the value-filling rules, the server extracts the corresponding certificate-making data from the catch-all data to be produced, inputs the extracted data into the certificate template, and generates the financial voucher. The certificate-making data can be obtained directly from the catch-all data or calculated based on it.
[0080] In this embodiment, by extracting corresponding business fields from business data according to preset filling rules, the extracted business fields can be automatically recorded as catch-all data. The business type corresponding to the application server is determined, and the certificate template and configuration file are obtained based on the business type. Then, the configuration file is used to extract the corresponding certificate data from the catch-all data to be issued, and the certificate data is input into the certificate template to generate financial vouchers. In this process, catch-all data can be automatically recorded according to preset filling rules, and corresponding financial vouchers can be automatically generated using the configuration file, the catch-all data to be issued, and the certificate template.
[0081] In this embodiment of the invention, a message queue is used to distribute the fallback data retrieval task, thereby controlling the application server that has subscribed to the corresponding fallback data retrieval task to perform fallback data retrieval processing for use in financial voucher creation, thus enabling rapid processing of fallback data retrieval tasks in different scenarios; at the same time, voucher creation is performed through voucher creation templates and configuration files, and voucher creation can be achieved simply by filling the fallback data into the corresponding positions, thus quickly generating financial vouchers.
[0082] The above describes the data retrieval and certificate creation method based on fallback data in the embodiments of the present invention. The following describes the data retrieval and certificate creation device based on fallback data in the embodiments of the present invention. Please refer to [link to relevant documentation]. Figure 4 One embodiment of the data retrieval and certificate generation device based on fallback data in this invention includes:
[0083] The extraction module 401 is used to obtain data retrieval condition information and extract the slice information and rule configuration information of the business scenario from the data retrieval condition information;
[0084] The generation module 402 is used to generate a fallback data retrieval task based on the slice information and the rule configuration information, and to distribute the fallback data retrieval task to the corresponding application server using a pre-set message middleware.
[0085] The execution module 403 is used to execute the corresponding fallback data retrieval task on the application server and obtain the business data table corresponding to the application server.
[0086] The data retrieval module 404 is used to retrieve data from the business data table on the application server to obtain the corresponding backup data of the application server.
[0087] The certificate generation module 405 is used to perform certificate generation processing using the fallback data to obtain the financial voucher corresponding to the application server.
[0088] In this embodiment of the invention, the range and method of data retrieval are determined by obtaining the data retrieval condition information, which are represented by slice information and rule configuration information, respectively. Then, a fallback data retrieval task is generated using both information and rules for the corresponding application server to perform fallback data retrieval. Finally, the fallback data obtained from the fallback data retrieval is used to create financial vouchers, thereby achieving automated generation of financial vouchers and improving the standardization of the voucher creation process.
[0089] Please see Figure 5 Another embodiment of the data retrieval and certificate generation device based on fallback data in this invention includes:
[0090] The extraction module 401 is used to obtain data retrieval condition information and extract the slice information and rule configuration information of the business scenario from the data retrieval condition information;
[0091] The generation module 402 is used to generate a fallback data retrieval task based on the slice information and the rule configuration information, and to distribute the fallback data retrieval task to the corresponding application server using a pre-set message middleware.
[0092] The execution module 403 is used to execute the corresponding fallback data retrieval task on the application server and obtain the business data table corresponding to the application server.
[0093] The data retrieval module 404 is used to retrieve data from the business data table on the application server to obtain the corresponding backup data of the application server.
[0094] The certificate generation module 405 is used to perform certificate generation processing using the fallback data to obtain the financial voucher corresponding to the application server.
[0095] Specifically, the extraction module 401 includes:
[0096] The slice extraction unit 4011 is used to extract multiple slice fields from the data retrieval condition information and generate slice information using each slice field;
[0097] The rule extraction unit 4012 is used to extract the scene identification information from the data retrieval condition information and match the rule configuration information associated with the scene identification information.
[0098] Specifically, the data retrieval and certificate generation device based on fallback data also includes a pagination module 406, used for:
[0099] The amount of data in the business data table is counted, and it is determined whether the amount of data exceeds a preset data volume threshold.
[0100] If the value is greater than the specified value, then configure the index nodes corresponding to each slice field and construct a tree diagram using each index node.
[0101] Based on the tree diagram, and according to the data volume threshold, the data in the business data table is recursively paginated.
[0102] Based on the results of the recursive classification process, the business data table is divided into multiple new business data tables.
[0103] Specifically, the data retrieval module 404 includes:
[0104] Acquisition unit 4041 is used to acquire the first filter table and the second filter table corresponding to the business data table on the application server;
[0105] The first filtering unit 4042 is used to filter the business data table according to the first filtering table and determine the catch-all data with the same slice field in the filtered business data table.
[0106] Deduplication unit 4043 is used to deduplicatize the bottom data with the same slice field, and uses the deduplicated business data table as a temporary data table.
[0107] The second filtering unit 4044 is used to filter the temporary data table according to the second filtering table, and to obtain the fallback data corresponding to the application server from the filtered temporary data table.
[0108] Specifically, the generation module 402 includes:
[0109] The publishing unit 4021 is used to send the fallback data retrieval task to a preset message middleware and publish the fallback data retrieval task to the message queue corresponding to the message middleware according to the preset subscription information.
[0110] The sending unit 4022 is used to select an application server that subscribes to the message queue and send the fallback data to the selected application server.
[0111] Specifically, the certificate issuance module 405 includes:
[0112] The determining unit 4051 is used to determine the business type corresponding to the application server, and to obtain the certificate template corresponding to the business type and the configuration file corresponding to the certificate template.
[0113] The reading unit 4052 is used to read the filling rules corresponding to the field names to be filled in the certificate template from the configuration file.
[0114] Calculation unit 4053 is used to calculate the field value corresponding to each of the fields to be filled according to the filling rules and the catch-all data;
[0115] The generation unit 4054 is used to input the values of each field into the corresponding field name to be filled in the certificate template to generate the corresponding financial voucher.
[0116] In this embodiment of the invention, different data retrieval conditions are configurable to facilitate subsequent management and maintenance. When the amount of data in the business data table to be processed is too large, exceeding the preset data volume threshold, the business data table can be paginated first, and then the data can be retrieved hierarchically to improve data retrieval efficiency. Then, the backup data is deduplicated through the first and second filter tables to prevent duplicate copying of financial vouchers and waste of computing resources. In addition, the backup data retrieval task is distributed through a message queue to control the application servers that have subscribed to the corresponding backup data retrieval task to perform backup data retrieval processing for use in financial voucher creation, realizing rapid processing of backup data retrieval tasks in different scenarios. At the same time, voucher creation is performed through voucher creation templates and configuration files. Voucher creation can be achieved simply by filling in the backup data in the corresponding positions, quickly generating financial vouchers.
[0117] above Figure 4 and Figure 5 The data retrieval and certificate production device based on fallback data in this embodiment of the invention will be described in detail from the perspective of modular functional entities. The data retrieval and certificate production device based on fallback data in this embodiment of the invention will be described in detail from the perspective of hardware processing.
[0118] Figure 6 This is a schematic diagram of a data retrieval and evidence production device based on fallback data provided in an embodiment of the present invention. The fallback data retrieval and evidence production device 600 can vary significantly due to different configurations or performance. It may include one or more central processing units (CPUs) 610 (e.g., one or more processors) and a memory 620, and one or more storage media 630 (e.g., one or more mass storage devices) storing application programs 633 or data 632. The memory 620 and storage media 630 can be temporary or persistent storage. The program stored in the storage media 630 may include one or more modules (not shown in the diagram), each module including a series of instruction operations on the fallback data retrieval and evidence production device 600. Furthermore, the processor 610 may be configured to communicate with the storage media 630 and execute the series of instruction operations in the storage media 630 on the fallback data retrieval and evidence production device 600.
[0119] The data acquisition and certificate generation device 600 based on fallback data may also include one or more power supplies 640, one or more wired or wireless network interfaces 650, one or more input / output interfaces 660, and / or one or more operating systems 631, such as Windows Server, Mac OS X, Unix, Linux, FreeBSD, etc. Those skilled in the art will understand that... Figure 6 The illustrated data collection and certificate production equipment structure based on catch-all data does not constitute a limitation on data collection and certificate production equipment based on catch-all data. It may include more or fewer components than illustrated, or combine certain components, or have different component arrangements.
[0120] The present invention also provides a data retrieval and certificate production device based on fallback data. The computer device includes a memory and a processor. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor performs the steps of the data retrieval and certificate production method based on fallback data in the above embodiments.
[0121] The present invention also provides a computer-readable storage medium, which can be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium, wherein the computer-readable storage medium stores instructions that, when the instructions are executed on a computer, cause the computer to perform the steps of the data retrieval and evidence creation method based on catch-all data.
[0122] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0123] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0124] The above-described embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for making a certificate based on the data in the bottom of the pocket, characterized in that, The data taking and certificate issuing method based on the bottom-up data comprises the following steps: acquiring data taking condition information, and extracting slice information and rule configuration information of a business scenario in the data taking condition information, wherein the slice information contains a target slice field, and the rule configuration information contains configuration rules of a data taking task; generating a bottom-up data taking task based on the slice information and the rule configuration information, and distributing the bottom-up data taking task to a corresponding application server by using a preset message middleware; executing the corresponding bottom-up data taking task on the application server, and acquiring a business data table corresponding to the application server; performing bottom-up data taking on the business data table on the application server to obtain bottom-up data corresponding to the application server; performing certificate issuing processing by using the bottom-up data to obtain financial vouchers corresponding to the application server.
2. The method for data-based number taking and certificate making according to the bottom data according to claim 1, characterized in that, The extracting of the slice information and the rule configuration information of the business scenario in the data taking condition information comprises the following steps: extracting a plurality of slice fields in the data taking condition information, and generating slice information by using each slice field; extracting scenario identification information in the data taking condition information, and matching rule configuration information associated with the scenario identification information.
3. The method for data-based number taking and certificate making according to claim 2, characterized in that, After the execution of the corresponding bottom-up data taking task on the application server and the acquisition of the business data table corresponding to the application server, the method further comprises the following steps: statistically analyzing the data amount in the business data table, and determining whether the data amount is greater than a preset data amount threshold; if yes, configuring index nodes corresponding to each slice field, and constructing a tree diagram by using each index node; according to the tree diagram, performing recursive paging processing on the data in the business data table according to the data amount threshold; dividing the business data table into a plurality of new business data tables according to the results of the recursive classification processing.
4. The method according to claim 2 or 3, wherein, The bottom-up data taking on the business data table on the application server comprises the following steps: acquiring a first filter table and a second filter table corresponding to the business data table on the application server; filtering the business data table according to the first filter table, and determining bottom-up data with the same slice field in the filtered business data table; performing deduplication processing on the bottom-up data with the same slice field, and taking the deduplicated business data table as a temporary data table; filtering the temporary data table according to the second filter table, and acquiring the bottom-up data corresponding to the application server from the filtered temporary data table.
5. The method for data-based number taking and certificate making according to claim 1, characterized in that, The distribution of the bottom-up data taking task to the corresponding application server by using the preset message middleware comprises the following steps: sending the bottom-up data taking task to the preset message middleware, publishing the bottom-up data taking task to a message queue corresponding to the message middleware according to preset subscription information; selecting an application server subscribed to the message queue, and sending the bottom-up data to the selected application server.
6. The method for making a document based on the bottom data according to any one of claims 1, 2, 3, 5, wherein, The certificate issuing processing by using the bottom-up data to obtain the financial vouchers corresponding to the application server comprises the following steps: determining a business type corresponding to the application server, and acquiring a certificate issuing template corresponding to the business type and a configuration file corresponding to the certificate issuing template; reading a filling value rule corresponding to the to-be-filled field name in the certificate template from the configuration file; calculating a field value corresponding to the to-be-filled field name according to the filling value rule and the bottom-up data; inputting the field value into the to-be-filled field name in the certificate template to generate a corresponding financial voucher.
7. A data-based number-taking certificate issuing device characterized by comprising: The data taking and certificate making device based on bottom-up data comprises: An extraction module is configured to acquire data taking condition information and extract slice information and rule configuration information of a business scenario in the data taking condition information, wherein the slice information contains a target slice field, and the rule configuration information contains a configuration rule of a data taking task; A generation module is configured to generate a bottom-up data taking task based on the slice information and the rule configuration information, and distribute the bottom-up data taking task to a corresponding application server by using a preset message middleware; An execution module is configured to execute a corresponding bottom-up data taking task on the application server and acquire a business data table corresponding to the application server; A data taking module is configured to take data from the business data table on the application server to obtain bottom-up data corresponding to the application server; A certificate making module is configured to perform certificate making processing by using the bottom-up data to obtain a financial voucher corresponding to the application server.
8. The underpinnings data based number taking certificate device according to claim 7, characterized in that, The data taking and certificate making device based on bottom-up data further comprises a paging module configured to: count a data amount in the business data table and determine whether the data amount is greater than a preset data amount threshold; if yes, configure an index node corresponding to each slice field and construct a tree diagram by using each index node; according to the tree diagram, perform recursive paging processing on data in the business data table according to the data amount threshold; according to a result of the recursive classification processing, divide the business data table into a plurality of new business data tables.
9. A data-based number-taking certificate-issuing apparatus, characterized by comprising: The data taking and certificate making device based on bottom-up data comprises a memory and at least one processor, and the memory stores instructions; The at least one processor invokes the instructions in the memory to enable the data taking and certificate making device based on bottom-up data to perform the steps of the data taking and certificate making method based on bottom-up data in any one of claims 1-6.
10. A computer-readable storage medium having stored thereon instructions, the computer-readable storage medium comprising: The instructions are executed by the processor to implement the steps of the data taking and certificate making method based on bottom-up data in any one of claims 1-6.
Citation Information
Patent Citations
Method and device for data processing
CN107103009A
A data processing method and apparatus
CN109032796A