Data reporting method and device, storage medium and computer equipment
By generating a two-dimensional table template that meets the expectations of data supervisors, the problems of inefficiency and error-prone traditional data reporting methods are solved, and more efficient and accurate data reporting is achieved to adapt to complex data supervision needs.
Patent Information
- Application Number
- CN202510144223.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-10
- Publication Date
- 2025-05-30
AI Technical Summary
Traditional data reporting methods rely on manual sorting and manual filling, which are inefficient and prone to errors, making it difficult to meet the complexity and timeliness of modern data supervision.
By responding to the two-dimensional table template configuration instructions, the data needs of the data supervisor are obtained, and based on the data resources in the current data resource pool, the target data dimensions and target supervision indicators are determined, the rows and columns of the two-dimensional table template are configured, and the data fields and data types of each cell to be filled in are generated to meet the expectations of the data supervisor.
It improves the accuracy and efficiency of data reporting, adapts to the complex needs of different data supervisors, and the automated process shortens the data reporting cycle. The structured two-dimensional table template makes the data clearer and easier to understand, ensuring that data type constraints further ensure the accuracy of the data.
Smart Images
Figure CN120068834A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the fields of computer and financial technologies, and particularly to a data reporting method, apparatus, storage medium, and computer device. Background Art
[0002] In the fields of data management and supervision, data reporting is a crucial task, which involves the collection, collation, statistics, and analysis of various data resources by multiple data supervision parties. For example, in the financial field, financial institutions such as banks need to regularly report the data required by the regulatory authorities to the regulatory authorities to ensure that the business operations of financial institutions comply with laws, regulations, and regulatory requirements. These data include, but are not limited to, financial statements, business data, risk data, etc., which help regulatory agencies comprehensively understand the operating conditions and risk levels of financial institutions.
[0003] With the rapid development of information technology, data supervision parties have increasingly higher requirements for the format, content, and accuracy of data reporting. Traditional data reporting methods often rely on manual collation and manual filling of reports. This method is not only inefficient but also error-prone, and it is difficult to meet the complexity and timeliness requirements of modern data supervision. Summary of the Invention
[0004] In view of this, this application provides a data reporting method, apparatus, storage medium, and computer device, which can highly customize a two-dimensional table template according to the specific data requirements of data supervision parties and the data resources in the current data resource pool, ensure that the generated target two-dimensional table template and the data reported according to the target two-dimensional table template fully meet the expectations of data supervision parties, and improve the accuracy of reported data; whether it is data dimension, supervision indicator, data range, or data granularity, it can be flexibly adjusted, and thus can adapt to the complex requirements of different data supervision parties; the automated process can generate reported data faster, thereby shortening the data reporting cycle and improving the overall efficiency; the structured two-dimensional table template makes the data clearer and easier to understand, reducing the ambiguity caused by inconsistent data formats or representation methods; restricting the data type of the data to be filled in each cell to be filled can further ensure the accuracy of the filled data.
[0005] According to one aspect of this application, a data reporting method is provided, including:
[0006] In response to a two-dimensional table template configuration instruction, obtain the data requirements of the data supervision party corresponding to the two-dimensional table template configuration instruction, and based on the data requirements and the data resources in the current data resource pool, determine at least one target data dimension and the target supervision indicators corresponding to each target data dimension, where the target monitoring indicators are used to indicate the processing method for processing the data under the target data dimension;
[0007] Based on the at least one target data dimension and the target supervision indicators corresponding to each target data dimension, configure the rows and columns of the two-dimensional table template according to preset rules. Based on the configured rows and columns, determine the data fields corresponding to each cell to be filled in the two-dimensional table template, and according to the data fields corresponding to each cell to be filled in, set the data type of the data filled in the cell to be filled in. After the setting is completed, obtain the target two-dimensional table template corresponding to the data supervisor, so as to perform data reporting of the data supervisor based on the target two-dimensional table template.
[0008] According to another aspect of the present application, there is provided a data reporting device, including:
[0009] A data acquisition module, configured to, in response to a two-dimensional table template configuration instruction, acquire the data requirements of the data supervisor corresponding to the two-dimensional table template configuration instruction, and based on the data requirements and the data resources in the current data resource pool, determine at least one target data dimension and the target supervision indicators corresponding to each target data dimension, wherein the target monitoring indicator is used to indicate the processing method for processing the data under the target data dimension;
[0010] A two-dimensional table configuration module, configured to, based on the at least one target data dimension and the target supervision indicators corresponding to each target data dimension, configure the rows and columns of the two-dimensional table template according to preset rules, determine the data fields corresponding to each cell to be filled in the two-dimensional table template based on the configured rows and columns, and according to the data fields corresponding to each cell to be filled in, set the data type of the data filled in the cell to be filled in. After the setting is completed, obtain the target two-dimensional table template corresponding to the data supervisor, so as to perform data reporting of the data supervisor based on the target two-dimensional table template.
[0011] According to yet another aspect of the present application, there is provided a storage medium, on which a computer program is stored, and when the program is executed by a processor, the above-mentioned data reporting method is implemented.
[0012] According to still another aspect of the present application, there is provided a computer device, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor. When the processor executes the program, the above-mentioned data reporting method is implemented.
[0013] With the above technical solution, a data reporting method, device, storage medium, and computer device provided by this application can, first, obtain the specific data requirements of the data supervisor for the reported data after receiving a two-dimensional table template configuration instruction. Subsequently, based on the data requirements of the data supervisor and the data resources in the current data resource pool, it can be determined which data dimensions are required by the data supervisor and are available, and such data dimensions are used as target data dimensions, and the supervision indicators required by the data supervisor for each target data dimension are used as the target supervision indicators corresponding to the target data dimension. Then, according to the determined target data dimensions and target supervision indicators, the rows and columns of the two-dimensional table template can be configured according to preset rules. Subsequently, it can also be determined the data fields corresponding to each cell to be filled, and the data type of the data filled in each cell to be filled can be set according to the corresponding data field. After completing all the above steps, a target two-dimensional table template that meets the requirements of the data supervisor can be generated immediately. Subsequently, this target two-dimensional table template can be used to extract data from the data resource pool and fill it into the corresponding cells, thereby generating a complete reported two-dimensional table. The embodiments of this application can highly customize the two-dimensional table template according to the specific data requirements of the data supervisor and the data resources in the current data resource pool, ensure that the generated target two-dimensional table template and the data reported according to the target two-dimensional table template fully meet the expectations of the data supervisor, and improve the accuracy of the reported data; whether it is data dimensions, supervision indicators, data ranges, or data granularity, it can be flexibly adjusted, and thus can adapt to the complex requirements of different data supervisors; the automated process can generate reported data faster, thereby shortening the data reporting cycle and improving the overall efficiency; the structured two-dimensional table template makes the data clearer and easier to understand, reducing the ambiguity caused by inconsistent data formats or representation methods; restricting the data type of the data filled in each cell to be filled can further ensure the accuracy of the filled data.
[0014] The above description is only an overview of the technical solution of this application. In order to be able to understand the technical means of this application more clearly, it can be implemented according to the content of the specification. And in order to make the above and other purposes, features, and advantages of this application more obvious and understandable, the following specifically enumerates the specific implementation manners of this application. Brief Description of the Drawings
[0015] The drawings described herein are used to provide a further understanding of this application and constitute a part of this application. The illustrative embodiments of this application and their descriptions are used to explain this application and do not constitute an improper limitation of this application. In the drawings:
[0016] Figure 1 shows a schematic flow chart of a data reporting method provided by an embodiment of this application;
[0017] Figure 2It shows a schematic flowchart of another data reporting method provided by an embodiment of the present application;
[0018] Figure 3 It shows a schematic structural diagram of a data reporting device provided by an embodiment of the present application;
[0019] Figure 4 It shows a schematic structural diagram of a device of a computer device provided by an embodiment of the present application. Detailed implementation manners
[0020] The present application will be described in detail below with reference to the accompanying drawings and in combination with embodiments. It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments may be combined with each other.
[0021] In this embodiment, a data reporting method is provided. As Figure 1 shown, the method includes:
[0022] Step 101, in response to a two-dimensional table template configuration instruction, obtain the data requirements of the data supervisor corresponding to the two-dimensional table template configuration instruction, and based on the data requirements and the data resources in the current data resource pool, determine at least one target data dimension and the target supervision indicators corresponding to each target data dimension, where the target monitoring indicators are used to indicate the processing manner for processing the data under the target data dimension.
[0023] A data reporting method provided by an embodiment of the present application can be applied to scenarios where financial institutions such as banks report data to data regulators, and can specifically be applied to the data reporting system of financial institutions. First, the data reporting system can listen for and respond to two-dimensional table template configuration instructions. These instructions can be submitted through a certain user interface (such as a web form, application interface, etc.), or automatically triggered and generated according to a timing mechanism, etc. For example, the two-dimensional table template is automatically configured every once in a while, and the two-dimensional table template completed with the latest configuration is used to update the previous two-dimensional table template. After receiving the two-dimensional table template configuration instructions, further, the specific requirements of the data regulator for the reported data can be obtained. These data requirements can include required data dimensions, data ranges (such as time range, geographical range, etc.), data granularity (such as daily, weekly, monthly, etc.), and regulatory indicators, etc. By obtaining the data requirements of the data regulator, it can be ensured that the subsequent configured target two-dimensional table template can accurately and comprehensively meet these requirements. Subsequently, based on the data requirements of the data regulator and the data resources in the current data resource pool, it can be determined which data dimensions are required by the data regulator and are available, and such data dimensions are used as target data dimensions, and the regulatory indicators required by the data regulator for each target data dimension are used as the target regulatory indicators corresponding to the target data dimension. These target regulatory indicators are used to indicate how to process the data under the target data dimension to meet the requirements of the data regulator. For example, the target regulatory indicators can be "beginning balance", "increase this month", "decrease this month", "ending balance", etc. Through each target regulatory indicator, it can be known how to process the data under the corresponding target data dimension.
[0024] Step 102, based on the at least one target data dimension and the target regulatory indicator corresponding to each target data dimension, configure the rows and columns of the two-dimensional table template according to a preset rule. Based on the configured rows and columns, determine the data fields corresponding to each cell to be filled in the two-dimensional table template, and according to the data fields corresponding to each cell to be filled in, set the data type of the filled-in data of the cell to be filled in. After the setting is completed, obtain the target two-dimensional table template corresponding to the data regulator, so as to perform data reporting for the data regulator based on the target two-dimensional table template.
[0025] Next, according to the determined target data dimensions and target supervision indicators, the rows and columns of the two-dimensional table template can be configured according to preset rules. For example, the target data dimensions can be used as row headers, and the target supervision indicators can be used as column headers; or the target data dimensions can be used as column headers, and the target supervision indicators can be used as row headers. In addition, rules for arranging the order between row headers and rules for arranging the order between column headers can also be set. Here, the two-dimensional table template can be a preset general template or a simple two-dimensional table structure. After configuring the rows and columns of the two-dimensional table template, a preliminary two-dimensional table template with a clear structure and easy to understand can be obtained. Subsequently, the data fields corresponding to each cell to be filled can also be determined. Here, the cell to be filled refers to the cell that needs to fill in data according to the target data dimensions and target supervision indicators in the future. The data field can specifically be a combination of the target data dimension and the target supervision indicator. Through this combination, the data type of the data to be filled in the cell corresponding to this combination can be determined. Furthermore, the data type of the data filled in each cell to be filled can be set according to the data field corresponding to each cell to be filled. Here, the data type can be numerical data, date data, text data, etc. For example, if the data field is a combination of "cash inflow" and "beginning balance", then the data type of the corresponding cell to be filled can be numerical data. Setting the data type for each cell to be filled can ensure that each cell to be filled can correctly and accurately fill in the corresponding data, thus generating a complete and accurate data report. After completing all the above steps, a target two-dimensional table template that meets the requirements of the data supervisor can be generated immediately. Subsequently, this target two-dimensional table template can be used to extract data from the data resource pool and fill it into the corresponding cells, thus generating a complete reported two-dimensional table.
[0026] By applying the technical solution of this embodiment, first, after receiving the two-dimensional table template configuration instruction, the specific data requirements of the data supervisor for the reported data can be obtained. Subsequently, based on the data requirements of the data supervisor and the data resources in the current data resource pool, it can be determined which data dimensions are required by the data supervisor and are available, and such data dimensions are used as the target data dimensions, and the supervision indicators required by the data supervisor for each target data dimension are used as the target supervision indicators corresponding to the target data dimension. Then, according to the determined target data dimensions and target supervision indicators, the rows and columns of the two-dimensional table template can be configured according to the preset rules. Subsequently, the data fields corresponding to each cell to be filled can also be determined, and the data types of the data filled into each cell to be filled are set according to the data fields corresponding to each cell to be filled. After completing all the above steps, a target two-dimensional table template that meets the requirements of the data supervisor can be generated immediately. Subsequently, this target two-dimensional table template can be used to extract data from the data resource pool and fill it into the corresponding cells, thereby generating a complete reported two-dimensional table. The embodiment of the present application can highly customize the two-dimensional table template according to the specific data requirements of the data supervisor and the data resources in the current data resource pool, ensure that the generated target two-dimensional table template and the data reported according to the target two-dimensional table template fully meet the expectations of the data supervisor, and improve the accuracy of the reported data; whether it is data dimensions, supervision indicators, data ranges or data granularity, it can be flexibly adjusted, and thus can adapt to the complex requirements of different data supervisors; the automated process can generate reported data faster, thereby shortening the data reporting cycle and improving the overall efficiency; the structured two-dimensional table template makes the data clearer and easier to understand, reducing the ambiguity caused by inconsistent data formats or representation methods; restricting the data types of the data filled into each cell to be filled can further ensure the accuracy of the filled data.
[0027] In the embodiment of the present application, optionally, the "configuring the rows and columns of the two-dimensional table template according to the preset rules based on the at least one target data dimension and the target supervision indicators corresponding to each target data dimension" in step 102 includes: using each target data dimension as the row title of the two-dimensional table template respectively, and, performing a merge and deduplication process on the target supervision indicators corresponding to each target data dimension, and using the merged and deduplicated target monitoring indicators as the column titles of the two-dimensional table template respectively; before the "determining the data fields corresponding to each cell to be filled in the two-dimensional table template based on the configured rows and columns" in step 102, the method further includes: determining the cells to be filled included in the two-dimensional table template according to the configured rows and columns; for each target data dimension, based on the target supervision indicator corresponding to the target data dimension, determining redundant cells from the cells to be filled corresponding to the target data dimension, and updating the status of the redundant cells to an uneditable state.
[0028] In this embodiment, when configuring the two-dimensional table template, each determined target data dimension can be used as a row header of the two-dimensional table template. For example, if the target data dimensions are cash flow data, borrowing data, and wealth management data, then the two-dimensional table template can be set with three row headers corresponding to these three target data dimensions respectively.
[0029] In addition, the target regulatory indicators corresponding to different target data dimensions can be merged together and then de-duplicated. The merging and de-duplication are to avoid the occurrence of duplicate regulatory indicators in the column headers and ensure that each regulatory indicator is unique in the column headers. The processed target regulatory indicators are used as the column headers of the two-dimensional table template. For example, if there are two regulatory indicators, namely the beginning balance and the ending balance, under the cash flow data dimension, and there are also these two regulatory indicators, the beginning balance and the ending balance, under the wealth management data dimension, then after merging and de-duplication, the column headers only include one beginning balance and one ending balance.
[0030] After the row and column configurations are completed, all the cells to be filled in the two-dimensional table template can be determined according to the intersection of the row headers (target data dimensions) and the column headers (target regulatory indicators). These cells are the places where specific data needs to be filled in later. In addition, since the target regulatory indicators of the column headers are obtained through merging and de-duplication processing, for each target data dimension, there may be target regulatory indicators that are not applicable to this target data dimension. At this time, the cells to be filled corresponding to the intersection of this target data dimension and the inapplicable target regulatory indicators can be used as redundant cells, and their status can be updated to non-editable. In this way, in the final data reporting process, these cells will not be filled with data, and users cannot edit them either. The embodiment of the present application effectively avoids the duplicate reporting of target regulatory indicators through the merging and de-duplication processing of target regulatory indicators, reduces the redundant information in the data report, making the data more concise and effective; by updating the status of redundant cells to non-editable, it avoids the incorrect data entry caused by misoperation or misunderstanding during the data reporting process, helps to improve the accuracy of data reporting, and ensures the authenticity and reliability of the reported data.
[0031] In one embodiment, assume that a financial institution needs to regularly report its loan business conditions in different regions to a regulatory agency. The determined target data dimensions at this time include: personal loans (Region A), corporate loans (Region A), personal loans (Region B), corporate loans (Region B) ... The merged and deduplicated target regulatory indicators include: total loan amount, loan growth rate, non-performing loan rate. At this time, configure the row headers of the two-dimensional table template: personal loans (Region A), corporate loans (Region A), personal loans (Region B), corporate loans (Region B) ... Column headers: total loan amount, loan growth rate, non-performing loan rate. Assume that in some regions or loan types, the non-performing loan rate is not applicable (for example, there is not enough data for a newly launched business type to calculate the non-performing loan rate), then the corresponding cells can be marked as non-editable. Finally, the financial institution can fill in the corresponding data based on this configured target two-dimensional table template and generate a two-dimensional table for reporting loan business that meets the requirements of the regulatory agency.
[0032] In an embodiment of the present application, optionally, after the step of "configuring the rows and columns of the two-dimensional table template according to a preset rule" in step 102, the method further includes: obtaining the data verification logic corresponding to each target regulatory indicator and binding the corresponding data verification logic to each target regulatory indicator; after the step of "obtaining the target two-dimensional table template corresponding to the data regulatory party after the setting is completed" in step 102, the method further includes: in response to a data reporting instruction, obtaining the target two-dimensional table template of the data regulatory party corresponding to the data reporting instruction and the time period to be reported; screening the data resources in the current data resource pool according to the time period to be reported to obtain first target data, and based on the first target data, completing the cells to be filled in the target two-dimensional table template corresponding to the data reporting instruction to obtain the reporting two-dimensional table corresponding to the data reporting instruction; based on the data verification logic corresponding to each target regulatory indicator, performing data verification on the filled data in each cell to be filled in the reporting two-dimensional table, and when the verification passes, sending the reporting two-dimensional table to the data regulatory party corresponding to the data reporting instruction.
[0033] In this embodiment, after completing the row and column configuration of the two-dimensional table template, the setting of data verification logic can also be carried out. For each determined target supervision index, the corresponding data verification logic can be obtained. These verification logics can be simple range checks (such as a value must be within a certain range), format checks (such as whether the date format is correct), or more complex business rule checks (such as the profit growth rate cannot exceed a certain percentage), as well as combined verification logics between multiple target supervision indexes (such as the data corresponding to target supervision index a + the data corresponding to target supervision index b = the data corresponding to target supervision index c). After obtaining the data verification logic, these data verification logics can be further bound to the corresponding target supervision indexes for use in subsequent data verification processes.
[0034] After obtaining the target two-dimensional table templates corresponding to each data supervision party, these target two-dimensional table templates can be stored. Further, when a data reporting instruction is received, according to the information in the data reporting instruction, the target two-dimensional table template of the corresponding data supervision party and the time period to be reported can be obtained. This time period specifies the time range of the data to be reported, such as "the first quarter of 2023". It should be noted that the data reporting instruction can be automatically generated, such as setting a scheduled task, or manually triggered and generated. Then, according to the time period to be reported, relevant data can be screened out from the current data resource pool, that is, the first target data. After screening out the first target data, the data in each cell to be filled in the target two-dimensional table template can be completed according to the first target data. Specifically, it can be directly filling in the first target data, or filling in after statistical analysis of the first target data, depending on the corresponding target supervision index.
[0035] After completing the data completion process, data verification can also be performed on each cell to be filled in the reported two-dimensional table. This is achieved through the data verification logic bound to each target supervision index before. If the data in a certain cell does not conform to its corresponding data verification logic, this cell can be marked as an error and further error handling can be carried out (such as re-obtaining data, notifying relevant personnel, etc.). If the data in all cells passes the data verification, the reported two-dimensional table can be sent to the data supervision party corresponding to the data reporting instruction. In the embodiment of the present application, the corresponding data verification logic is bound to each target supervision index, ensuring the accuracy and compliance of the reported data. This helps the data supervision party to effectively supervise and evaluate the reported data, improving the credibility of the data.
[0036] In one embodiment, assume that a bank needs to regularly report data on its loan business to a financial regulatory agency. Among them, the target regulatory indicators include: total loan amount, non-performing loan ratio, loan growth rate, etc. The data verification logic includes: for the total loan amount, the data verification logic is that it must be a non-negative value and cannot exceed the bank's total assets; for the non-performing loan ratio, the data verification logic is that it must be between 0% and 100%; for the loan growth rate, the data verification logic is that it cannot exceed a certain preset percentage (such as 20%). After the bank's data reporting system receives a data reporting instruction, it determines the loan business data for the second quarter of 2023 as the time period to be reported. Then, according to the time range of the second quarter of 2023, relevant loan business data is screened from the data resource pool, and the cells in the target two-dimensional table template are filled in based on this data. After filling in the data, each cell can be verified. For example, check whether the total loan amount is non-negative and does not exceed the total assets, whether the non-performing loan ratio is between 0% and 100%, and whether the loan growth rate exceeds the preset percentage. If all the data passes the verification, the reported two-dimensional table can be sent to the financial regulatory agency. If some data fails the verification, error handling can be performed, and the reporting can be retried or relevant personnel can be notified for handling.
[0037] In an embodiment of the present application, optionally, after "sending the reported two-dimensional table to the data regulatory party corresponding to the data reporting instruction", the method further includes: if feedback information of the reported two-dimensional table is received, parsing the feedback information, and when it is parsed that the feedback information includes new data requirements, based on the new data requirements, determining new rows and / or new columns of the corresponding target two-dimensional table template, updating the target two-dimensional table template according to the new rows and / or new columns to obtain an updated target two-dimensional table template; determining newly to-be-filled cells according to the new rows and / or new columns in the updated target two-dimensional table template, filling in the newly to-be-filled cells according to the first target data, and copying the data in each historical to-be-filled cell in the reported two-dimensional table to the updated target two-dimensional table template to obtain an updated reported two-dimensional table.
[0038] In this embodiment, when the data supervision party receives the reported two-dimensional table, it may send feedback information to the data reporting party (such as banks, enterprises, etc.) according to actual requirements or audit results. These information include evaluations of data quality, requirements for data integrity, or new requirements for data content, etc. When receiving these feedback information, they can be parsed to understand the specific intentions of the data supervision party. During the process of parsing the feedback information, once new data requirements are identified, the rows and / or columns to be added in the target two-dimensional table template can be determined according to these new data requirements. For example, when there are new supervision indicators, it means there are new columns (if the previous column headers were determined by the target supervision indicators); when there are new data dimensions, it means there are new rows (if the previous row headers were determined by the target data dimensions). Based on the parsed new data requirements, the target two-dimensional table template is updated. This includes adding new rows and / or columns in the template to accommodate new data points. At the same time, it can also be ensured that the updated target two-dimensional table template still complies with preset rules and standards, such as setting the data types of the newly added cells to be filled, binding data verification logics to the newly added target supervision indicators, etc. After that, the newly added cells to be filled can be automatically filled with the first target data. After filling the newly added cells to be filled, the data in each historical cell to be filled in the original reported two-dimensional table is copied to the updated target two-dimensional table template that complements the newly added cells to be filled. After completing this step, an updated reported two-dimensional table can be obtained, which contains both the original historical data and the new data filled according to the new data requirements.
[0039] When the data supervision party in the embodiment of the present application puts forward new data requirements, it can automatically identify these requirements and update the target two-dimensional table template. At the same time, it can also generate an updated reported two-dimensional table according to the new template and the original data, thereby ensuring the accuracy and integrity of data reporting, and greatly improving the flexibility and adaptability of the data reporting process.
[0040] In the embodiment of the present application, optionally, after "when the verification passes", the method further includes: obtaining the historical reported two-dimensional table, identifying the error data marked in the historical reported two-dimensional table, and determining the data dimension and supervision indicator corresponding to each error data; for any combination including a data dimension and a supervision indicator, counting the number of error data corresponding to the any combination, and calculating the error rate corresponding to the any combination according to the number of error data; according to the error rates corresponding to each combination, randomly select secondary verification cells from the reported two-dimensional table that has passed the verification, mark the secondary verification cells, and send the marked reported two-dimensional table to the secondary verification terminal.
[0041] In this embodiment, when the reported two-dimensional table passes the preliminary data verification, it can also be secondarily verified based on historically error-prone data. Specifically, first, the historical reported two-dimensional tables reported previously can be obtained. These historical reported two-dimensional tables contain the data within the previous reporting period and have been reviewed and feedback by the data supervision party. Then, these historical reported two-dimensional tables are traversed to identify the data marked as errors. These error data can be the problem data pointed out by the data supervision party during the previous review process, or the abnormal data that could not be detected during the preliminary verification process. For each identified error data, further determine the data dimension it belongs to and the corresponding supervision indicator.
[0042] Subsequently, for each combination of data dimension and supervision indicator, count the number of error data corresponding to this combination. This helps to understand which data dimensions and supervision indicators are prone to problems in data reporting. It should be noted that each combination includes only one data dimension and one supervision indicator, and the data dimensions and supervision indicators included in different combinations are not exactly the same. After counting the number of error data, further calculate the error rate corresponding to each combination. The error rate refers to the proportion of the number of error data in this combination to the total number of data in this combination. By calculating the error rate, the data quality status of different data dimensions and supervision indicators can be more intuitively understood.
[0043] After that, based on the error rates corresponding to each combination, a certain number of secondarily verified cells are randomly selected from the currently verified reported two-dimensional table. Specifically, for the combinations with high error rates, more cells to be filled corresponding to these combinations can be selected as secondarily verified cells; for the combinations with low error rates, fewer cells to be filled corresponding to these combinations can be selected as secondarily verified cells. After selecting the secondarily verified cells, they can be marked. These marks can include specific colors, symbols, or text annotations, etc., so that these cells can be quickly identified during the subsequent secondary verification process.
[0044] Finally, the reported two-dimensional table after the marking process is sent to the secondary verification terminal. The secondary verification terminal can be the working interface of a dedicated team or individual responsible for data quality control. At the secondary verification terminal, the quality control team or individual can conduct detailed inspections and verifications on the marked cells.
[0045] Through a series of steps such as identifying error data in the historical reported two-dimensional table, calculating the error rate, randomly selecting secondarily verified cells, and sending them to the secondary verification terminal, the embodiment of this application can further improve the accuracy and reliability of data reporting.
[0046] In an embodiment of the present application, optionally, the step of "obtaining a historical report two-dimensional table, identifying the marked error data in the historical report two-dimensional table, and determining the data dimension and supervision index corresponding to each error data" includes: in response to an operation instruction to add a historical report two-dimensional table to a target window, calling an error data extraction interface corresponding to each supervision index; through the error data extraction interface, extracting the marked error data in the historical report two-dimensional table added to the target window to obtain an error data extraction result corresponding to each supervision index, and determining the data dimension corresponding to the error data extraction result.
[0047] In this embodiment, the error data can be specifically identified in the following manner. Before identifying the error data, in response to the user's error data identification instruction, the target window can be displayed. Then the user can add a historical report two-dimensional table to the target window. Specifically, the user can add the historical report two-dimensional table to the target window by dragging the historical report two-dimensional table; or after clicking on the target window, the user can jump to a preset interface through a preset path. Then the user can directly select the historical report two-dimensional table on the preset interface, or jump to a specified interface (such as the interface corresponding to the storage location of the historical report two-dimensional table of the data supervisor) through the preset interface, directly select the historical report two-dimensional table on the specified interface, and then add the selected historical report two-dimensional table to the target window. In addition, the historical report two-dimensional table can be added to the target window in other ways, which are not limited here. After adding the historical report two-dimensional table to the target window, in response to the user's confirmation instruction, an error data extraction interface corresponding to each supervision index can be called. These interfaces are pre-designed to extract error data under specific supervision indexes from the historical report two-dimensional table. Each supervision index has a corresponding error data extraction interface to ensure that the error data can be accurately located and extracted. By calling the error data extraction interface, the historical report two-dimensional table added to the target window can be traversed. These interfaces have the ability to identify marked error data and can automatically detect the data cells marked as errors in the two-dimensional table. For each supervision index, the error data extraction interface can return an error data extraction result. This result contains information about all the data cells marked as errors under this supervision index, such as the data value, the position of the row and column where they are located, etc. After obtaining the error data extraction result, the data dimension corresponding to these error data can be further determined. For example, the data dimension corresponding to each error data can be determined according to the position of the error data in the two-dimensional table (i.e., the row and column where it is located).
[0048] After determining the data dimension corresponding to each error data, organize this information into a structured format, such as a table or database record. This helps in subsequent in-depth analysis and processing of error data. In the embodiments of the present application, after the user adds a historical reported two-dimensional table to the target window, the error data in the historical reported two-dimensional table can be automatically identified, which can greatly improve the flexibility, efficiency, and accuracy of error data identification.
[0049] Further, as a refinement and extension of the specific implementation manner of the above embodiment, in order to fully illustrate the specific implementation process of this embodiment, another data reporting method is provided, as Figure 2 shown, the method includes:
[0050] Step 201, in response to a two-dimensional table template configuration instruction, obtain the data requirements of the data supervisor corresponding to the two-dimensional table template configuration instruction.
[0051] Step 202, input the data requirements into a preset large model, and parse the data requirements through the preset large model to obtain multiple first data dimensions and the first supervision indicators corresponding to each first data dimension.
[0052] Step 203, obtain the supervisor portrait corresponding to the data supervisor, and verify the first data dimensions and the first supervision indicators corresponding to each first data dimension based on the supervisor portrait, and obtain second data dimensions and the second supervision indicators corresponding to each second data dimension according to the verification result.
[0053] Step 204, identify the metadata corresponding to the data resources in the current data resource pool, and based on the metadata, determine whether there are data resources corresponding to the second data dimensions in the current data resource pool. According to the determination result, screen out the target data dimensions from the second data dimensions, and use the second supervision indicators corresponding to each target data dimension as the target supervision indicators.
[0054] In this embodiment, first, the data requirements of the obtained data supervisor can be input into a preset large model. Then, the preset large model can deeply analyze the input data requirements. This large model can be constructed based on machine learning or deep learning, be able to understand complex natural language texts, and extract information describing data dimensions and supervision indicators from them. The result of the analysis is multiple first data dimensions and the first supervision indicators corresponding to each first data dimension. The first data dimensions are initially identified data categories that may meet the data requirements, and the first supervision indicators can be data processing requirements associated with these dimensions.
[0055] Then, obtain the supervisor portrait of the data supervisor. The supervisor portrait is a model or representation that combines information such as the responsibilities of the supervisor, historical data dimensions, historical supervision indicators, and supervision rules. Based on the supervisor portrait, the initially determined first data dimension and first supervision indicator can be verified. This verification process mainly checks whether these dimensions and indicators meet the requirements of the supervisor and whether there are any omissions or errors. After verification, data dimensions and supervision indicators that meet the supervision requirements can be further screened out as the second data dimension and the second supervision indicator. These dimensions and indicators are more accurate and reliable.
[0056] Next, identify the metadata corresponding to the data resources in the current data resource pool. Metadata is data about data, which describes information such as the structure, attributes, source, and dimensions of the data. Based on the metadata, it can be determined whether the current data resource pool contains data resources for the second data dimension. This process mainly checks whether the data in the data resource pool can cover all the second data dimensions, because the data requirements of some data supervisors are for most financial institutions, and these data requirements may not be fully met by each financial institution. For each second data dimension, if there is a corresponding data resource in the current data resource pool, then this second data dimension can be screened out as the target data dimension. If the corresponding data resource for this second data dimension cannot be found in the data resource pool, then this second data dimension can be discarded. Finally, for each screened target data dimension, the corresponding second supervision indicator is used as the target supervision indicator.
[0057] Through the parsing of the preset large model, the verification of the supervisor portrait, and the metadata analysis of the current data resource pool in the embodiments of the present application, the target data dimension and its corresponding target supervision indicator are determined, which not only ensures the accurate understanding and satisfaction of data requirements, but also guarantees the compliance and reliability of the data, and can greatly improve the data quality and the experience of the data supervisor.
[0058] Step 205, based on the at least one target data dimension and the target supervision indicator corresponding to each target data dimension, configure the rows and columns of the two-dimensional table template according to the preset rules. Based on the configured rows and columns, determine the data fields corresponding to each cell to be filled in the two-dimensional table template, and set the data type of the data to be filled in the cell according to the data field corresponding to each cell to be filled in. After the setting is completed, the target two-dimensional table template corresponding to the data supervisor is obtained, so as to perform data reporting for the data supervisor based on the target two-dimensional table template.
[0059] Further, as Figure 1 a specific implementation of the method, the embodiments of the present application provide a data reporting device, as Figure 3 shown, the device includes:
[0060] A data acquisition module, which is used to respond to a two-dimensional table template configuration instruction, obtain the data requirements of the data supervisor corresponding to the two-dimensional table template configuration instruction, and determine at least one target data dimension and the target supervision indicators corresponding to each target data dimension based on the data requirements and the data resources in the current data resource pool, wherein the target monitoring indicators are used to indicate the processing methods for processing the data under the target data dimension;
[0061] A two-dimensional table configuration module, which is used to configure the rows and columns of the two-dimensional table template according to preset rules based on the at least one target data dimension and the target supervision indicators corresponding to each target data dimension, determine the data fields corresponding to each cell to be filled in the two-dimensional table template based on the configured rows and columns, and set the data types of the data to be filled in the cells to be filled according to the data fields corresponding to each cell to be filled. After the setting is completed, the target two-dimensional table template corresponding to the data supervisor is obtained, so as to report the data of the data supervisor based on the target two-dimensional table template.
[0062] Optionally, the two-dimensional table configuration module is used for:
[0063] Respectively use each target data dimension as the row title of the two-dimensional table template, and perform a combined deduplication process on the target supervision indicators corresponding to each target data dimension, and respectively use the combined and deduplicated target monitoring indicators as the column titles of the two-dimensional table template;
[0064] The device further includes a redundant cell determination module; the redundant cell determination module is used for:
[0065] Before determining the data fields corresponding to each cell to be filled in the two-dimensional table template based on the configured rows and columns, determine the cells to be filled included in the two-dimensional table template according to the configured rows and columns;
[0066] For each target data dimension, determine redundant cells from the cells to be filled corresponding to the target data dimension based on the target supervision indicators corresponding to the target data dimension, and update the status of the redundant cells to non-editable status.
[0067] Optionally, the device further includes a verification logic acquisition module; the verification logic acquisition module is used for:
[0068] After configuring the rows and columns of the two-dimensional table template according to the preset rules, obtain the data verification logics corresponding to each target supervision indicator and bind the corresponding data verification logics to each target supervision indicator;
[0069] The device further includes a data completion module; the data completion module is used for:
[0070] After obtaining the target two-dimensional table template corresponding to the data supervisor after the above settings are completed, in response to a data reporting instruction, obtain the target two-dimensional table template of the data supervisor corresponding to the data reporting instruction, and the time period to be reported;
[0071] According to the time period to be reported, screen the data resources in the current data resource pool to obtain the first target data, and based on the first target data, complete the cells to be filled in the target two-dimensional table template corresponding to the data reporting instruction to obtain the reporting two-dimensional table corresponding to the data reporting instruction;
[0072] Based on the data verification logic corresponding to each target supervision index, verify the filled data in each cell to be filled in the reporting two-dimensional table, and after the verification passes, send the reporting two-dimensional table to the data supervisor corresponding to the data reporting instruction.
[0073] Optionally, the device further includes a parsing module; the parsing module is used for:
[0074] After sending the reporting two-dimensional table to the data supervisor corresponding to the data reporting instruction, if feedback information of the reporting two-dimensional table is received, parse the feedback information, and when it is parsed that the feedback information includes new data requirements, based on the new data requirements, determine the new rows and / or new columns of the corresponding target two-dimensional table template, and update the target two-dimensional table template according to the new rows and / or new columns to obtain an updated target two-dimensional table template;
[0075] Determine the newly added cells to be filled according to the new rows and / or new columns in the updated target two-dimensional table template, complete the newly added cells to be filled according to the first target data, and copy the data in each historical cell to be filled in the reporting two-dimensional table to the updated target two-dimensional table template to obtain an updated reporting two-dimensional table.
[0076] Optionally, the device further includes a secondary verification module; the secondary verification module is used for:
[0077] After the verification passes, obtain the historical reporting two-dimensional table, identify the marked error data in the historical reporting two-dimensional table, and determine the data dimension and supervision index corresponding to each error data;
[0078] For any combination including a data dimension and a supervision index, count the number of error data corresponding to the any combination, and calculate the error rate corresponding to the any combination according to the number of error data;
[0079] According to the error rate corresponding to each combination, randomly select secondary verification cells from the verified reported two-dimensional table, mark the secondary verification cells, and send the marked reported two-dimensional table to the secondary verification terminal.
[0080] Optionally, the secondary verification module is further configured to:
[0081] In response to an operation instruction to add a historical reported two-dimensional table to a target window, call an error data extraction interface corresponding to each supervision indicator;
[0082] Through the error data extraction interface, extract error data from the marked error data in the historical reported two-dimensional table added to the target window, obtain an error data extraction result corresponding to each supervision indicator, and determine the data dimension corresponding to the error data extraction result.
[0083] Optionally, the data acquisition module is configured to:
[0084] Input the data requirement into a preset large model, parse the data requirement through the preset large model to obtain multiple first data dimensions and a first supervision indicator corresponding to each first data dimension;
[0085] Obtain the supervisor portrait corresponding to the data supervisor, and verify the first data dimension and the first supervision indicator corresponding to each first data dimension based on the supervisor portrait, and obtain a second data dimension and a second supervision indicator corresponding to each second data dimension according to the verification result;
[0086] Identify the metadata corresponding to the data resources in the current data resource pool, and based on the metadata, determine whether there are data resources corresponding to the second data dimension in the current data resource pool. According to the judgment result, screen out the target data dimension from the second data dimensions, and use the second supervision indicator corresponding to each target data dimension as the target supervision indicator.
[0087] It should be noted that for other corresponding descriptions of each functional unit involved in the data reporting device provided in the embodiments of the present application, reference can be made to Figures 1 to 2 the corresponding description in the method, which will not be elaborated here.
[0088] The embodiments of the present application further provide a computer device, specifically a personal computer, a server, a network device, etc. For example, Figure 4As shown in the figure, the computer device includes a bus, a processor, a memory, and a communication interface, and may further include an input / output interface and a display device. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store location information. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it implements the steps in the method embodiments.
[0089] Those skilled in the art can understand that Figure 4 the structure shown in the figure is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. Specifically, the computer device may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0090] In one embodiment, a computer-readable storage medium is provided. The computer-readable storage medium may be non-volatile or volatile, and has a computer program stored thereon. When the computer program is executed by the processor, it implements the steps in the above method embodiments.
[0091] In one embodiment, a computer program product is provided, including a computer program. When the computer program is executed by the processor, it implements the steps in the above method embodiments.
[0092] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data that have been authorized by the user or fully authorized by all parties.
[0093] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, etc., without limitation.
[0094] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.
[0095] The above-described embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.
Claims
1. A data reporting method, characterized in that: include: In response to a two-dimensional table template configuration instruction, obtain a data demand of a data supervisor corresponding to the two-dimensional table template configuration instruction, and determine at least one target data dimension and a target supervision indicator corresponding to each target data dimension based on the data demand and data resources in a current data resource pool, wherein the target monitoring indicator is used to indicate a processing method for processing data under the target data dimension; Based on the at least one target data dimension and the target supervision indicator corresponding to each target data dimension, the rows and columns of the two-dimensional table template are configured according to preset rules, and based on the configured rows and columns, the data field corresponding to each cell to be filled in the two-dimensional table template is determined, and according to the data field corresponding to each cell to be filled in, the data type of the data to be filled in the cell to be filled in is set, and after the setting is completed, the target two-dimensional table template corresponding to the data supervisor is obtained, so as to report the data to the data supervisor based on the target two-dimensional table template.
2. The method according to claim 1, characterized in that The configuring rows and columns of the two-dimensional table template according to preset rules based on the at least one target data dimension and the target supervision indicator corresponding to each target data dimension includes: Each target data dimension is used as a row title of the two-dimensional table template, and the target supervision indicators corresponding to each target data dimension are merged and deduplicated, and each target monitoring indicator after the merged and deduplicated processing is used as a column title of the two-dimensional table template; Before determining the data field corresponding to each to-be-filled cell in the two-dimensional table template based on the configured rows and columns, the method further includes: Determine the cells to be filled in the two-dimensional table template according to the configured rows and columns; For each target data dimension, based on the target supervision indicator corresponding to the target data dimension, redundant cells are determined from the cells to be filled in corresponding to the target data dimension, and the status of the redundant cells is updated to a non-editable state.
3. The method according to claim 1, characterized in that After configuring the rows and columns of the two-dimensional table template according to the preset rules, the method further includes: Obtain the data verification logic corresponding to each target supervision indicator, and bind the corresponding data verification logic to each target supervision indicator; After the setting is completed and the target two-dimensional table template corresponding to the data supervisor is obtained, the method further includes: In response to the data reporting instruction, obtaining a target two-dimensional table template of a data supervisor corresponding to the data reporting instruction and a time period to be reported; According to the time period to be reported, the data resources in the current data resource pool are screened to obtain the first target data, and based on the first target data, the cells to be filled in the target two-dimensional table template corresponding to the data reporting instruction are completed to obtain the reporting two-dimensional table corresponding to the data reporting instruction; Based on the data verification logic corresponding to each target supervision indicator, data verification is performed on each completed data to be filled in the reported two-dimensional table, and when the verification passes, the reported two-dimensional table is sent to the data supervisor corresponding to the data reporting instruction.
4. The method according to claim 3, characterized in that After sending the reporting two-dimensional table to the data supervisor corresponding to the data reporting instruction, the method further includes: If feedback information of the reported two-dimensional table is received, the feedback information is parsed, and when it is found that the feedback information includes new data requirements, based on the new data requirements, new rows and / or new columns of the corresponding target two-dimensional table template are determined, and the target two-dimensional table template is updated according to the new rows and / or new columns to obtain an updated target two-dimensional table template; According to the newly added rows and / or newly added columns in the updated target two-dimensional table template, the newly added cells to be filled in are determined, the newly added cells to be filled in are completed according to the first target data, and the data in each historical cell to be filled in the reported two-dimensional table is copied to the updated target two-dimensional table template to obtain an updated reported two-dimensional table.
5. The method according to claim 3 or 4, characterized in that: After the verification is passed, the method further includes: Obtain a historical reporting two-dimensional table, identify the erroneous data marked in the historical reporting two-dimensional table, and determine the data dimension and supervision indicator corresponding to each erroneous data; For any combination of data dimensions and regulatory indicators, count the number of erroneous data corresponding to the combination, and calculate the error rate corresponding to the combination based on the number of erroneous data; According to the error rate corresponding to each combination, a secondary verification cell is randomly selected from the verified reported two-dimensional table, and the secondary verification cell is marked, and the marked reported two-dimensional table is sent to the secondary verification terminal.
6. The method according to claim 5, characterized in that The obtaining of the historical reporting two-dimensional table, identifying the erroneous data marked in the historical reporting two-dimensional table, and determining the data dimension and supervision indicator corresponding to each erroneous data, includes: In response to an operation instruction to add a historical reporting two-dimensional table to a target window, an error data extraction interface corresponding to each regulatory indicator is called; Through the error data extraction interface, error data extraction is performed on the error data marked in the historical reporting two-dimensional table added to the target window to obtain the error data extraction result corresponding to each regulatory indicator, and the data dimension corresponding to the error data extraction result is determined.
7. The method according to claim 1, characterized in that The determining, based on the data demand and the data resources in the current data resource pool, at least one target data dimension and a target supervision indicator corresponding to each target data dimension includes: Inputting the data requirement into a preset large model, parsing the data requirement through the preset large model, and obtaining a plurality of first data dimensions and a first supervision indicator corresponding to each first data dimension; Obtaining a supervisory party portrait corresponding to the data supervisor, and verifying the first data dimension and the first supervision indicator corresponding to each first data dimension based on the supervisory party portrait, and obtaining the second data dimension and the second supervision indicator corresponding to each second data dimension according to the verification result; Identify the metadata corresponding to the data resources in the current data resource pool, and based on the metadata, determine whether the current data resource pool corresponds to the data resources of the second data dimension; based on the determination result, filter out the target data dimension from the second data dimension, and use the second supervision indicator corresponding to each target data dimension as the target supervision indicator.
8. A data reporting device, characterized in that: include: A data acquisition module, configured to respond to a two-dimensional table template configuration instruction, acquire data requirements of a data supervisor corresponding to the two-dimensional table template configuration instruction, and determine at least one target data dimension and a target supervision indicator corresponding to each target data dimension based on the data requirements and data resources in a current data resource pool, wherein the target monitoring indicator is used to indicate a processing method for processing data under the target data dimension; A two-dimensional table configuration module is used to configure the rows and columns of the two-dimensional table template according to preset rules based on the at least one target data dimension and the target supervision indicator corresponding to each target data dimension, determine the data field corresponding to each cell to be filled in the two-dimensional table template based on the configured rows and columns, and set the data type of the data to be filled in the cell according to the data field corresponding to each cell to be filled, and obtain the target two-dimensional table template corresponding to the data supervisor after the setting is completed, so as to report the data to the data supervisor based on the target two-dimensional table template.
9. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
10. A computer device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.