Data submission method and device, electronic equipment and computer program product

Abstract

The invention discloses a data submission method and device, electronic equipment and a computer program product. The method comprises the following steps: acquiring a data submission instruction; in response to the data submission instruction, target to-be-submitted data indicated by a target data identifier is selected from a data lake, and the data lake is used for storing multiple pieces of pre-recorded preset to-be-submitted data and a preset submitted data identifier corresponding to each piece of preset to-be-submitted data; the target to-be-submitted data is preset to-be-submitted data corresponding to the target data identifier; a target submission model indicated by the target model identifier is selected from a preset model library, and the preset model library is used for storing a plurality of preset submission models registered in advance and a preset model identifier corresponding to each preset submission model; processing the target to-be-submitted data by using the target submission model to generate submitted data; and sending the submitted data to the target submitted object. According to the invention, the technical problem of low data submission efficiency is solved.

Description

Technical Field

[0001] The present invention relates to the field of data processing, and in particular to a data reporting method, device, electronic equipment and computer program product. Background Art

[0002] At present, various reporting applications are built independently in a chimney-style manner, relying on various business systems, data warehouses and various markets to provide basic data. The application side mostly uses traditional relational databases for logical processing. The processing links and the technology stacks used are not unified, and the data are relatively independent, which is not conducive to rapid iteration and response to regulatory needs.

[0003] Some enterprises involve multiple major regulatory agencies. In order to meet and quickly respond to various regulatory reports, a large number of independent reporting entities have been created. Each independent reporting entity relies on the data of the source business system, data warehouse and various markets, and processes and reports based on traditional relational databases. Due to the urgency of regulatory time, the same business reporting data is mostly built quickly and independently to meet the regulatory time plan. There are differences in data sources, reporting calibers, verification rules, etc. At the same time, there is also a risk of inconsistency in the external reporting of the same business data.

[0004] However, the existing reporting business has the following problems:

[0005] 1. Data duplication: Most of the reported data comes from data warehouses and integrated data from marts, a small part is source data tables, and there are a large number of repeated accesses to interface tables.

[0006] 2. The rules are not fully managed in a unified manner: the rules focus on data format verification, with less cross-application data logic verification, and the verification rules do not cover all reporting applications, which is not conducive to the comprehensiveness and effectiveness monitoring of the rules.

[0007] 3. Lack of unified tools for data troubleshooting: Problems detected by rule checking lack tools and environment for problem analysis, which affects the efficiency of problem solving.

[0008] 4. Inconsistent external reporting of the same business data due to inconsistent business rules.

[0009] Therefore, the existing regulatory data reporting involves a wide range of business and many data items, so it has problems such as inconsistent reporting caliber, diverse data sources, long and low link timeliness, high data processing duplication, inability to guarantee data quality, and difficulty in tracking problem rectification.

[0010] Currently, no effective solution has been proposed to address the above-mentioned problem of low efficiency in data reporting. Summary of the invention

[0011] The embodiments of the present invention provide a data reporting method, device, electronic device and computer program product to at least solve the technical problem of low data reporting efficiency.

[0012] According to one aspect of an embodiment of the present invention, a data reporting method is provided, comprising: obtaining a data reporting instruction, wherein the data reporting instruction carries at least: a target data identifier, a target model identifier, and a target object identifier, the target data identifier is used to indicate the target data to be reported used by the data reporting instruction request, the target model identifier is used to indicate the target reporting model used by the data reporting instruction request, and the target object identifier is used to indicate the target reporting object requested by the data reporting instruction; in response to the data reporting instruction, selecting the target data to be reported indicated by the target data identifier from a data lake , wherein the data lake is used to store a plurality of pre-recorded preset data to be reported, and a preset reporting data identifier corresponding to each of the preset data to be reported, and the target data to be reported is the preset data to be reported corresponding to the target data identifier; the target reporting model indicated by the target model identifier is selected from a preset model library, wherein the preset model library is used to store a plurality of pre-registered preset reporting models, and a preset model identifier corresponding to each of the preset reporting models; the target reporting model is used to process the target data to be reported to generate reporting data; and the reporting data is sent to the target reporting object.

[0013] Optionally, obtaining the data reporting instruction includes: obtaining a target reporting request based on a target reporting service, wherein the target reporting service is used to indicate: sending the reporting data generated based on at least one preset data to be reported belonging to the target indicator to the target object; in response to the target reporting request, determining the target reporting model corresponding to the target reporting service, wherein the target reporting model is used to generate the reporting data based on at least one preset data to be reported belonging to the target indicator in response to the indication of the target reporting service; in response to the target reporting request, determining the target object identifier of the target reporting object, determining the target data identifier corresponding to the preset data to be reported belonging to the target indicator, and determining the target model identifier corresponding to the target reporting model; generating the data reporting instruction based on the target object identifier, the target data identifier and the target model identifier.

[0014] Optionally, in response to the target reporting request, determining the target reporting model corresponding to the target reporting business includes: in response to the target reporting request, determining the target business complexity of the target reporting business, wherein the target business complexity is used to evaluate the number of data processing steps for generating the reporting data based on at least one preset data to be reported belonging to the target indicator; when the target business complexity is higher than a preset complexity threshold, splitting the target reporting business into multiple preset reporting sub-businesses, wherein the preset reporting sub-businesses are at least used to indicate: generating the preset data to be reported belonging to the second indicator based on the preset data to be reported belonging to the first indicator, and the preset data to be reported belonging to the first indicator At least including: preset data to be reported belonging to the target indicator and preset data to be reported belonging to the intermediate indicator, the preset data to be reported belonging to the second indicator at least including: preset data to be reported belonging to the intermediate indicator and the reported data; when there is preset data to be reported belonging to the intermediate indicator in the data lake, the preset reporting sub-business that generates the reported data based on the preset data to be reported belonging to the intermediate indicator is determined as the target reporting sub-business; the preset reporting model corresponding to the target reporting sub-business is determined in the preset model library as the target reporting model, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset sub-reporting business.

[0015] Optionally, the method also includes: when the complexity of the target business is not higher than a preset complexity threshold, or when there is no preset to-be-reported data belonging to the intermediate indicator in the data lake, determining in the preset model library that the preset reporting model corresponding to the target reporting business is the target reporting model, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset reporting business.

[0016] Optionally, before selecting the target data to be reported indicated by the target data identifier from the data lake in response to the data reporting instruction, the method also includes: connecting with at least one data acquisition device through a data acquisition interface to obtain at least one data to be processed collected by the data acquisition device; preprocessing the data to be processed to obtain at least one processed data, wherein the preprocessing of the data to be processed includes at least one of the following: data cleaning of the data to be processed, normalizing the data to be processed, validating the data to be processed, and deduplicating the data to be processed; and putting at least one of the processed data into the data lake as the preset data to be reported.

[0017] Optionally, before responding to the data reporting instruction and selecting the target reporting model indicated by the target model identifier from the preset model library, the method also includes: receiving a model registration request for at least one initial reporting model through a model acquisition module; in response to the model registration request, calling a preset data exploration platform to verify the initial reporting model, wherein the preset data exploration platform is used to analyze whether the initial reporting model meets the preset model conditions; if the initial reporting model meets the preset model conditions in the preset data exploration platform, the initial reporting model is used as the preset reporting model and placed in the preset model library.

[0018] Optionally, before sending the reporting data to the target reporting object, the method also includes: synchronizing the reporting data to a preset data exploration platform, wherein the preset data exploration platform is used to analyze whether the reporting data meets the preset reporting conditions; receiving a problem report returned by the preset data exploration platform, wherein the problem report is at least used to record the reason why the reporting data does not meet the preset reporting conditions.

[0019] According to another aspect of an embodiment of the present invention, a data reporting device is further provided, including: an acquisition module, used to acquire a data reporting instruction, wherein the data reporting instruction carries at least: a target data identifier, a target model identifier and a target object identifier, the target data identifier is used to indicate the target data to be reported used by the data reporting instruction request, the target model identifier is used to indicate the target reporting model used by the data reporting instruction request, and the target object identifier is used to indicate the target reporting object requested by the data reporting instruction; a first selection module, used to select the target data to be reported indicated by the target data identifier from a data lake in response to the data reporting instruction, wherein , the data lake is used to store a plurality of pre-recorded preset data to be reported, and a preset reporting data identifier corresponding to each of the preset data to be reported, and the target data to be reported is the preset data to be reported corresponding to the target data identifier; a second selection module is used to select the target reporting model indicated by the target model identifier from a preset model library, wherein the preset model library is used to store a plurality of pre-registered preset reporting models, and a preset model identifier corresponding to each of the preset reporting models; a processing module is used to use the target reporting model to process the target data to be reported to generate reporting data; a reporting module is used to send the reporting data to the target reporting object.

[0020] According to another aspect of an embodiment of the present invention, there is further provided an electronic device, comprising: a memory and a processor, wherein the processor is configured to run a program stored in the processor, wherein the above-mentioned data reporting method is executed when the program is run.

[0021] According to another aspect of an embodiment of the present invention, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned data reporting method are implemented.

[0022] In an embodiment of the present invention, according to the data reporting instruction, the target data to be reported required for data reporting can be selected in the data lake, the target reporting model required for data reporting can be selected in the preset model library, and then the target reporting model is used to process the target data to be reported to generate reporting data that can be sent to the target object, thereby realizing the generation of reporting data. The data lake can be used to achieve unified management of the data to be reported, and the preset model library can be used to achieve unified management of the reporting model. When data reporting is required, it is only necessary to obtain the target data to be reported from the data lake and the target reporting model from the preset reporting model library to process the reporting data, thereby achieving the technical effect of improving data reporting efficiency and solving the technical problem of low data reporting efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0024] Figure 1 is a flow chart of a data reporting method according to an embodiment of the present invention;

[0025] Figure 2 is a schematic diagram of a data reporting system according to an embodiment of the present invention;

[0026] Figure 3 is a schematic diagram of a reporting data pool model architecture according to an embodiment of the present invention;

[0027] Figure 4 is a schematic diagram of data reporting according to an embodiment of the present invention;

[0028] Figure 5 is a schematic diagram of a preset data exploration platform according to an embodiment of the present invention;

[0029] Figure 6 is a schematic diagram of a data reporting device according to an embodiment of the present invention;

[0030] Figure 7 It is a structural block diagram of a computer terminal according to an embodiment of the present invention. DETAILED DESCRIPTION

[0031] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0032] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0033] According to an embodiment of the present invention, a data reporting method embodiment is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0034] Figure 1 is a flow chart of a data reporting method according to an embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0035] Step S102, obtaining a data reporting instruction, wherein the data reporting instruction carries at least: a target data identifier, a target model identifier, and a target object identifier, wherein the target data identifier is used to indicate the target data to be reported used by the data reporting instruction request, the target model identifier is used to indicate the target reporting model used by the data reporting instruction request, and the target object identifier is used to indicate the target reporting object requested to be reported by the data reporting instruction;

[0036] Step S104, in response to the data reporting instruction, selecting the target data to be reported indicated by the target data identifier from the data lake, wherein the data lake is used to store a plurality of pre-recorded preset data to be reported and a preset reporting data identifier corresponding to each preset data to be reported, and the target data to be reported is the preset data to be reported corresponding to the target data identifier;

[0037] Step S106, selecting a target reporting model indicated by a target model identifier from a preset model library, wherein the preset model library is used to store a plurality of pre-registered preset reporting models and a preset model identifier corresponding to each preset reporting model;

[0038] Step S108, using the target reporting model to process the target data to be reported to generate reporting data;

[0039] Step S110, sending the reporting data to the target reporting object.

[0040] In an embodiment of the present invention, according to the data reporting instruction, the target data to be reported required for data reporting can be selected in the data lake, the target reporting model required for data reporting can be selected in the preset model library, and then the target reporting model is used to process the target data to be reported to generate reporting data that can be sent to the target object, thereby realizing the generation of reporting data. The data lake can be used to achieve unified management of the data to be reported, and the preset model library can be used to achieve unified management of the reporting model. When data reporting is required, it is only necessary to obtain the target data to be reported from the data lake and the target reporting model from the preset reporting model library to process the reporting data, thereby achieving the technical effect of improving data reporting efficiency and solving the technical problem of low data reporting efficiency.

[0041] As an optional embodiment, obtaining a data reporting instruction includes: obtaining a target reporting request based on a target reporting service, wherein the target reporting service is used to indicate: sending reporting data generated based on at least one preset data to be reported belonging to a target indicator to a target object; in response to the target reporting request, determining a target reporting model corresponding to the target reporting service, wherein the target reporting model is used to generate reporting data based on at least one preset data to be reported belonging to a target indicator in response to the indication of the target reporting service; in response to the target reporting request, determining a target object identifier of the target reporting object, determining a target data identifier corresponding to the preset data to be reported belonging to the target indicator, and determining a target model identifier corresponding to the target reporting model; generating a data reporting instruction based on the target object identifier, the target data identifier and the target model identifier.

[0042] In the above-mentioned embodiment of the present invention, the target reporting request based on the target reporting business can be embodied by a data reporting instruction. When generating a data reporting instruction, it is necessary to first determine the target reporting business, and then determine the target reporting model used for data processing for the target reporting business, as well as the preset data to be reported and the target reporting object indicated by the target reporting business that belong to the target indicator, and determine the target object identifier of the target reporting object, the target data identifier of the target data to be reported, and the target model identifier of the target reporting model. Then, based on the target object identifier, the target data identifier, and the target model identifier, a data reporting instruction that conforms to a unified instruction format can be generated to achieve a unified reporting caliber.

[0043] As an optional embodiment, obtaining a data reporting instruction includes: obtaining a target reporting statement described in natural language; analyzing the target reporting statement using a preset semantic model to determine a target reporting business, wherein the preset semantic model is trained through machine learning using multiple sets of data, and each set of data in the multiple sets of data includes: a preset reporting statement described in natural language, and a preset reporting business marked in the preset reporting statement, and the preset reporting business is used to indicate: sending reporting data generated based on at least one preset data to be reported belonging to a preset indicator to a preset reporting object; determining a target reporting object, at least one target data to be reported belonging to the target indicator, and a target reporting model corresponding to the target business according to the target business; determining the data reporting instruction according to the target object identifier of the target reporting object, the target data identifier of the target data to be reported, and the target model identifier of the target reporting model.

[0044] The above-mentioned embodiment of the present invention utilizes a preset semantic model to convert a target reporting statement described in natural language into a data reporting instruction, so that the data reporting instruction conforms to a unified instruction format and achieves a unified reporting caliber.

[0045] As an optional embodiment, in response to a target reporting request, determining a target reporting model corresponding to a target reporting business includes: in response to the target reporting request, determining a target business complexity of the target reporting business, wherein the target business complexity is used to evaluate the number of data processing steps for generating reporting data based on at least one preset data to be reported belonging to a target indicator; when the target business complexity is higher than a preset complexity threshold, splitting the target reporting business into a plurality of preset reporting sub-businesses, wherein the preset reporting sub-businesses are at least used to indicate: generating preset data to be reported belonging to a second indicator based on preset data to be reported belonging to a first indicator, The preset data to be reported at least include: preset data to be reported belonging to the target indicator and preset data to be reported belonging to the intermediate indicator, and the preset data to be reported belonging to the second indicator at least include: preset data to be reported belonging to the intermediate indicator and reporting data; when there is preset data to be reported belonging to the intermediate indicator in the data lake, the preset reporting sub-business that generates reporting data based on the preset data to be reported belonging to the intermediate indicator is determined as the target reporting sub-business; the preset reporting model corresponding to the target reporting sub-business is determined in the preset model library as the target reporting model, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset sub-reporting business.

[0046] In the above-mentioned embodiment of the present invention, the target business complexity is used to evaluate the number of data processing steps for the target reporting business to generate reporting data. The more data processing steps there are, the greater the value of the target business complexity. When the target business complexity is higher than the preset complexity threshold, it means that the data processing of the target business needs to occupy more resources and time. In order to improve the data processing efficiency of the target business, the target business can be split into multiple target reporting sub-businesses, and then based on the target reporting sub-business that can generate reporting data, it is detected in the data lake whether there is preset data to be reported belonging to the intermediate indicator required by the target reporting sub-business. Furthermore, when the preset data to be reported belonging to the intermediate indicator exists in the data lake, it means that the reporting data can be generated by using the target reporting sub-business, and the target business can be simplified to the target reporting sub-business, thereby achieving the purpose of reducing business complexity.

[0047] As an optional embodiment, the target reporting sub-business includes at least one of the following: a first target reporting sub-business, used to generate preset data to be reported belonging to an intermediate indicator based on the preset data to be reported belonging to the target indicator; a second target reporting sub-business, used to generate second data to be reported based on the first data to be reported, wherein the first reporting data and the second data to be reported belong to the preset data to be reported of the intermediate indicator, and the first reporting data and the second data to be reported are different; and a third target reporting sub-business, used to generate reporting data based on the preset data to be reported belonging to the intermediate indicator.

[0048] As an optional example, different reporting businesses may have some repeated data processing steps. The data obtained by using repeated steps for data processing can be used as the preset data to be reported belonging to the intermediate indicators and stored in the data lake. Then, the reporting business can directly use the preset data to be reported belonging to the intermediate indicators for subsequent processing, thereby reducing the number of data processing steps for the reporting business and reducing the complexity of the reporting business.

[0049] For example, target reporting business A indicates that the target data A to be reported first goes through step A and then goes through step B to generate reporting data A. Target reporting business B indicates that the target data A to be reported first goes through step A and then goes through step C to generate reporting data B. Both target reporting business A and target reporting business B need to go through step A. Therefore, the data obtained from the target data A to be reported after step A can be stored in the data lake as the target data B to be reported which belongs to the intermediate indicator. Then, target reporting business A becomes the generation of reporting data A from the target data B to be reported after step B, and target reporting business B becomes the generation of reporting data B from the target data B to be reported after step C.

[0050] Optionally, the data lake is used to store preset data to be reported that belongs to preset indicators, wherein the preset indicators include at least: target indicators and intermediate indicators.

[0051] As an optional embodiment, the method also includes: when the complexity of the target business is not higher than a preset complexity threshold, or when there is no preset to-be-reported data belonging to the intermediate indicator in the data lake, determining in the preset model library that the preset reporting model corresponding to the target reporting business is the target reporting model, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset reporting business.

[0052] In the above-mentioned embodiments of the present invention, when the complexity of the target business is not higher than the preset complexity threshold, or when there is no preset data to be reported belonging to the intermediate indicator in the data lake, the target reporting model corresponding to the target reporting business can be directly determined, and the reporting data can be generated based on the target data to be reported based on the target reporting model, thereby realizing the generation of the reporting data.

[0053] As an optional embodiment, before selecting the target data to be reported indicated by the target data identifier from the data lake in response to the data reporting instruction, the method also includes: connecting with at least one data acquisition device through a data acquisition interface to obtain the data to be processed collected by the at least one data acquisition device; preprocessing the data to be processed to obtain at least one processed data, wherein the preprocessing of the data to be processed includes at least one of the following: data cleaning the data to be processed, normalizing the data to be processed, verifying the validity of the data to be processed, and deduplicating the data to be processed; and putting at least one processed data as preset data to be reported into the data lake.

[0054] The above-mentioned embodiment of the present invention uses a unified data acquisition interface to communicate with at least one data acquisition device, so that the data to be processed collected by at least one data acquisition device can be uniformly processed. Then, by pre-processing the data to be processed collected by at least one data acquisition device, and putting the pre-processed data as the data to be processed into the data lake, the reliability and availability of the data to be processed stored in the data lake can be guaranteed, and the unified management of the data to be processed can be achieved. When the reporting data is subsequently generated based on the reporting business, the corresponding preset data to be reported can be directly obtained from the data lake for processing, without repeating the data preparation work before each data reporting, thereby improving the data reporting efficiency.

[0055] As an optional embodiment, before responding to a data reporting instruction and selecting a target reporting model indicated by a target model identifier from a preset model library, the method also includes: receiving a model registration request for at least one initial reporting model through a model acquisition module; in response to the model registration request, calling a preset data exploration platform to verify the initial reporting model, wherein the preset data exploration platform is used to analyze whether the initial reporting model meets the preset model conditions; when the initial reporting model meets the preset model conditions in the preset data exploration platform, the initial reporting model is used as a preset reporting model and placed in the preset model library.

[0056] In the above-mentioned embodiment of the present invention, the preset reporting models can be uniformly managed using the model acquisition module. When a new preset reporting model needs to be entered, the newly entered preset reporting model (that is, the initial reporting model) can be registered through the model acquisition module, and the initial reporting model can be sent to the preset data exploration platform for verification to ensure that the preset reporting model placed in the preset model library is safe and effective.

[0057] As an optional embodiment, before sending the reporting data to the target reporting object, the method also includes: synchronizing the reporting data to a preset data exploration platform, wherein the preset data exploration platform is used to analyze whether the reporting data meets the preset reporting conditions; receiving a problem report returned by the preset data exploration platform, wherein the problem report is at least used to record the reason why the reporting data does not meet the preset reporting conditions.

[0058] In the above-mentioned embodiment of the present invention, before sending the reporting data to the target reporting object, the reporting data can be verified through the preset data exploration platform to ensure that the sent reporting data is safe and accurate, and in the case that the reporting data fails to pass the verification of the preset data exploration platform, the preset data exploration platform can return to record the reason why the reporting data does not meet the preset reporting conditions, thereby realizing problem analysis of the reported data.

[0059] The present invention also provides a preferred embodiment, which provides a data reporting pool construction plan based on a big data platform. In order to improve data quality and data governance efficiency, big data technology is applied to construct a regulatory data reporting pool, which is built across the entire domain according to the subject model to consolidate data assets and achieve the "five unifications" of reporting data services: unified data source, unified verification rules, unified quality problem management, unified reporting caliber management, and unified query and analysis of reporting data problems. This achieves unified management, reduces data silos, ensures the timeliness, completeness and accuracy of regulatory data reporting, comprehensively improves the quality of regulatory reporting data, and more quickly locates problems and analyzes data.

[0060] Figure 2 is a schematic diagram of a data reporting system according to an embodiment of the present invention. Figure 2 As shown, it includes: data asset management platform, data service platform, data exchange platform, data exploration platform and reporting applications.

[0061] Alternatively, if Figure 2 As shown, the data service platform adopts the FI offline cluster, which includes at least: a source layer (data lake) and a reporting market. The reporting market can process the preset data to be reported in the source layer (data lake), generate reporting data, and send the reporting data through the reporting application.

[0062] Alternatively, if Figure 2 As shown, the data exploration platform uses the CDH analysis cluster, which is accessed through corresponding links to perform problem analysis and generate problem data.

[0063] Alternatively, if Figure 2 As shown, the data asset management platform includes at least: a unified view of inspection rules, a unified view of reporting standards, a unified view of data quality and closed-loop management, and a link to the data exploration platform.

[0064] As an alternative example, based on Figure 2 The data reporting system shown can perform data management, specifically including: based on the big data platform, according to the reporting needs, supplement and improve the data collection and storage of the source layer (data lake) 21, and perform data integration, data processing, rule verification, etc. based on the reporting market (reporting pool) 22; and manage the reporting scope and indicators based on the unified view of reporting scope 23 of the data asset platform.

[0065] As an alternative example, based on Figure 2 The data reporting system shown can perform rule management, specifically including: a unified view 24 of inspection rules in the data asset management platform to achieve unified management of inspection rules, including rule establishment, deployment process, rule information display, etc.; data verification on the regulatory application side in each reporting application, data verification on the source side in the source area, and cross-regulatory data cross-checking and verification in the reporting market.

[0066] As an alternative example, based on Figure 2 The data reporting system shown can perform problem management, specifically including: a unified view of data quality and closed-loop management 25 in the data asset management platform to achieve unified display and tracking closed-loop management of data quality issues; through the data exploration platform 26, query data quality problem data and normal data for problem diagnosis and analysis.

[0067] Figure 3 is a schematic diagram of a reporting data pool model architecture according to an embodiment of the present invention, such as Figure 3 As shown, it includes: a source layer (data lake) 31 and a reporting market, wherein the reporting market includes: an integration layer 32, an indicator layer 33, and an application layer 34.

[0068] As an alternative example, Figure 3 As shown, the source layer 31 realizes data collection and synchronization of the upstream source system based on the source data lake of the big data platform, and stores the source data step by step according to the three-level hierarchical structure of the buffer layer (Current), the history layer (History), and the basic layer (Operator); through data lineage tracking analysis, the O-layer data table with a high data processing utilization rate is sorted out and identified, and the source table is established according to the business primary key information to form a deduplicated and de-redundant source layer to avoid inconsistent source data in the same usage scenario (such as data duplication problems, etc.); in terms of data cleaning, according to the preset data standards, big data specifications and other requirements, the source table data is cleaned, formatted, and the data validity is checked (such as confirming the valid mobile phone number through regular expression matching, forcibly converting the date to YYYY-MM-DD, the default value of the amount field is 0, the unit is cents, etc.); in terms of data storage, the data life cycle management is performed on the data according to the requirements of the line; thereby establishing an available, easy-to-use, and unified reporting basic data layer.

[0069] As an alternative example, Figure 3 As shown, the integration layer 32 is oriented to the actual business line, and at the same time, combined with different regulatory reporting requirements, it sorts out different business attributes and establishes a basic model for the reporting market, including first-level topics such as customers, deposits, and loans. According to more detailed regulatory demands, it is further broken down into second-level and third-level topics. For example, the customer topic is broken down into second-level topics such as corporate, personal, peer, and group. For detailed data reporting scenarios, the data processing link can be directly shortened from the integration layer to the application layer, thereby improving data integration efficiency. At the same time, through IT architecture management tools and modeling tools, the data references of upstream and downstream data links and between systems are identified and sorted out to build a clear data link model.

[0070] As an alternative example, Figure 3 As shown, the indicator layer 33 starts from the regulatory reporting business scenario, breaks down the statistical data, data with high processing complexity and other reporting requirements into more fine-grained indicators, and precipitates and integrates them into commonly used parts to form an indicator layer; for the identification of common indicators, it is mainly judged based on whether the indicator definition is used in multiple reporting systems; for the indicator definition constraints, the same indicator and the same caliber are mainly achieved through the precipitation and integration mechanism of this layer to ensure the uniqueness of the indicator technical caliber, and at the same time form a unified management of indicator metadata, which improves the convenience of verification such as data consistency across reporting systems.

[0071] As an alternative example, Figure 3 As shown, the application layer 34 connects each reporting application with the external system of the pool to store the reporting data, verification results, etc.

[0072] As an optional embodiment, the five unifications of the reporting data pool include: unified data source, unified verification rules, unified quality problem management, unified reporting caliber management, and unified query and analysis of reporting data problems.

[0073] As an optional example, data source unification refers to using the data lake data of the big data platform as the base, performing data integration, data processing, rule verification, etc. based on the reporting market (reporting pool), and realizing unified access, storage, and processing of reporting data sources.

[0074] Figure 4 is a schematic diagram of data reporting according to an embodiment of the present invention, such as Figure 4 As shown, the data lake is used to store the data to be reported provided by the source system (such as preset data to be reported, or target data to be reported), and then the data to be reported is obtained from the reporting data lake through the reporting market for processing to generate reporting data. Since different reporting objects require different reporting data, the corresponding reporting data can be sent to each reporting object (such as the target reporting object).

[0075] As an optional example, unified verification rules refer to optimization based on the rule management function of the data asset management platform, registration of rules and scripts in the data asset management platform, and execution of scripts in the reporting market and reporting applications.

[0076] Optionally, unified quality problem management refers to displaying rule verification problems on the data asset management platform, viewing detailed problem data on the data exploration platform through links, and summarizing and displaying key information of problem details on the data asset management platform.

[0077] As an optional example, summarizing and displaying the key information of the problem details includes: displaying through a unified view of the problem, and enabling each problem discovered by the rule to query the corresponding error content, table name, primary key, and key field.

[0078] Optionally, after discovering a problem, you can follow up on the current status, solution, and governance results of the problem, and monitor whether the same problem occurs repeatedly.

[0079] Optionally, unified management of reporting scope refers to online management of reporting data scope through table-level and field-level scope maintenance based on the indicator management function of the data asset management platform, so as to achieve unified maintenance and change of reporting scope and data acquisition mapping rules, and ensure that the understanding of business and technical personnel is consistent with the requirements of regulatory agencies.

[0080] As an optional example, query and analysis of reported data problems uniformly refers to synchronizing reported data from the FI cluster to the CDH cluster, querying reported processing data and problem data through BDP, and performing diagnosis and analysis of the problems.

[0081] Figure 5 is a schematic diagram of a preset data exploration platform according to an embodiment of the present invention, such as Figure 5 As shown, the preset data exploration platform can be the CDH cluster, and the reported data is synchronized from the FI cluster to the CDH cluster. BDP users in the CDH cluster can query the reported processing data and problem data through the BDP reporting tool to perform diagnostic analysis of the problem.

[0082] It should be noted that the FI cluster is a distributed computing system for storing and processing data. It consists of multiple computer nodes that can work together to complete complex computing tasks. FI clusters are usually used in large-scale data analysis, machine learning, artificial intelligence and other fields, and can provide high-performance and high-reliability computing capabilities. FI clusters can be expanded as needed to adapt to computing tasks of different scales.

[0083] It should be noted that CDH cluster, which stands for Cloudera Distribution including ApacheHadoop, is a distributed computing platform based on Apache Hadoop developed and maintained by Cloudera. It includes multiple components in the Hadoop ecosystem, such as Hadoop Distributed File System (HDFS), MapReduce, Hive, HBase, ZooKeeper, etc., and also integrates other open source tools and components. CDH cluster can be used for large-scale data storage, processing and analysis, and is suitable for enterprise-level data processing and analysis needs.

[0084] It should be noted that the BDP reporting tool is a tool for generating and displaying data reports. It can help users extract data from different data sources and organize it into reports that are easy to understand and analyze. These reports can include various charts, tables, and other visual forms to help users better understand the data and make corresponding decisions. BDP reporting tools usually have a user-friendly interface and rich functions to meet users' needs for different types of reports and support the design and generation of customized reports. It can also be integrated with other data processing tools or database systems to more conveniently obtain and process data.

[0085] The above-mentioned embodiment of the present invention applies big data technology to construct a reporting data pool, links the data asset management platform, and realizes the unification of data sources, verification rules, quality problem management, reporting scope management, and query and analysis of reporting data problems for the reporting data; designs a hierarchical model for the reporting data pool, builds integration layer, indicator layer, and application layer logical models, and builds a full-domain sub-theme model to consolidate data assets and realize regulatory data sharing.

[0086] According to an embodiment of the present invention, a data reporting device embodiment is also provided. It should be noted that the data reporting device can be used to execute the data reporting method in the embodiment of the present invention, and the data reporting method in the embodiment of the present invention can be executed in the data reporting device.

[0087] Figure 6 is a schematic diagram of a data reporting device according to an embodiment of the present invention. Figure 6As shown, the device may include: an acquisition module 61, used to acquire a data reporting instruction, wherein the data reporting instruction carries at least: a target data identifier, a target model identifier and a target object identifier, the target data identifier is used to indicate the target data to be reported used by the data reporting instruction request, the target model identifier is used to indicate the target reporting model used by the data reporting instruction request, and the target object identifier is used to indicate the target reporting object requested by the data reporting instruction; a first selection module 63, used to select the target data to be reported indicated by the target data identifier from the data lake in response to the data reporting instruction, wherein the data lake is used to store The module 65 stores a plurality of pre-recorded preset data to be reported, and a preset reporting data identifier corresponding to each preset data to be reported, and the target data to be reported is the preset data to be reported corresponding to the target data identifier; the second selection module 65 is used to select the target reporting model indicated by the target model identifier from the preset model library, wherein the preset model library is used to store a plurality of pre-registered preset reporting models, and a preset model identifier corresponding to each preset reporting model; the processing module 67 is used to use the target reporting model to process the target data to be reported to generate reporting data; the reporting module 69 is used to send the reporting data to the target reporting object.

[0088] It should be noted that the acquisition module 61 in this embodiment can be used to execute step S102 in the embodiment of the present application, the first selection module 63 in this embodiment can be used to execute step S104 in the embodiment of the present application, the second selection module 65 in this embodiment can be used to execute step S106 in the embodiment of the present application, the processing module 67 in this embodiment can be used to execute step S108 in the embodiment of the present application, and the reporting module 69 in this embodiment can be used to execute step S110 in the embodiment of the present application. The examples and application scenarios implemented by the above modules and corresponding steps are the same, but are not limited to the contents disclosed in the above embodiments.

[0089] In an embodiment of the present invention, according to the data reporting instruction, the target data to be reported required for data reporting can be selected in the data lake, the target reporting model required for data reporting can be selected in the preset model library, and then the target reporting model is used to process the target data to be reported to generate reporting data that can be sent to the target object, thereby realizing the generation of reporting data. The data lake can be used to achieve unified management of the data to be reported, and the preset model library can be used to achieve unified management of the reporting model. When data reporting is required, it is only necessary to obtain the target data to be reported from the data lake and the target reporting model from the preset reporting model library to process the reporting data, thereby achieving the technical effect of improving data reporting efficiency and solving the technical problem of low data reporting efficiency.

[0090] As an optional embodiment, the acquisition module includes: an acquisition unit, which is used to acquire a target reporting request based on a target reporting business, wherein the target reporting business is used to indicate: sending reporting data generated based on at least one preset data to be reported belonging to the target indicator to the target object; a first determination unit, which is used to determine, in response to the target reporting request, a target reporting model corresponding to the target reporting business, wherein the target reporting model is used to generate reporting data based on at least one preset data to be reported belonging to the target indicator in response to the indication of the target reporting business; a second determination unit, which is used to determine, in response to the target reporting request, a target object identifier of the target reporting object, determine a target data identifier corresponding to the preset data to be reported belonging to the target indicator, and determine a target model identifier corresponding to the target reporting model; a first generation unit, which is used to generate a data reporting instruction based on the target object identifier, the target data identifier and the target model identifier.

[0091] As an optional embodiment, the first determination unit includes: a first determination sub-unit, used to determine the target business complexity of the target reporting business in response to the target reporting request, wherein the target business complexity is used to evaluate the number of data processing steps for generating reporting data based on at least one preset data to be reported belonging to the target indicator; a splitting sub-unit, used to split the target reporting business into multiple preset reporting sub-businesses when the target business complexity is higher than a preset complexity threshold, wherein the preset reporting sub-businesses are at least used to indicate: generating preset data to be reported belonging to a second indicator based on the preset data to be reported belonging to the first indicator, and the preset data to be reported belonging to the first indicator at least includes : The preset data to be reported belonging to the target indicator and the preset data to be reported belonging to the intermediate indicator, the preset data to be reported belonging to the second indicator at least includes: the preset data to be reported belonging to the intermediate indicator and the reporting data; a generating subunit, which is used to, when there is the preset data to be reported belonging to the intermediate indicator in the data lake, generate the preset reporting sub-business for reporting data based on the preset data to be reported belonging to the intermediate indicator, and determine it as the target reporting sub-business; a second determining subunit, which is used to determine the preset reporting model corresponding to the target reporting sub-business in the preset model library as the target reporting model, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset sub-reporting business.

[0092] As an optional embodiment, the device also includes: a third determination subunit, which is used to determine the preset reporting model corresponding to the target reporting business in the preset model library as the target reporting model when the complexity of the target business is not higher than a preset complexity threshold, or when there is no preset to-be-reported data belonging to the intermediate indicator in the data lake, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset reporting business.

[0093] As an optional embodiment, the device also includes: an acquisition submodule, which is used to connect with at least one data acquisition device through a data acquisition interface to acquire the data to be processed collected by at least one data acquisition device before selecting the target data to be reported indicated by the target data identifier from the data lake in response to the data reporting instruction; a preprocessing submodule, which is used to preprocess the data to be processed to obtain at least one processed data, wherein the preprocessing of the data to be processed includes at least one of the following: data cleaning of the data to be processed, normalization of the data to be processed, validity verification of the data to be processed, and deduplication of the data to be processed; a first placement submodule, which is used to place at least one processed data as preset data to be reported into the data lake.

[0094] As an optional embodiment, the device also includes: a first receiving sub-module, which is used to receive a model registration request for at least one initial reporting model through a model acquisition module before selecting a target reporting model indicated by a target model identifier from a preset model library in response to a data reporting instruction; a verification sub-module, which is used to call a preset data exploration platform to verify the initial reporting model in response to the model registration request, wherein the preset data exploration platform is used to analyze whether the initial reporting model meets the preset model conditions; and a second placement sub-module, which is used to place the initial reporting model as a preset reporting model into the preset model library when the initial reporting model meets the preset model conditions in the preset data exploration platform.

[0095] As an optional embodiment, the device also includes: a synchronization submodule, used to synchronize the reported data to a preset data exploration platform before sending the reported data to the target reporting object, wherein the preset data exploration platform is used to analyze whether the reported data meets the preset reporting conditions; a second receiving submodule, used to receive a problem report returned by the preset data exploration platform, wherein the problem report is at least used to record the reason why the reported data does not meet the preset reporting conditions.

[0096] The embodiment of the present invention can provide a computer terminal, which can be any computer terminal device in a computer terminal group. Optionally, in this embodiment, the computer terminal can also be replaced by a terminal device such as a mobile terminal.

[0097] Optionally, in this embodiment, the computer terminal may be located in at least one network device among a plurality of network devices of the computer network.

[0098] In this embodiment, the computer terminal can execute the program code of the following steps in the data reporting method: obtaining a data reporting instruction, wherein the data reporting instruction carries at least: a target data identifier, a target model identifier and a target object identifier, the target data identifier is used to indicate the target data to be reported used by the data reporting instruction request, the target model identifier is used to indicate the target reporting model used by the data reporting instruction request, and the target object identifier is used to indicate the target reporting object requested to be reported by the data reporting instruction; in response to the data reporting instruction, selecting the target data to be reported indicated by the target data identifier from the data lake, wherein the data lake is used to store a plurality of pre-recorded preset data to be reported and a preset reporting data identifier corresponding to each preset data to be reported, and the target data to be reported is the preset data to be reported corresponding to the target data identifier; selecting the target reporting model indicated by the target model identifier from the preset model library, wherein the preset model library is used to store a plurality of pre-registered preset reporting models and a preset model identifier corresponding to each preset reporting model; processing the target data to be reported using the target reporting model to generate reporting data; and sending the reporting data to the target reporting object.

[0099] Figure 7 is a structural block diagram of a computer terminal according to an embodiment of the present invention. Figure 7 As shown, the computer terminal 70 may include: one or more (only one is shown in the figure) processors 72 and a memory 74 .

[0100] Among them, the memory can be used to store software programs and modules, such as program instructions / modules corresponding to the data reporting method and device in the embodiment of the present invention. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, realizing the above-mentioned data reporting method. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the terminal 70 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0101] The processor can call the information and application stored in the memory through the transmission device to perform the following steps: obtain a data reporting instruction, wherein the data reporting instruction carries at least: a target data identifier, a target model identifier and a target object identifier, the target data identifier is used to indicate the target data to be reported used by the data reporting instruction request, the target model identifier is used to indicate the target reporting model used by the data reporting instruction request, and the target object identifier is used to indicate the target reporting object requested by the data reporting instruction; in response to the data reporting instruction, select the target data to be reported indicated by the target data identifier from the data lake, wherein the data lake is used to store a plurality of pre-recorded preset data to be reported and a preset reporting data identifier corresponding to each preset data to be reported, and the target data to be reported is the preset data to be reported corresponding to the target data identifier; select the target reporting model indicated by the target model identifier from the preset model library, wherein the preset model library is used to store a plurality of pre-registered preset reporting models and a preset model identifier corresponding to each preset reporting model; use the target reporting model to process the target data to be reported to generate reporting data; and send the reporting data to the target reporting object.

[0102] Optionally, the processor may also execute program code for the following steps: obtaining a target reporting request based on a target reporting service, wherein the target reporting service is used to indicate: sending reporting data generated based on at least one preset data to be reported belonging to a target indicator to a target object; in response to the target reporting request, determining a target reporting model corresponding to the target reporting service, wherein the target reporting model is used to generate reporting data based on at least one preset data to be reported belonging to a target indicator in response to the indication of the target reporting service; in response to the target reporting request, determining a target object identifier of the target reporting object, determining a target data identifier corresponding to the preset data to be reported belonging to the target indicator, and determining a target model identifier corresponding to the target reporting model; and generating a data reporting instruction based on the target object identifier, the target data identifier, and the target model identifier.

[0103] Optionally, the processor may also execute program code for the following steps: in response to a target reporting request, determining a target business complexity of a target reporting business, wherein the target business complexity is used to evaluate the number of data processing steps for generating reporting data based on at least one preset data to be reported belonging to a target indicator; when the target business complexity is higher than a preset complexity threshold, splitting the target reporting business into a plurality of preset reporting sub-businesses, wherein the preset reporting sub-businesses are at least used to indicate: generating preset data to be reported belonging to a second indicator based on the preset data to be reported belonging to a first indicator, and generating at least one preset data to be reported belonging to a first indicator. Including: preset data to be reported belonging to the target indicator and preset data to be reported belonging to the intermediate indicator, the preset data to be reported belonging to the second indicator at least includes: preset data to be reported belonging to the intermediate indicator and reporting data; when there is preset data to be reported belonging to the intermediate indicator in the data lake, the preset reporting sub-business that generates reporting data based on the preset data to be reported belonging to the intermediate indicator is determined as the target reporting sub-business; the preset reporting model corresponding to the target reporting sub-business is determined in the preset model library as the target reporting model, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset sub-reporting business.

[0104] Optionally, the processor may also execute the program code of the following steps: when the complexity of the target business is not higher than a preset complexity threshold, or when there is no preset data to be reported belonging to the intermediate indicator in the data lake, determine in the preset model library that the preset reporting model corresponding to the target reporting business is the target reporting model, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset reporting business.

[0105] Optionally, the processor may also execute the program code of the following steps: connecting with at least one data acquisition device through a data acquisition interface to obtain the data to be processed collected by at least one data acquisition device; preprocessing the data to be processed to obtain at least one processed data, wherein the preprocessing of the data to be processed includes at least one of the following: data cleaning the data to be processed, normalizing the data to be processed, verifying the validity of the data to be processed, and deduplicating the data to be processed; and putting at least one processed data as preset data to be reported into the data lake.

[0106] Optionally, the processor may also execute the program code of the following steps: receiving a model registration request for at least one initial reporting model through the model acquisition module; in response to the model registration request, calling a preset data exploration platform to verify the initial reporting model, wherein the preset data exploration platform is used to analyze whether the initial reporting model meets the preset model conditions; when the initial reporting model meets the preset model conditions in the preset data exploration platform, the initial reporting model is used as a preset reporting model and placed in the preset model library.

[0107] Optionally, the processor may also execute program codes of the following steps: synchronizing the reported data to a preset data exploration platform, wherein the preset data exploration platform is used to analyze whether the reported data meets preset reporting conditions; and receiving a problem report returned by the preset data exploration platform, wherein the problem report is at least used to record the reason why the reported data does not meet the preset reporting conditions.

[0108] By adopting the embodiment of the present invention, a data reporting scheme is provided. According to the data reporting instruction, the target data to be reported required for data reporting can be selected in the data lake, the target reporting model required for data reporting can be selected in the preset model library, and then the target reporting model is used to process the target data to be reported to generate reporting data that can be sent to the target object, thereby realizing the generation of reporting data. The data lake can be used to achieve unified management of the reporting data, and the preset model library can be used to achieve unified management of the reporting model. When data reporting is required, it is only necessary to obtain the target data to be reported from the data lake and the target reporting model from the preset reporting model library to process the reporting data, thereby achieving the technical effect of improving the data reporting efficiency and solving the technical problem of low data reporting efficiency.

[0109] It can be understood by those skilled in the art that Figure 7 The structure shown is for illustration only, and the computer terminal may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a handheld computer, a mobile Internet device (Mobile Internet Devices, MID), a PAD, or other terminal devices. Figure 7 The structure of the electronic device is not limited. For example, the computer terminal 70 may also include Figure 7 ) shown in more or less components (such as network interfaces, display devices, etc.), or having Figure 7 Different configurations are shown.

[0110] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the hardware related to the terminal device through a program, and the program can be stored in a non-volatile medium. The non-volatile storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0111] The embodiment of the present invention further provides a computer program product, including a computer program. Optionally, in this embodiment, it is characterized in that when the computer program is executed by a processor, the steps of the data reporting method provided in the above embodiment are implemented.

[0112] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0113] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0114] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0115] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0116] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0117] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a non-volatile storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a non-volatile storage medium, including several instructions for a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned non-volatile storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0118] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A data reporting method, characterized in that: include: Obtaining a data reporting instruction, wherein the data reporting instruction carries at least: a target data identifier, a target model identifier, and a target object identifier, wherein the target data identifier is used to indicate the target data to be reported requested by the data reporting instruction, the target model identifier is used to indicate the target reporting model requested by the data reporting instruction, and the target object identifier is used to indicate the target reporting object requested by the data reporting instruction; In response to the data reporting instruction, the target data to be reported indicated by the target data identifier is selected from the data lake, wherein the data lake is used to store a plurality of pre-recorded preset data to be reported and a preset reporting data identifier corresponding to each of the preset data to be reported, and the target data to be reported is the preset data to be reported corresponding to the target data identifier; Selecting the target reporting model indicated by the target model identifier from a preset model library, wherein the preset model library is used to store a plurality of pre-registered preset reporting models and a preset model identifier corresponding to each of the preset reporting models; Processing the target data to be reported using the target reporting model to generate reporting data; The reporting data is sent to the target reporting object.

2. The method according to claim 1, characterized in that The instructions for obtaining data submission include: Acquire a target reporting request based on a target reporting service, wherein the target reporting service is used to instruct: sending the reporting data generated based on at least one preset to-be-reported data belonging to the target indicator to the target object; In response to the target reporting request, determining the target reporting model corresponding to the target reporting service, wherein the target reporting model is used to generate the reporting data based on at least one preset data to be reported belonging to the target indicator in response to an instruction of the target reporting service; In response to the target reporting request, determining the target object identifier of the target reporting object, determining the target data identifier corresponding to the preset to-be-reported data belonging to the target indicator, and determining the target model identifier corresponding to the target reporting model; The data reporting instruction is generated based on the target object identifier, the target data identifier and the target model identifier.

3. The method according to claim 2, characterized in that In response to the target reporting request, determining the target reporting model corresponding to the target reporting service includes: In response to the target reporting request, determining a target business complexity of the target reporting business, wherein the target business complexity is used to evaluate the number of data processing steps for generating the reporting data based on at least one preset to-be-reported data belonging to the target indicator; In the case where the complexity of the target business is higher than the preset complexity threshold, the target reporting business is split into a plurality of preset reporting sub-businesses, wherein the preset reporting sub-businesses are at least used to indicate: generating preset data to be reported belonging to the second indicator based on the preset data to be reported belonging to the first indicator, the preset data to be reported belonging to the first indicator at least includes: the preset data to be reported belonging to the target indicator and the preset data to be reported belonging to the intermediate indicator, and the preset data to be reported belonging to the second indicator at least includes: the preset data to be reported belonging to the intermediate indicator and the reporting data; In the case where there is preset data to be reported belonging to the intermediate indicator in the data lake, the preset reporting sub-business that generates the reporting data based on the preset data to be reported belonging to the intermediate indicator is determined as the target reporting sub-business; The preset reporting model corresponding to the target reporting sub-business is determined in the preset model library as the target reporting model, wherein the preset model library is also used to record the corresponding relationship between the preset reporting model and the preset sub-reporting business.

4. The method according to claim 3, characterized in that The method further comprises: When the complexity of the target business is not higher than the preset complexity threshold, or when there is no preset data to be reported belonging to the intermediate indicator in the data lake, the preset reporting model corresponding to the target reporting business is determined in the preset model library as the target reporting model, wherein the preset model library is also used to record the correspondence between the preset reporting model and the preset reporting business.

5. The method according to claim 1, characterized in that Before selecting the target data to be reported indicated by the target data identifier from the data lake in response to the data reporting instruction, the method further includes: Connecting with at least one data acquisition device through a data acquisition interface to obtain data to be processed collected by at least one data acquisition device; Preprocessing the data to be processed to obtain at least one processed data, wherein preprocessing the data to be processed includes at least one of the following: data cleaning the data to be processed, normalizing the data to be processed, validating the data to be processed, and deduplicating the data to be processed; At least one of the processed data is used as the preset data to be reported and put into the data lake.

6. The method according to claim 1, characterized in that Before selecting the target reporting model indicated by the target model identifier from a preset model library in response to the data reporting instruction, the method further includes: Receiving, through the model acquisition module, a model registration request for at least one initial submission model; In response to the model registration request, calling a preset data exploration platform to verify the initial submission model, wherein the preset data exploration platform is used to analyze whether the initial submission model meets the preset model conditions; When the initial reporting model meets the preset model conditions in the preset data exploration platform, the initial reporting model is used as the preset reporting model and put into the preset model library.

7. The method according to claim 1, characterized in that Before sending the reporting data to the target reporting object, the method further includes: Synchronizing the submitted data to a preset data exploration platform, wherein the preset data exploration platform is used to analyze whether the submitted data meets preset submission conditions; Receive a problem report returned by the preset data exploration platform, wherein the problem report is at least used to record the reason why the reported data does not meet the preset reporting conditions.

8. A data reporting device, characterized in that: include: An acquisition module is used to acquire a data reporting instruction, wherein the data reporting instruction carries at least: a target data identifier, a target model identifier and a target object identifier, the target data identifier is used to indicate the target data to be reported used by the data reporting instruction request, the target model identifier is used to indicate the target reporting model used by the data reporting instruction request, and the target object identifier is used to indicate the target reporting object requested to be reported by the data reporting instruction; a first selection module, configured to select, in response to the data reporting instruction, the target data to be reported indicated by the target data identifier from the data lake, wherein the data lake is used to store a plurality of pre-recorded preset data to be reported and a preset reporting data identifier corresponding to each of the preset data to be reported, and the target data to be reported is the preset data to be reported corresponding to the target data identifier; A second selection module is used to select the target reporting model indicated by the target model identifier from a preset model library, wherein the preset model library is used to store a plurality of pre-registered preset reporting models and a preset model identifier corresponding to each of the preset reporting models; A processing module, used to process the target data to be reported using the target reporting model to generate reporting data; The reporting module is used to send the reporting data to the target reporting object.

9. An electronic device, characterized in that: include: A memory and a processor, wherein the processor is used to run a program stored in the processor, wherein the program executes the data reporting method according to any one of claims 1 to 7 when running.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the data reporting method according to any one of claims 1 to 7 are implemented.

Images