Data filling and reporting method and data filling and reporting system applying same

Abstract

The invention relates to the technical field of data filling and reporting, in particular to a data filling and reporting method and a data filling and reporting system applying the same, and the data filling and reporting method comprises the following steps: S1, initializing the data filling and reporting system; s2, creating a report by calling a database table, a model and a data set according to the business condition, making a perspective table through source data in the report, pulling corresponding dimensions according to the business condition to perform screening, and generating a template and a corresponding search condition through combination of columns, rows and values; s3, performing batch filling and reporting of multi-dimensional data for corresponding role personnel according to the divided templates and the corresponding search conditions; s4, after the role personnel complete filling and reporting, the filled and reported data is transmitted back to the database table; and S5, splitting and analyzing the returned data by the data filling and reporting system. The method is high in self-definition degree and compatibility, high in real-time performance, convenient to improve filling efficiency and cooperation efficiency, high in safety coefficient and capable of reducing labor intensity of operators.

Description

Technical Field

[0001] The present invention relates to the technical field of data reporting, and in particular to a data reporting method and a data reporting system using the same. Background Art

[0002] The current state of data reporting technology in various industries shows a trend of rapid progress. With the promotion of digital transformation, many industries have begun to adopt technologies such as automation, intelligence and cloud computing to optimize the data reporting process. Artificial intelligence and machine learning technologies are applied to data accuracy verification and anomaly detection, which improves the efficiency and quality of reporting. At the same time, the popularity of mobile devices and wireless communication technologies makes data reporting more convenient and real-time. In the future, data reporting is expected to continue to develop, combining more advanced technologies such as big data analysis and natural language processing to further improve the automation level and value creation ability of data reporting. However, the most commonly used reporting methods are still traditional Excel data formats, formulas and charts. However, in actual work, the use of Excel spreadsheets has the problem of manual distribution and collection, and the reporting time is long, time-consuming and laborious. It cannot meet the data reporting requirements with high timeliness and security requirements, and does not support online reporting of data. There is a lack of necessary process control. When there are many reporting personnel, different personnel may use different standards and methods to report, resulting in data consistency being affected. At the same time, the traditional reporting method has the risk of data leakage and tampering, posing an information security threat. Summary of the invention

[0003] The technical problem to be solved by the present invention is that the existing data reporting method is time-consuming and laborious to use, cannot meet the data reporting work requirements with high timeliness and security requirements, does not support online data reporting, and has a low safety factor.

[0004] In order to solve the above technical problems, the first aspect of the present invention adopts the following technical solution: a data reporting method, comprising the following steps:

[0005] S1: Initialize the data reporting system and obtain business information;

[0006] S2: Initialize the version classification, and create reports by calling database tables, models, and data sets according to business conditions, make pivot tables based on the source data in the reports, and pull corresponding dimensions for filtering, columns, rows, and values ​​according to business conditions to generate templates and corresponding search conditions;

[0007] S3: Distribute the generated templates and corresponding search conditions to the corresponding role personnel for batch reporting of multi-dimensional data;

[0008] S4: When the role personnel completes the reporting, the reported data is sent back to the database table;

[0009] S5: The data reporting system splits and analyzes the returned data, forms data of corresponding dimensions according to preset rules, and saves them for subsequent calls.

[0010] When the present invention is working, it can generate templates by calling database tables, models and data sets according to business conditions, with a high degree of customization and compatibility, and can realize online batch reporting and return of data, with high real-time performance, convenient for improving reporting efficiency and cooperation efficiency, and high safety factor. At the same time, it can also realize the splitting and analysis of returned data, optimize data processing steps, improve data management efficiency, facilitate operators to call applications, and reduce the labor intensity of operators.

[0011] Preferably, in step S2, when creating a report by calling database tables, models and data sets according to business conditions, a pivot table is made through the source data in the report, and corresponding dimensions are pulled according to business conditions for filtering, columns, rows and values ​​are combined to generate templates and corresponding search conditions, the following steps are adopted to generate base table data of the report by reading database tables, models and data sets, and create a pivot table based on the base table data, and pull different dimensions according to business conditions for filtering, columns, rows and values ​​to generate templates, and assemble corresponding search conditions.

[0012] Preferably, in step S3, when distributing the generated template and the corresponding search conditions to the corresponding role personnel for filling in, the following steps are adopted: the generated template and the corresponding search conditions are packaged and sent to the corresponding role personnel, and the corresponding role personnel parse and organize the data therein after receiving them, and filter them as search conditions, read rows, columns and values ​​respectively, and obtain corresponding cell data in turn through multi-dimensional calculations, and combine them into data of corresponding dimensions for the role personnel to fill in.

[0013] Preferably, in step S3, the generated template and the corresponding search conditions are packaged and sent to the corresponding role personnel. After receiving the data, the corresponding role personnel parse and organize the data therein, filter them as search conditions, read rows, columns and values ​​respectively, obtain the corresponding cell data in turn through multi-dimensional calculations, and combine them into data of corresponding dimensions for the role personnel to fill in. The following steps are adopted: the generated template and the corresponding search conditions are packaged into json data and sent to the corresponding role personnel. After receiving the json data, the corresponding role personnel parse the celldata data, pivotTable data, row and column data in the json data, calculate the data location information, assemble a list set for the celldata data through polling, assemble the search conditions through the pivotTable data, generate a list set through the assembled data of corresponding dimensions, and assemble the list set with SQL statements to form a key-value pair map of the corresponding value of a field for batch insertion.

[0014] Preferably, in step S3, when combining the data into corresponding dimensions for the role personnel to fill in, the following steps are adopted to combine the data into corresponding dimensions through a multi-threaded manner for the role personnel to fill in.

[0015] Preferably, in step S3, when the data of corresponding dimensions are combined for reporting by the role personnel, the following steps are adopted to set a corresponding type for each generated combination, and identify it by setting a random character string. Each time the role personnel reports the addition, deletion, and modification of the combination, they must clear the set random character string before reporting.

[0016] When the present invention is working, a random character string is set for identification in a unique correspondence method, which can avoid affecting other data when merging data of multiple dimensions, and can improve data security and efficiency of data reporting.

[0017] Preferably, the step S4 further includes the following steps: after the role personnel complete filling in the data, the data filled in by the role personnel are reviewed and approved, and the approved data are returned to the database table.

[0018] To solve the above-mentioned technical problems, the second aspect of the present invention adopts the following technical solution: a data reporting system, applying a data reporting method as described above, including a data collection module for preliminary data preparation, version classification management and template production for reporting, a data filling module for interacting with personnel of different roles to realize page and search condition switching and filling in business data, and a data storage module for storing data, wherein the data collection module sends the template to the data filling module after the template production is completed, and the data filling module sends the filled-in data to the data storage module after the data filling is completed.

[0019] Preferably, it also includes a data approval module for approving the data filled in by personnel in various roles. The data sent by the data filling module is stored in the data storage module after being approved by the data approval module. The data storage module is also provided with a data analysis module for supporting risk management and forecasting to identify potential risks, predict future trends and patterns, and provide a basis for planning.

[0020] Preferably, it also includes a front end and a back end, and the data acquisition module, data filling module and data storage module are deployed on the front end or the back end respectively. The front end is configured to be integrated through vue2.0, element-ui and Luckysheet, and the back end is configured to adopt the springcloud microservice system architecture.

[0021] When the present invention is working, by setting the front end to be integrated through vue2.0, element-ui and Luckysheet, it can realize data reporting in an Excel-like operation mode, which lowers the usage threshold, has high compatibility, and is convenient for operators to customize the design according to business conditions. At the same time, by setting the back end to adopt the springcloud microservice system architecture, it can solve the problem of high concurrency of large amounts of data, and the system has large redundancy and high stability.

[0022] The beneficial technical effects of the present invention include:

[0023] 1. The present invention can generate templates by calling database tables, models and data sets according to business conditions, with high customization and compatibility, and can realize online batch reporting and return of data, with high real-time performance, convenient for improving reporting efficiency and cooperation efficiency, and high safety factor. At the same time, it can also realize the splitting and analysis of returned data, optimize data processing steps, improve data management efficiency, facilitate operators to call applications, and reduce the labor intensity of operators.

[0024] 2. The present invention adopts a unique correspondence method to set a random string for identification, which can avoid affecting other data when merging data of multiple dimensions, and can improve data security and efficiency of data reporting.

[0025] 3. The present invention sets the front end to be integrated through vue2.0, element-ui and Luckysheet, which can realize data reporting in an Excel-like operation mode, lowers the usage threshold, has high compatibility, and is convenient for operators to customize the design according to business conditions. At the same time, by setting the back end to adopt the springcloud microservice system architecture, it can solve the problem of high concurrency of large amounts of data, and the system has large redundancy and high stability.

[0026] Other features and advantages of the present invention will be disclosed in detail in the following specific embodiments and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The present invention will be further described below in conjunction with the accompanying drawings:

[0028] Attached Figure 1 It is a structural diagram of a data reporting system;

[0029] Attached Figure 2 This is a work flow chart of Example 2;

[0030] Attached Figure 3 This is an example diagram of the reference structure of the floor table of Example 2;

[0031] Attached Figure 4 This is an example diagram of data reporting in Example 2. DETAILED DESCRIPTION

[0032] The technical solutions of the embodiments of the present invention are explained and described below in conjunction with the drawings of the embodiments of the present invention, but the following embodiments are only preferred embodiments of the present invention, not all. Based on the embodiments in the implementation mode, other embodiments obtained by those skilled in the art without creative work are all within the protection scope of the present invention.

[0033] In the following description, terms such as "inside", "outside", "up", "down", "left", "right", etc. that indicate directions or positional relationships are only used to facilitate the description of the embodiments and simplify the description, and do not indicate or imply that the referred device or element must have a specific direction, be constructed and operate in a specific direction. Therefore, it should not be understood as a limitation of the present invention.

[0034] Embodiment 1:

[0035] Please see attached Figure 1 This embodiment discloses a data reporting method, comprising the following steps:

[0036] S1: Initialize the data reporting system and obtain business information;

[0037] S2: Initialize the version classification, and create reports by calling database tables, models, and data sets according to business conditions, make pivot tables based on the source data in the reports, and pull corresponding dimensions for filtering, columns, rows, and values ​​according to business conditions to generate templates and corresponding search conditions;

[0038] S3: Distribute the generated templates and corresponding search conditions to the corresponding role personnel for batch reporting of multi-dimensional data;

[0039] S4: When the role personnel completes the reporting, the reported data is sent back to the database table;

[0040] S5: The data reporting system splits and analyzes the returned data, forms data of corresponding dimensions according to preset rules, and saves them for subsequent calls.

[0041] In this embodiment, templates can be generated by calling database tables, models and data sets according to business conditions, with a high degree of customization and compatibility, and can realize online batch reporting and return of data with high real-time performance, which is convenient for improving reporting efficiency and cooperation efficiency and has a high safety factor. At the same time, it can also realize the splitting and analysis of returned data, optimize data processing steps, improve data management efficiency, facilitate operators to call applications, and reduce the labor intensity of operators.

[0042] Preferably, in step S2, when creating a report by calling database tables, models and data sets according to business conditions, a pivot table is made through the source data in the report, and corresponding dimensions are pulled according to business conditions for filtering, columns, rows and values ​​are combined to generate templates and corresponding search conditions, the following steps are adopted to generate the base table data of the report by reading database tables, models and data sets, and create a pivot table based on the base table data, and pull different dimensions according to business conditions for filtering, columns, rows and values ​​to generate templates, and assemble corresponding search conditions.

[0043] In the specific implementation, in step S3, when distributing the generated template and the corresponding search conditions to the corresponding role personnel for filling in, the following steps are adopted: the generated template and the corresponding search conditions are packaged and sent to the corresponding role personnel, and the corresponding role personnel parse and organize the data after receiving them, and filter them as search conditions, read rows, columns and values ​​respectively, and obtain the corresponding cell data in turn through multi-dimensional calculations, and combine them into data of corresponding dimensions for the role personnel to fill in.

[0044] Preferably, in step S3, when combining data of corresponding dimensions for role personnel to fill in, the following steps are adopted to combine data of corresponding dimensions for role personnel to fill in through multi-threading, which can improve processing efficiency.

[0045] As a further improvement of this embodiment, in step S4, the following steps are also included: after the role personnel completes filling in the data, the data filled in by the role personnel is reviewed and approved, and the approved data is returned to the database table, which can improve data security and avoid erroneous data pollution.

[0046] Embodiment 2:

[0047] Please see attached Figure 1 This embodiment provides a data reporting method. The same points as those in the first embodiment will not be described in detail. The differences will be described in detail below with reference to the accompanying drawings.

[0048] Please see attached Figure 2 To Attachment Figure 4 In this embodiment, in step S3, the generated template and the corresponding search conditions are packaged and sent to the corresponding role personnel. After receiving the data, the corresponding role personnel parse and organize the data therein, and filter them as search conditions, read rows, columns and values ​​respectively, and obtain the corresponding cell data in turn through multi-dimensional calculations. When combined into data of corresponding dimensions for the role personnel to fill in, the following steps are adopted: the generated template and the corresponding search conditions are packaged into json data and sent to the corresponding role personnel, wherein the json data contains the template format, pivot table dimensions, cell data style and log. After receiving the json data, the corresponding role personnel parse the celldata data, pivotTable data, row and column data in the json data, calculate the data location information, assemble the list set of the celldata data through polling, assemble the search conditions through the pivotTable data, generate a list set through the assembled data of corresponding dimensions, and assemble the list set with SQL statements to form a key-value pair map of the corresponding value of a field for batch insertion.

[0049] As a further improvement of this embodiment, in step S3, when the data of corresponding dimensions are combined for role personnel to fill in, the following steps are adopted to set a corresponding type for each generated combination, and identify it by setting a random character string. Each time the role personnel fill in the report to add, delete, or modify the combination, they must clear the set random character string before performing the reporting operation.

[0050] When this embodiment is working, a random character string is set for identification by a unique correspondence method, which can avoid affecting other data when merging data of multiple dimensions, and can improve data security and efficiency of data reporting.

[0051] Embodiment three:

[0052] Please see attached Figure 1The present embodiment provides a data reporting system, which applies a data reporting method as in the above embodiment, including a data acquisition module 1 for preliminary data preparation, version classification management and template production for reporting, a data filling module 2 for interacting with personnel of different roles to switch pages and search conditions and fill in business data, and a data storage module 4 for storing data, which are described in detail below.

[0053] In this embodiment, the data acquisition module 1 sends the template to the data filling module 2 after the template is created. The data filling module 2 sends the filled data to the data storage module 4 after the data is filled in. Preferably, it also includes a data approval module 3 for approving the data filled in by personnel of each role. The data sent by the data filling module 2 is stored in the data storage module 4 after being approved by the data approval module 3. The data storage module 4 is also provided with a data analysis module for supporting risk management and forecasting to identify potential risks, predict future trends and patterns, and provide a basis for planning. It can realize online reporting and feedback of data, help to strengthen internal communication and transparency, and by sharing data, different departments and teams can better collaborate and cooperate to avoid information islands and duplication of work, and can also increase the trust of the organization and establish a good cooperative relationship.

[0054] As a further improvement of this embodiment, it also includes a front end and a back end, and the data collection module 1, the data filling module 2 and the data storage module 4 are deployed on the front end or the back end respectively. The front end is configured to be integrated through vue2.0, element-ui and Luckysheet, and the back end is configured to adopt the springcloud microservice system architecture.

[0055] When this embodiment is working, by setting the front end to integrate through vue2.0, element-ui and Luckysheet, it can realize data reporting in an Excel-like operation mode, which lowers the usage threshold, has high compatibility, and is convenient for operators to customize the design according to business conditions. At the same time, by setting the back end to adopt the springcloud microservice system architecture, it can solve the problem of high concurrency of large amounts of data, and the system has large redundancy and high stability.

[0056] The beneficial technical effects of this embodiment include: the present invention can generate templates by retrieving database tables, models and data sets according to business conditions, with a high degree of customization and compatibility, and can realize online batch reporting and return of data, with high real-time performance, convenient for improving reporting efficiency and cooperation efficiency, and a high safety factor. At the same time, it can also realize the splitting and analysis of returned data, optimize data processing steps, improve data management efficiency, facilitate operators to call applications, and reduce the labor intensity of operators.

[0057] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Those skilled in the art should understand that the present invention includes but is not limited to the contents described in the drawings and the above specific embodiments. Any modification that does not deviate from the functional and structural principles of the present invention will be included in the scope of the claims.

Claims

1. A data reporting method, characterized in that: The following steps are involved: S1: Initialize the data reporting system and obtain business information; S2: Initialize the version classification, and create reports by calling database tables, models, and data sets according to business conditions, make pivot tables based on the source data in the reports, and pull corresponding dimensions for filtering, columns, rows, and values ​​according to business conditions to generate templates and corresponding search conditions; S3: Distribute the generated templates and corresponding search conditions to the corresponding role personnel for batch reporting of multi-dimensional data; S4: When the role personnel completes the reporting, the reported data is sent back to the database table; S5: The data reporting system splits and analyzes the returned data, forms data of corresponding dimensions according to preset rules, and saves them for subsequent calls.

2. A data reporting method according to claim 1, characterized in that: In step S2, when creating a report by calling database tables, models and data sets according to business conditions, a pivot table is made through the source data in the report, and corresponding dimensions are pulled according to business conditions for filtering, columns, rows and values ​​are combined to generate templates and corresponding search conditions. The following steps are adopted to generate the base table data of the report by reading database tables, models and data sets, and create a pivot table based on the base table data, and pull different dimensions according to business conditions for filtering, columns, rows and values ​​to generate templates, and assemble corresponding search conditions.

3. A data reporting method according to claim 1, characterized in that: In step S3, when distributing the generated template and the corresponding search conditions to the corresponding role personnel for filling in, the following steps are adopted: the generated template and the corresponding search conditions are packaged and sent to the corresponding role personnel. After receiving, the corresponding role personnel parse and organize the data therein, and filter them as search conditions, read rows, columns and values ​​respectively, and obtain the corresponding cell data in turn through multi-dimensional calculations, and combine them into data of corresponding dimensions for the role personnel to fill in.

4. A data reporting method according to claim 3, characterized in that: In the step S3, the generated template and the corresponding search conditions are packaged and sent to the corresponding role personnel. After receiving the data, the corresponding role personnel parse and organize the data therein, and filter them as search conditions, read rows, columns and values ​​respectively, and obtain the corresponding cell data in turn through multi-dimensional calculations. The data are combined into data of corresponding dimensions for the role personnel to fill in. The following steps are adopted: the generated template and the corresponding search conditions are packaged into json data and sent to the corresponding role personnel. After receiving the json data, the corresponding role personnel parse the celldata data, pivotTable data, row and column data in the json data, calculate the data location information, assemble a list set for the celldata data through polling, assemble the search conditions through the pivotTable data, generate a list set through the assembled data of corresponding dimensions, and assemble the list set with SQL statements to form a key-value pair map of the corresponding value of a field for batch insertion.

5. A data reporting method according to claim 3, characterized in that: In the step S3, when the data of corresponding dimensions are combined for the role personnel to fill in, the following steps are adopted to combine the data of corresponding dimensions in a multi-threaded manner for the role personnel to fill in.

6. A data reporting method according to claim 3, characterized in that: In step S3, when the data of corresponding dimensions are combined for the role personnel to fill in, the following steps are adopted to set the corresponding type for each generated combination, and identify it by setting a random character string. Each time the role personnel fill in the addition, deletion, and modification operations of the combination, they must clear the set random character string before filling in the operation.

7. A data reporting method according to claim 1, characterized in that: In the step S4, the following steps are also included: after the role personnel completes filling in the data, the data filled in by the role personnel are reviewed and approved, and the approved data is returned to the database table.

8. A data reporting system, using a data reporting method according to any one of claims 1 to 7, characterized in that: The invention comprises a data collection module (1) for preparing templates for preliminary data preparation, version classification management and filling in, a data filling module (2) for interacting with personnel of different roles to switch pages and search conditions and fill in business data, and a data storage module (4) for storing data. The data collection module (1) sends the template to the data filling module (2) after the template is prepared, and the data filling module (2) sends the filled data to the data storage module (4) after the data is filled in.

9. A data reporting system according to claim 8, characterized in that: It also includes a data approval module (3) for approving data submitted by personnel of various roles. The data sent by the data filling module (2) is stored in a data storage module (4) after being approved by the data approval module (3). The data storage module (4) is also provided with a data analysis module for supporting risk management and prediction to identify potential risks, predict future trends and patterns, and provide a basis for planning.

10. A data reporting system according to claim 8, characterized in that: It also includes a front end and a back end, wherein the data collection module (1), the data filling module (2) and the data storage module (4) are respectively deployed on the front end or the back end, the front end is configured to be integrated through vue2.0, element-ui and Luckysheet, and the back end is configured to adopt the springcloud microservice system architecture.

Images