Data processing method and device, storage medium and electronic equipment

By obtaining the summary table and table types, determining the anchor cell and identifying the business subtable, performing summary operations and comparisons, the inefficiency problem in the business data check of abnormal business data is solved, and automated and efficient data difference identification is achieved. and positioning.

CN119066133APending Publication Date: 2024-12-03CHINA CONSTR BANK CORP SHANDONG BRANCH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411094273.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-09
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

The prior art relies on manual comparison in the investigation of abnormal business data of summary table data, resulting in low data processing efficiency, difficulty in providing comparison results quickly and accurately, and low efficiency in determining abnormal data.

Method used

By obtaining the summary table and table types, determining the anchor cell and identifying multiple business subtables based on it, performing summary operations and comparisons, and generating exception prompt messages to automatically identify and locate data differences.

Benefits of technology

It realizes automated and efficient identification and positioning of data differences, improves business data management and analysis efficiency, and solves the problems of complex processing processes and inefficient determination of abnormal data caused by large amounts of data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119066133A_ABST
    Figure CN119066133A_ABST
Patent Text Reader

Abstract

The invention discloses a data processing method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a summary table and a table type related to a target business system; determining a group of anchor point cells according to the feature data corresponding to each cell in the summary table; determining a plurality of service sub-tables based on the table type, and determining a plurality of service sub-data corresponding to the plurality of service sub-tables based on the group of anchor cells; and summarizing the plurality of business sub-data to obtain second business data, comparing the first business data with the second business data, determining an abnormal sub-table, and generating a target prompt message. According to the method and the device, the technical problems of complex data processing flow and relatively low abnormal data determination efficiency caused by overlarge data volume are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a data processing method and device, a storage medium, and an electronic device. Background Art

[0002] At present, when checking for abnormal business data in summary table data, people often rely on manual comparison of the business data in each sub-table corresponding to the summary table, resulting in a lot of time and energy being invested in repetitive data processing links. That is, the data processing method in the relevant technology is difficult to quickly and accurately provide comparison results and locate the causes of the differences, resulting in a technical problem of low efficiency in determining abnormal data.

[0003] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0004] The embodiments of the present application provide a data processing method and device, a storage medium, and an electronic device to at least solve the technical problem that the data processing process is complicated and the efficiency of determining abnormal data is low due to excessive data volume.

[0005] According to one aspect of an embodiment of the present application, a data processing method is provided, comprising: obtaining a summary table and a table type related to a target business system, wherein the summary table is used to record first business data to be compared; determining a group of anchor cells according to feature data corresponding to each cell in the summary table, wherein the feature data is used to represent a cell attribute of a corresponding cell, and cell attributes of different anchor cells in the group of anchor cells satisfy different preset attribute conditions; determining multiple business sub-tables based on the table type, and determining multiple business sub-data corresponding to the multiple business sub-tables based on the group of anchor cells, wherein the table type is the same as the table type of each sub-table in the multiple business sub-tables, the group of anchor cells is used to determine a target cell to be compared, and the target cell corresponding to one of the multiple business sub-tables is used to record a type of data of the multiple business sub-data; performing a summary operation on the multiple business sub-data to obtain second business data, comparing the first business data and the second business data, determining an abnormal sub-table, and generating a target prompt message, wherein the target prompt message is used to indicate that abnormal data and an abnormal cell where the abnormal data are located are recorded in the abnormal sub-table.

[0006] According to another aspect of an embodiment of the present application, a data processing device is also provided, including: an acquisition module, used to acquire a summary table and a table type related to a target business system, wherein the summary table is used to record first business data to be compared; a first determination module, used to determine a group of anchor cells according to feature data corresponding to each cell in the summary table, wherein the feature data is used to represent cell attributes of the corresponding cells, and cell attributes of different anchor cells in the group of anchor cells meet different preset attribute conditions; a second determination module, used to determine a plurality of business sub-tables based on the table type, and determine the plurality of business sub-tables based on the group of anchor cells. A plurality of business sub-data corresponding to a grid, wherein the table type is the same as the table type of each sub-table in the plurality of business sub-tables, the group of anchor cells is used to determine the target cells that need to be compared, and the target cell corresponding to a sub-table in the plurality of business sub-tables is used to record a type of data of the plurality of business sub-data; an execution module is used to perform a summary operation on the plurality of business sub-data to obtain second business data, compare the first business data with the second business data, determine an abnormal sub-table, and generate a target prompt message, wherein the target prompt message is used to indicate that abnormal data is recorded in the abnormal sub-table and an abnormal cell where the abnormal data is located.

[0007] Optionally, the device is used to determine a group of anchor cells according to the characteristic data corresponding to each cell in the summary table in the following manner: acquiring characteristic data of each cell in the summary table, wherein the characteristic data includes border characteristic data and data characteristic data of the cell, the border characteristic data is used to indicate whether each border of the corresponding cell exists, and the data characteristic data is used to indicate the data format of the corresponding cell record; when the characteristic data satisfies a first attribute condition, determining the corresponding cell as a table starting area of ​​the group of anchor cells, wherein a first border and a second border exist in the table starting area, and a first adjacent cell in a first direction and a second direction of the table starting area has no border and fill color, or the first adjacent cell has no content, or the first adjacent cell does not exist, and the first direction and the second direction are perpendicular to each other; when the characteristic data satisfies a second attribute condition In the case of the condition that the characteristic data satisfies the third attribute condition, the corresponding cell is determined as the data starting area of ​​the group of anchor cells, wherein the data type of the second adjacent cell in the first direction and the second direction of the data starting area is a character type, and the data type of the third adjacent cell in the third direction and the fourth direction of the data starting area is not a character type, the third direction is opposite to the first direction, the fourth direction is opposite to the second direction, and the cell corresponding to the data starting area has no border and fill color or has no content; in the case that the characteristic data satisfies the third attribute condition, the corresponding cell is determined as the table ending area of ​​the group of anchor cells, wherein the table ending area has a third border and a fourth border, and the fourth adjacent cell in the third direction and the fourth direction of the table ending area has no border and fill color, or the fourth adjacent cell has no content, or the fourth adjacent cell does not exist.

[0008] Optionally, the device is used to determine multiple business sub-tables based on the table type, and determine multiple business sub-data corresponding to the multiple business sub-tables based on the set of anchor cells in the following manner: create a multi-level target index based on the set of anchor cells, wherein the multi-level target index is used to indicate the position of each row header and column header in the summary table; determine multiple business sub-tables based on the table type, and obtain the multiple business sub-data from the multiple business sub-tables based on the multi-level target index and a predetermined target number of rows and a predetermined number of columns.

[0009] Optionally, the device is used to determine multiple business sub-tables based on the table type in the following manner, and obtain the multiple business sub-data from the multiple business sub-tables based on the multi-level target index and a predetermined target number of rows and target number of columns: determine the first row header in the summary table according to the target number of rows in the multi-level target index, and determine the first column header in the summary table according to the target number of columns in the multi-level target index; determine the second row header of each sub-table in the multiple business sub-tables according to the target number of rows in the multi-level target index, and determine the second column header of each sub-table in the multiple business sub-tables according to the target number of columns in the multi-level target index; when the second row header is the same as the first row header, and the second column header is the same as the first column header, determine the data recorded in the cell determined by the second row header and the second column header as the multiple business sub-data.

[0010] Optionally, the device is also used to: determine multiple business sub-tables based on the table type, and before determining multiple business sub-data corresponding to the multiple business sub-tables based on the set of anchor cells, obtain a pre-set parameter configuration file, wherein the parameter configuration file is used to record different anchor cells corresponding to different table types; determine the table type according to the identifier of the summary table; and query the set of anchor cells corresponding to the table type from the parameter configuration file.

[0011] Optionally, the device is also used for: after querying the set of anchor cells corresponding to the table type of the target summary table from the parameter configuration file, when the set of anchor cells are queried from the parameter configuration file, obtaining the multiple business sub-data according to the set of anchor cells; when the set of anchor cells are not queried from the parameter configuration file, determining the set of anchor cells based on the characteristic data, and obtaining the multiple business sub-data according to the set of anchor cells, wherein the table type, the set of anchor cells and the corresponding association relationship are set to be stored in the parameter configuration file.

[0012] Optionally, the device is used to perform a summary operation on the multiple business sub-data in the following manner to obtain second business data, compare the first business data and the second business data, determine an abnormal sub-table, and generate a target prompt message: sum the multiple target business sub-data to obtain the second business data; when the first business data is different from the second business data, compare the difference between the historical value and the current value of each data in the multiple target business sub-data to see if they meet a preset difference condition; when the difference between the historical value and the current value of the abnormal data in the multiple target business sub-data does not meet the preset difference condition, determine the table in the multiple target business sub-tables that records the abnormal data as the abnormal sub-table, and generate a target prompt message.

[0013] According to another aspect of the embodiments of the present application, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned data processing method when running.

[0014] According to another aspect of the embodiments of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the above data processing method.

[0015] According to another aspect of the embodiments of the present application, there is further provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the data processing method through the computer program.

[0016] In an embodiment of the present application, a summary table and table type related to a target business system are obtained, wherein the summary table is used to record the first business data to be compared; a group of anchor cells are determined according to the characteristic data corresponding to each cell in the summary table, wherein the characteristic data is used to represent the cell attributes of the corresponding cells, and the cell attributes of different anchor cells in a group of anchor cells meet different preset attribute conditions; multiple business sub-tables are determined based on the table type, and multiple business sub-data corresponding to the multiple business sub-tables are determined based on the group of anchor cells, wherein the table type is the same as the table type of each sub-table in the multiple business sub-tables, and a group of anchor cells are used to determine the business data that need to be compared. A target cell, a target cell corresponding to a subtable in a plurality of business subtables is used to record a type of data of the plurality of business subdata; a summary operation is performed on the plurality of business subdata to obtain a second business data, the first business data and the second business data are compared, the abnormal subtable is determined, and a target prompt message is generated, wherein the target prompt message is used to indicate that the abnormal subtable records abnormal data and the abnormal cell where the abnormal data is located, thereby achieving the purpose of automatically and efficiently identifying and locating data differences, thereby achieving the technical effect of more efficiently managing and analyzing business data, and further solving the technical problem of complex data processing flow and low efficiency in determining abnormal data due to excessive data volume. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0018] Figure 1 is a schematic diagram of an application environment of an optional data processing method according to an embodiment of the present application;

[0019] Figure 2 is a flowchart of an optional data processing method according to an embodiment of the present application;

[0020] Figure 3 is a schematic diagram of an optional data processing method according to an embodiment of the present application;

[0021] Figure 4 is a schematic diagram of another optional data processing method according to an embodiment of the present application;

[0022] Figure 5 is a schematic diagram of another optional data processing method according to an embodiment of the present application;

[0023] Figure 6 is a schematic diagram of another optional data processing method according to an embodiment of the present application;

[0024] Figure 7 is a schematic structural diagram of an optional data processing device according to an embodiment of the present application;

[0025] Figure 8 is a schematic diagram of the structure of an optional data processing product according to an embodiment of the present application;

[0026] Fig. 9 It is a schematic diagram of the structure of an optional electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0029] The present application is described below in conjunction with embodiments:

[0030] According to one aspect of an embodiment of the present application, a data processing method is provided. Optionally, in this embodiment, the data processing method can be applied to Figure 1 In the hardware environment composed of the server 101 and the terminal device 103 shown in FIG. Figure 1As shown, the server 101 is connected to the terminal 103 via a network, and can be used to provide services for the terminal device or the application installed on the terminal device. The application can be a video application, an instant messaging application, a browser application, an educational application, a game application, etc. A database 105 may be set up on the server or independently of the server to provide data storage services for the server 101, for example, a game data storage server. The above-mentioned network may include, but is not limited to, a wired network and a wireless network, wherein the wired network includes, for example, a local area network, a metropolitan area network, and a wide area network; the wireless network includes, for example, Bluetooth, WIFI, and other networks that implement wireless communication; the terminal device 103 may be a terminal configured with an application program, and may include, but is not limited to, at least one of the following: a mobile phone (such as an Android phone, an iOS phone, etc.), a laptop computer, a tablet computer, a PDA, a MID (Mobile Internet Devices), a PAD, a desktop computer, a smart TV, an intelligent voice interaction device, a smart home appliance, a vehicle-mounted terminal, an aircraft, a virtual reality (VR) terminal, an augmented reality (AR) terminal, a mixed reality (MR) terminal, and other computer devices; the above-mentioned server may be a single server, a server cluster consisting of multiple servers, or a cloud server.

[0031] Combination Figure 1 As shown, the above data processing method can be executed by an electronic device, which can be a terminal device or a server. The above data processing method can be implemented by the terminal device or the server respectively, or by the terminal device and the server together.

[0032] The above is only an example and is not specifically limited in this embodiment.

[0033] Optionally, as an optional implementation, as Figure 2 As shown, the above data processing method includes:

[0034] S202, obtaining a summary table and table type related to the target business system, wherein the summary table is used to record the first business data to be compared;

[0035] Optionally, in an embodiment of the present application, the target business system may include but is not limited to a financial management system, a data warehouse system, etc. The summary table refers to one or more predefined electronic forms for extracting and summarizing key business data from various business subsystems. The summary table may include but is not limited to key performance indicators (KPIs), totals, averages, percentages and other summary data, and the summary table may be an Excel worksheet, a CSV file, a database table or any other supported data format. The table types may include but are not limited to financial statements, such as an income statement, a balance sheet, a cash flow statement, a sales report, an inventory report, etc. The first business data refers to the business data recorded in any cell in the summary table, including but not limited to sales data, financial data, inventory data, etc.

[0036] For example, Figure 3 is a schematic diagram of an optional data processing method according to an embodiment of the present application, and the summary table is as follows Figure 3 shown.

[0037] S204, determining a group of anchor cells according to the characteristic data corresponding to each cell in the summary table, wherein the characteristic data is used to represent the cell attributes of the corresponding cell, and the cell attributes of different anchor cells in the group of anchor cells meet different preset attribute conditions;

[0038] Optionally, in an embodiment of the present application, the above-mentioned feature data may include but is not limited to the location information of the cell: including the row number, column number or cell address (such as A1, B2, etc.) of the cell, which is used to accurately locate the position of the cell in the table, the data type of the cell: refers to the type of data in the cell, such as numeric value, text, date, currency, etc., the format of the cell: including visual attributes such as font, color, alignment, border style, etc., the content of the cell: the specific data or text in the cell, the label or comment of the cell: the explanatory text attached to the cell, which may contain an explanation of the cell content or additional information, the status of the cell: whether it is locked, whether editing is allowed, and other permission information, the above-mentioned set of anchor cells may include but is not limited to the starting cell of the table, the starting cell of the data area, the ending cell of the data area, etc., that is, the cell properties of the above-mentioned cells include but are not limited to the border properties of the cell (whether there is a border, border color, etc.), the data properties of the cell (data type, fill content, label or comment), etc.

[0039] Furthermore, the above-mentioned preset attribute conditions may include but are not limited to being pre-defined according to business needs and data characteristics. The preset attribute conditions corresponding to the above-mentioned summary tables of different table types may be the same or different, so that a group of anchor cells corresponding to the above-mentioned summary tables of different table types may be the same or different.

[0040] In an exemplary embodiment, the above-mentioned preset attribute condition may include but is not limited to several sub-conditions. If a cell A in the above-mentioned summary table satisfies a sub-condition A of the above-mentioned preset attribute condition, the cell A satisfying the sub-condition will be automatically determined as a cell in the above-mentioned set of anchor cells. If a cell B in the above-mentioned summary table satisfies a sub-condition B of the above-mentioned preset attribute condition, the cell B satisfying the sub-condition will be automatically determined as a cell in the above-mentioned set of anchor cells.

[0041] It should be noted that the cells in the above-mentioned summary table either meet one sub-condition of the above-mentioned preset attribute conditions, or do not meet all the sub-conditions of the above-mentioned preset attribute conditions, ensuring that the process of determining the above-mentioned set of anchor cells is clear, thereby improving the accuracy and efficiency of cell data processing.

[0042] Specifically, the sub-conditions in the above-mentioned preset attribute conditions can be understood as: the characteristic data of a cell indicates that the cell has a right border and a bottom border, and the cells to the right and the cells below the cell have no fill content or no border and no fill color, and at the same time, the cells in the N columns to the right of the cell have no fill content or border and no fill color, and the value of N is greater than or equal to 1, and another sub-condition in the above-mentioned preset attribute conditions can be understood as: the characteristic data of a cell indicates that the cell has a left border and a top border, and the cells to the left and the cells above the cell have no fill content or no border and no fill color, and at the same time, the cells in the M columns to the left of the cell have no content or border and no fill color, and the value of M is greater than or equal to 1.

[0043] S206, determining a plurality of business sub-tables based on a table type, and determining a plurality of business sub-data corresponding to the plurality of business sub-tables based on a set of anchor cells, wherein the table type is the same as the table type of each sub-table in the plurality of business sub-tables, the set of anchor cells is used to determine a target cell that needs to be compared, and a corresponding target cell in one of the plurality of business sub-tables is used to record one type of data in the plurality of business sub-data;

[0044] Optionally, in an embodiment of the present application, the above-mentioned multiple business sub-tables refer to detailed data tables collected from various business departments or subsidiaries, each table containing a specific type of data, such as sales data, financial data, inventory data, etc., and the above-mentioned multiple business sub-tables are of the same table type as the above-mentioned summary table. In other words, the two have the same structure, column headers, data processing rules, etc.

[0045] In an exemplary embodiment, assuming that the table type of the summary table is a financial table type, the table naming prefix is ​​"SF", correspondingly, the table type of each table in the above multiple business sub-tables is also a financial table type, and the table naming prefix is ​​also "SF".

[0046] Furthermore, one of the multiple business sub-data is recorded in a business sub-table. The multiple business sub-data may be a single numerical value, a text string, a date, etc. The target cell has the same number of rows and columns as the cell where the first business sub-data is located in the summary table.

[0047] In an exemplary embodiment, the anchor cell in the summary table is located in the 3rd row and the B column. Then, in each business sub-table, the target cell corresponding to the anchor cell should also be located in the 3rd row and the B column.

[0048] S208, performing a summary operation on the plurality of business sub-data to obtain second business data, comparing the first business data with the second business data, determining an abnormal sub-table, and generating a target prompt message, wherein the target prompt message is used to indicate that abnormal data and an abnormal cell where the abnormal data are located are recorded in the abnormal sub-table.

[0049] Optionally, in an embodiment of the present application, the above-mentioned summary operation may include but is not limited to summing, averaging, finding the maximum or minimum value, etc., the above-mentioned second business data may include but is not limited to sales data, financial data, inventory data, etc., the above-mentioned target prompt message may include but is not limited to display through text, image, video, etc., and the above-mentioned abnormal data may include but is not limited to abnormal data caused by data input errors, missing data, data outside the normal range, etc.

[0050] In an exemplary embodiment, the above-mentioned target prompt message may include but is not limited to the name or identifier of the abnormal sub-table, the description of the abnormal data, such as "amount does not match", "data is missing", etc., and the location of the abnormal cell of the abnormal sub-table (when the data in the above-mentioned target cell is abnormal, the target cell will be determined as an abnormal cell), such as "row 3, column C", etc.

[0051] In another exemplary embodiment, assuming that it is necessary to perform an abnormal comparison on the data in the third row and the C column of the summary table to determine whether the data is correct, the total score comparison can be performed according to the data processing method proposed in the present application. Specifically, Figure 4 yes Figure 4 is a schematic diagram of another optional data processing method according to an embodiment of the present application, such as Figure 4 As shown:

[0052] S402, obtaining a summary table, and determining a table type according to a table name or table path of the summary table, for example, the table type of a table in a folder under a certain path is determined by the name of the folder (for example, if the folder name is "financial data", the table type is a financial table type), or the table type is determined only by the table name of the summary table (for example, if the table name is "inventory data", the table type is an inventory table type);

[0053] S404, determining a table start area, a data start area, and a table end area of ​​the summary table, and using cells corresponding to the table start area, the data start area, and the table end area as a group of anchor cells;

[0054] S406, determining the first business data to be compared in the summary table, including but not limited to manually specifying the location of the cell where the first business data is located (for example, it is necessary to perform an abnormal comparison on the data in the third row and the C column in the summary table), or directly comparing each business data in the data area recorded in the summary table, that is, each business data in the data area is determined to be the above-mentioned first business data;

[0055] S408, reading multiple business sub-tables whose table type is the same as that of the summary table;

[0056] S410, determining target cells in the multiple business subtables in sequence according to the position of the cell where the first business data is located. For example, if the cell where the first business data is located is in the 3rd row and the B column, then the target cell is also a cell in the 3rd row and the B column in each of the multiple business subtables.

[0057] S412, sequentially determining whether the row header and column header corresponding to the target cell in each of the multiple business sub-tables are the same as the row header and column header corresponding to the cell where the first business data is located; if they are the same, reading the business sub-data of the target cell; otherwise, reading the row header and column header corresponding to the target cell in the next sub-table for determination, until all the business sub-tables are read;

[0058] S414, performing a summary operation on the business sub-data to obtain second business data;

[0059] S416, determine whether the second business data is the same as the first business data, and determine the target cell whose row title and column title are different from the row title and column title corresponding to the cell where the first business data is located in step S412 as an abnormal cell, and if the data value in the target cell is 0, the cell with empty data is also determined as an abnormal cell, and generate target prompt information.

[0060] Through the embodiments of the present application, a summary table and table type related to the target business system are obtained, wherein the summary table is used to record the first business data to be compared; a group of anchor cells are determined according to the characteristic data corresponding to each cell in the summary table, wherein the characteristic data is used to represent the cell attributes of the corresponding cells, and the cell attributes of different anchor cells in a group of anchor cells meet different preset attribute conditions; multiple business sub-tables are determined based on the table type, and multiple business sub-data corresponding to the multiple business sub-tables are determined based on the group of anchor cells, wherein the table type is the same as the table type of each sub-table in the multiple business sub-tables, and a group of anchor cells are used to determine the business data that need to be compared. A target cell, a target cell corresponding to a subtable in a plurality of business subtables is used to record a type of data of the plurality of business subdata; a summary operation is performed on the plurality of business subdata to obtain a second business data, the first business data and the second business data are compared, the abnormal subtable is determined, and a target prompt message is generated, wherein the target prompt message is used to indicate that the abnormal subtable records abnormal data and the abnormal cell where the abnormal data is located, thereby achieving the purpose of automatically and efficiently identifying and locating data differences, thereby achieving the technical effect of more efficiently managing and analyzing business data, and further solving the technical problem of complex data processing flow and low efficiency in determining abnormal data due to excessive data volume.

[0061] As an optional scheme, the above-mentioned determining a group of anchor cells according to the characteristic data corresponding to each cell in the above-mentioned summary table includes: obtaining the characteristic data of each cell in the above-mentioned summary table, wherein the above-mentioned characteristic data includes border characteristic data and data characteristic data of the above-mentioned cell, the above-mentioned border characteristic data is used to indicate whether each border of the corresponding cell exists, and the above-mentioned data characteristic data is used to indicate the data format recorded in the corresponding cell; when the above-mentioned characteristic data satisfies the first attribute condition, the corresponding cell is determined as the table starting area of ​​the above-mentioned group of anchor cells, wherein the above-mentioned table starting area has a first border and a second border, and the first adjacent cell in the first direction and the second direction of the above-mentioned table starting area has no border and fill color, or the above-mentioned first adjacent cell has no content, or the above-mentioned first adjacent cell does not exist, and the above-mentioned first direction and the above-mentioned second direction are perpendicular to each other; when the above-mentioned characteristic data satisfies the second attribute condition In the case where the characteristic data satisfies the third attribute condition, the corresponding cell is determined as the data starting area of ​​the group of anchor cells, wherein the data type of the second adjacent cell in the first direction and the second direction of the data starting area is a character type, and the data type of the third adjacent cell in the third direction and the fourth direction of the data starting area is not a character type, the third direction is opposite to the first direction, the fourth direction is opposite to the second direction, and the cell corresponding to the data starting area has no border and fill color or has no content; in the case where the characteristic data satisfies the third attribute condition, the corresponding cell is determined as the table ending area of ​​the group of anchor cells, wherein the table ending area has a third border and a fourth border, and the fourth adjacent cell in the third direction and the fourth direction of the table ending area has no border and fill color, or the fourth adjacent cell has no content, or the fourth adjacent cell does not exist.

[0062] Optionally, in an embodiment of the present application, the above-mentioned feature data can be used to describe the border features, data features, etc. of each of the above-mentioned cells. The above-mentioned border feature data may include but are not limited to: border color, border width, border height, and whether there is an upper border: indicating whether there is a border on the top of the cell; whether there is a lower border: indicating whether there is a border on the bottom of the cell; whether there is a left border: indicating whether there is a border on the left side of the cell; whether there is a right border: indicating whether there is a border on the right side of the cell, and may include but are not limited to being represented by binary codes and Boolean values.

[0063] In an exemplary embodiment, a four-bit binary number 1111 may indicate that all borders of a cell exist, while 0000 indicates that there are no borders; alternatively, each border may be a Boolean value (True / False), where True indicates that the border exists and False indicates that it does not exist.

[0064] Optionally, in an embodiment of the present application, the above-mentioned data feature data may include but is not limited to: data type: such as text, numbers, dates, currency, etc.; data format: for example, numbers may include decimal points and are represented by red fonts, and dates may have a specific format (such as YYYY-MM-DD); data length: the character length of the data in a cell or the number of digits; data integrity: whether the data is complete and whether there are missing values; data consistency: whether the data conforms to the format of other similar cells in the table.

[0065] In an exemplary embodiment, obtaining the above characteristic data may include but is not limited to taking the following steps:

[0066] S1, parse the table: use table parsing tools or libraries (such as Python's pandas and openpyxl) to read the data in the above summary table;

[0067] S2, traverse cells: traverse each cell in the table.

[0068] S3, extract border features: check the border style of each cell and record it.

[0069] S4, extract data features: analyze the data in the cell and determine its type, format and other characteristics.

[0070] S5, summarize feature data: store the extracted feature data in a list, dictionary or directly in a database.

[0071] Exemplarily, after the characteristic data is obtained, the group of anchor cells (including the table start area, data start area, and table end area) may be determined according to the characteristic data.

[0072] Optionally, in an embodiment of the present application, the first border and the second border may be, respectively, an upper border and a left border. Correspondingly, the first direction and the second direction may be, respectively, an upward direction and a left direction; the first adjacent cell refers to the cell adjacent to the top and the cell adjacent to the left of the starting area of ​​the table.

[0073] In an exemplary embodiment, assuming that the above-mentioned first attribute condition corresponding to the summary table is that the cell must have a top border and a left border, the above-mentioned first direction and the second direction can be an upward direction and a left direction, respectively. If the cell is located in the first row and column A, and its left and upper cells have no borders or fill colors, or the left and upper cells are empty, or the cell is the upper left edge cell of the summary table, then the cell can be determined as the starting area of ​​the table, or as a component of the starting area of ​​the table.

[0074] Optionally, in an embodiment of the present application, the first direction and the third direction are opposite, assuming that the first direction is an upward direction, the third direction is a downward direction; the fourth direction and the second direction are opposite, assuming that the second direction is a left direction, the fourth direction is a right direction; the second adjacent cell refers to the adjacent cell above the data starting area and the adjacent cell on the left, and the third adjacent cell refers to the adjacent cell below the data starting area and the adjacent cell on the right; the character types may include but are not limited to Chinese characters, English characters, etc., and there is no data in the data starting area.

[0075] In an exemplary embodiment, Figure 5 is a schematic diagram of another optional data processing method according to an embodiment of the present application, such as Figure 5 The method includes a data starting area, a second adjacent cell, and a third adjacent cell.

[0076] Optionally, in an embodiment of the present application, the third border and the fourth border may be respectively: a bottom border and a right border; the fourth adjacent cell refers to an adjacent cell above the end area of ​​the table and an adjacent cell on the right.

[0077] In an exemplary embodiment, assuming that the third attribute condition corresponding to the summary table is that the cell must have a bottom border and a right border, the first direction and the second direction can be the downward direction and the right direction, respectively. If the cell is located in the seventh row and the Sth column, and the cells to the right and below it have no borders or fill colors, or the cells to the right and below are empty, or the cell is the edge cell at the bottom right of the summary table, then the cell can be determined as the end area of ​​the table, or as a component of the end area of ​​the table.

[0078] Through the embodiments of the present application, the above-mentioned set of anchor cells is determined by utilizing the characteristic data of each cell of the summary table, that is, by defining clear characteristic data judgment conditions to adapt to different table style changes, the robustness of data processing is improved.

[0079] As an optional scheme, the above-mentioned determining multiple business sub-tables based on the above-mentioned table type, and determining multiple business sub-data corresponding to the above-mentioned multiple business sub-tables based on the above-mentioned set of anchor cells, include: creating a multi-level target index based on the above-mentioned set of anchor cells, wherein the above-mentioned multi-level target index is used to indicate the position of each row header and column header in the above-mentioned summary table in the above-mentioned summary table; determining multiple business sub-tables based on the above-mentioned table type, and obtaining the above-mentioned multiple business sub-data from the above-mentioned multiple business sub-tables based on the above-mentioned multi-level target index and a predetermined target number of rows and target number of columns.

[0080] Optionally, in an embodiment of the present application, the above-mentioned multi-level target index refers to an index structure used to locate and reference a specific data area in a table, which may include but is not limited to implementation using the Python programming language, and the above-mentioned target number of rows and target number of columns refers to the number of rows and columns of the above-mentioned target cells, that is, the number of rows and columns of the cells where the above-mentioned first business data is located in the summary table.

[0081] In an exemplary embodiment, an empty outer dictionary is first set up (for storing data in the summary table, with an inner dictionary embedded in it), and the table rows and columns are traversed in turn to identify row headers, and a key is created for each row header in the outer dictionary, and a key is created for each column header in the corresponding inner dictionary, and the position (number of rows and columns) of each combination of row header and column header in the summary table is recorded as an index value.

[0082] In another exemplary embodiment, if the summary table has multiple levels of row headers and column headers, taking the row headers as an example, an empty outer dictionary can be created first, which will serve as the root of the multi-level target index. Then, the first-level row headers are processed: the first row of the summary table is traversed, each first-level row header is identified, and for each first-level row header, a key is created in the outer dictionary and a new dictionary is assigned to it as a value. Then, the second-level row headers are processed. Under each first-level row header, the next row of the summary table is traversed, each second-level row header is identified, and for each second-level row header, a key is created in the dictionary of the first-level row header and a new dictionary is assigned to it as a value. If the summary table has more levels of row headers, continue to create dictionaries for each higher-level header until all levels of headers are processed. Finally, under the lowest-level header, the starting row number of the data corresponding to the header in the summary table is recorded. Similarly, the multi-level column headers are processed in the same way as the multi-level row headers, and the position (number of rows and columns) of each combination of row header and column header in the summary table is recorded as the index value.

[0083] Exemplarily, after creating a multi-level target index of the summary table, the row headings corresponding to the target number of rows and the column headings corresponding to the target number of columns can be determined based on the target number of rows and the target number of columns as index values.

[0084] Through the embodiment of the present application, the above-mentioned multi-level target indexing method is adopted to efficiently locate and extract the row header and column header corresponding to the cell where the first business data in the table is located.

[0085] As an optional scheme, the above-mentioned multiple business sub-tables are determined based on the above-mentioned table type, and the above-mentioned multiple business sub-data are obtained from the above-mentioned multiple business sub-tables based on the above-mentioned multi-level target index and the predetermined target number of rows and target number of columns, including: determining the first row title in the above-mentioned summary table according to the above-mentioned target number of rows in the above-mentioned multi-level target index, and determining the first column title in the above-mentioned summary table according to the above-mentioned target number of columns in the above-mentioned multi-level target index; determining the second row title of each sub-table in the above-mentioned multiple business sub-tables according to the above-mentioned target number of rows in the above-mentioned multi-level target index, and determining the second column title of each sub-table in the above-mentioned multiple business sub-tables according to the above-mentioned target number of columns in the above-mentioned multi-level target index; when the above-mentioned second row title is the same as the above-mentioned first row title, and the above-mentioned second column title is the same as the above-mentioned first column title, the data recorded in the cell determined by the above-mentioned second row title and the above-mentioned second column title is determined as the above-mentioned multiple business sub-data.

[0086] Optionally, in an embodiment of the present application, the first row title and the second row title can both be multi-level row titles or single-level row titles, and the first column title and the second column title can both be multi-level column titles or single-level column titles.

[0087] In an exemplary embodiment, a multi-level target index is first created for a summary table and each of the multiple business sub-tables, and the target number of rows and the target number of columns are used as index values ​​to determine the first-level row header and the column header corresponding to the summary table, and the target number of rows and the target number of columns are used as index values ​​to determine the second-level row header and the column header corresponding to each business sub-table. If the second-level row header is the same as the first-level row header, and the second-level column header is the same as the first-level column header, then the data in the target cell determined by the target number of rows and the target number of columns is determined as the above-mentioned business sub-data.

[0088] Through the embodiments of the present application, the purpose of accurately extracting specific business data from summary tables and a large number of business sub-tables is achieved, and data segmentation and extraction can also be effectively performed in the face of a complex table structure with multiple layers of headers.

[0089] As an optional scheme, before determining multiple business sub-tables based on the above-mentioned table type and determining multiple business sub-data corresponding to the above-mentioned multiple business sub-tables based on the above-mentioned set of anchor cells, the above-mentioned method also includes: obtaining a pre-set parameter configuration file, wherein the above-mentioned parameter configuration file is used to record different anchor cells corresponding to different table types; determining the above-mentioned table type according to the identifier of the above-mentioned summary table; and querying the above-mentioned set of anchor cells corresponding to the above-mentioned table type from the above-mentioned parameter configuration file.

[0090] Optionally, in an embodiment of the present application, the above-mentioned parameter configuration file may include but is not limited to recording the positions (number of rows, number of columns, etc.) of different groups of anchor cells corresponding to different table types, and the identifier of the above-mentioned summary table may be any unique identifier, such as a table file name, a table file path, a table name or other table-specific attributes, such as characters in a specific position in the table name, etc.

[0091] In an exemplary embodiment, Figure 6 is a schematic diagram of another optional data processing method according to an embodiment of the present application, such as Figure 6 As shown, the parameter configuration file includes a table type of "SF", corresponding to a group of anchor cells: the table starting area with 1 row and A columns; the data starting area with 3 rows and D columns; the table ending area with 50 rows and S columns; the table type is "SG", corresponding to a group of anchor cells: the table starting area with 1 row and A columns; the data starting area with 4 rows and C columns; the table ending area with 100 rows and S columns.

[0092] Through the embodiments of the present application, the above-mentioned parameter configuration file allows the system to flexibly adapt to the processing requirements of different table types, and is easy to expand to support new table types, thereby achieving efficient and accurate processing of table data.

[0093] As an optional scheme, after querying the above-mentioned set of anchor cells corresponding to the table type of the above-mentioned target summary table from the above-mentioned parameter configuration file, the above-mentioned method also includes: in the case that the above-mentioned set of anchor cells are queried from the above-mentioned parameter configuration file, obtaining the above-mentioned multiple business sub-data according to the above-mentioned set of anchor cells; in the case that the above-mentioned set of anchor cells are not queried from the above-mentioned parameter configuration file, determining the above-mentioned set of anchor cells based on the above-mentioned characteristic data, and obtaining the above-mentioned multiple business sub-data according to the above-mentioned set of anchor cells, wherein the above-mentioned table type, the above-mentioned set of anchor cells and the corresponding association relationship are set to be stored in the above-mentioned parameter configuration file.

[0094] Exemplarily, before determining a group of anchor cells of the above-mentioned summary table, the table type, the above-mentioned group of anchor cells and the corresponding association relationships recorded in the above-mentioned parameter configuration file can be read first, as in the embodiment of the present application. If a group of anchor cells corresponding to the table type of the above-mentioned summary table is not found, the data in the summary table is read, a group of anchor cells is determined according to the above-mentioned characteristic data, and a group of anchor cells corresponding to the table type of the summary table and the corresponding association relationships are written into the above-mentioned parameter configuration file, so as to facilitate the subsequent direct determination of the above-mentioned group of anchor cells when processing a table with the same table type as the summary table.

[0095] Through the embodiments of the present application, using a pre-set parameter configuration file, the system can quickly locate the anchor cell that matches the summary table type, thereby improving the efficiency of data processing.

[0096] As an optional scheme, the above-mentioned aggregation operation is performed on the above-mentioned multiple business sub-data to obtain the second business data, the above-mentioned first business data and the above-mentioned second business data are compared, the abnormal sub-table is determined, and a target prompt message is generated, including: summing the above-mentioned multiple target business sub-data to obtain the above-mentioned second business data; when the above-mentioned first business data is different from the above-mentioned second business data, comparing the difference between the historical value and the current value of each data in the above-mentioned multiple target business sub-data to see if they meet the preset difference condition; when the difference between the historical value and the current value of the abnormal data in the above-mentioned multiple target business sub-data does not meet the above-mentioned preset difference condition, determining the table in the above-mentioned multiple target business sub-tables that records the above-mentioned abnormal data as the above-mentioned abnormal sub-table, and generating a target prompt message.

[0097] Optionally, in an embodiment of the present application, the above-mentioned preset difference condition can be flexibly adjusted, and the present application does not limit this. The preset difference condition can be adjusted according to actual needs to adapt to different business rules and anomaly detection standards, and the historical value of the above-mentioned abnormal data may include but is not limited to the historical record of the data over a period of time, for example, the previous value.

[0098] In an exemplary embodiment, assume that the target cell in subtable A records the sales amount of enterprise A in this quarter, and the current value is 30. At this time, the historical value of the above abnormal data can be understood as the value of the sales amount of enterprise A in the previous quarter, which is assumed to be 70. Since the above preset difference condition is, if the difference between the historical value and the current value of the abnormal data exceeds 30, at this time, the difference between the historical value and the current value (|30-70|=40) does not meet the preset difference condition, then the abnormal cell is considered to be the target cell in the abnormal subtable A, and the abnormal subtable is subtable A.

[0099] Through the embodiments of the present application, abnormal situations in business sub-data can be discovered in a timely manner, so that corresponding measures can be taken to solve the problems and ensure the accuracy and reliability of the data.

[0100] Exemplarily, the data processing method proposed in the present application can be applied to the total score comparison application scenario of the financial regulatory report. The data format of the financial regulatory report is described by the three-point (cells in the above-mentioned set of anchor cells) one report method, which can simply, conveniently and quickly realize the data aggregation of the report and the tracking and positioning of the data source. First, the terms appearing in the embodiments of the present application are explained:

[0101] Financial regulatory reports: Financial regulatory reports are reports submitted by banks and other financial institutions to relevant financial regulatory agencies in order to meet regulatory requirements. These reports usually contain multiple parts to comprehensively reflect the operating conditions, risk conditions, financial conditions and other aspects of financial institutions. The main purpose is to help regulatory authorities understand and take corresponding regulatory measures to ensure the stability and security of the financial market.

[0102] Dictionary data structure: A dictionary is a data structure in Python that can store any type of object. It is an unordered, mutable sequence, and its elements are stored in the form of "key-value pairs". The biggest feature of a dictionary is that it has a very fast access speed. No matter how much data is in the dictionary, the access speed is almost the same.

[0103] Multi-layer index (multiindex): MultiIndex is an index concept used in the data analysis and processing library pandas dataframe. It supports dataframe to have multiple index levels, so that structured data can be flexibly processed and operated.

[0104] Specifically, the structure of each type of Excel report page is described through three anchor points of Excel (the above-mentioned set of anchor cells), and the total score comparison is simply achieved through multi-layer index and dictionary data structure. It has strong versatility and supports various current regulatory report formats. The three anchor points are three location points of Excel, and each point is the location point of a cell in Excel, including the row number and column number of the Excel. The regional block recognition algorithm is written to automatically identify the three anchor points, and the location and regional block information of the row title, column title, data area, and remarks area are automatically calculated based on the row and column coordinate information of the three anchor points, so as to give each cell the three labels of row direction title, column direction title, and cell position, and use labels to distinguish the report cell position. The three anchor points of each type of report can define the format of each type of report. Compared with traditional technologies, it greatly reduces the workload caused by the adjustment of the report format and reduces the relevant transformation time required for report changes.

[0105] In an exemplary embodiment, the total score comparison process of the summary table and the business subtable records the data and location information of the relevant data sources through a dictionary data structure. When a difference occurs and needs to be traced, the auxiliary information such as the values, proportions, and historical changes of the difference is automatically and quickly displayed through the dictionary data structure, so as to quickly locate the possible error source files of the error data (the above-mentioned abnormal subtable, compared with the prior art, does not need to open each compared business subtable one by one, which is faster and more convenient in effect.

[0106] It should be noted that when comparing the total score of financial regulatory reports, the three-point one-report method is adopted. The three position points can be used to distinguish the report row and column headers, data and other areas. The recognition algorithm for data block recognition is written by the self-written data block recognition algorithm. The starting coordinates and sizes of the header row area block, project column area block, regulatory indicator value area block, middle merged cell area block, annotation area block, reporting date and reporting person and reviewer area block, no data area block, formula area block and other types of area blocks can be calculated by the self-calculation. The area block type covers the current report format and realizes universality. When the report format is adjusted (including the adjustment of the data start position and the area position), it only determines the changes of the three position points, does not involve the modification of the data model and the code, is universal, and can maintain the stability of the original functions, and uses a dictionary data structure type to record the storage of report data sources, report types and various types of data area block information. At the same time, files with larger data volumes can be pre-processed into serialized binary files, so that the size of the data volume or the number of compared files has little effect on the call report total score comparison process. At the same time, it provides a fast tracing function to simplify the report total score comparison process and greatly reduce the source data tracking and search time of the difference items.

[0107] Specifically, by defining the starting position point of the row title position, the starting position point of the data area, and the ending position point of the data area, the business personnel directly complete the report format description. The underlying algorithm automatically completes the report row title area division, column title area division, and data area division according to the three position points, and on this basis, it can flexibly realize the data aggregation of subsidiary institutions and the data comparison of parent institutions. The three-point one report method is intuitive and easy to operate, and can flexibly respond to report format adjustments.

[0108] In an exemplary embodiment, it is necessary to make a total score comparison for the indicator data value (first business data) of the red-marked H10 cell (target cell) in the summary table. First, the data block recognition algorithm is used to obtain that the cell belongs to the data area block, and the row title of the cell indicator data is obtained from the header row area block and the project column area block: the serial number is 3, the classification is the loan balance, the project is 1.1.2 attention-class loans according to the five-level classification of loans; the column title is the various types of enterprises in C1 (divided by the nature of holding), including small and micro enterprises. According to the report type SF63, the file path corresponding to the SF63 type report corresponding to each sub-institution is found in the pre-processed dictionary data structure, and the corresponding cell value is found according to the matching of the row title and the column title, the indicator data value in each sub-file is calculated, and compared with the indicator data value in the summary file to see if they are equal. Finding indicator data through information such as row and column titles is more flexible and versatile than finding through fixed positions, and it is convenient to process data files of different formats. While calculating the total score comparison, the sub-process information of the entire comparison is retained. If there is a difference, the detailed information on the source of each value can be displayed in reverse. In addition, by providing the change range and change ratio of the historical data of the indicator data value as a reference, it is helpful to locate whether the data in the sub-file is abnormal.

[0109] Furthermore, the generation of title rows and title columns is an important auxiliary step. In the three-point position relationship, according to the first and second position points, the starting row number and column number of the header row title and the starting row number and column number of the header column title are obtained. Next, calculate the row title area above and the column title area on the left. Read multiple rows in the row title area into the pandas dataframe structure at one time to form a multiindex (multi-level index). Multiindex allows the dataframe to have multiple index levels to meet the scenario of processing multiple merged cells for row titles, similar to the composite primary key in the database. Re-parse the multiindex, process duplicates and prefixes in the subsidiary index, and convert them into indexes that conform to the regulatory report format. The column title processing first transposes the dataframe rows and columns, and then forms a multi-level index using a similar processing method to the row title. Multi-level indexing is very useful when processing complex data structures. The row and column headers use a multi-level index structure, which can group, slice and summarize the regulatory indicator data in complex format files, so as to provide an efficient and general total score comparison method. Since there are many parameters (anchor cell data) that are easy to confuse, many parameters control the areas to be compared, and parameter configuration files can be pre-set. Automatic area identification can better ensure the normal and compliance of the system's data processing process, and promptly discover and respond to potential data anomalies, abnormal operation of the running process and violations, to protect the accuracy and efficiency of data processing.

[0110] In addition, when saving table data, the report data area division can be changed to manual marking in the parameter file. Through the embodiment of the present application, the total score comparison based on the three-point one report method only needs to define 3 Excel cell positions for each type of new report. The total score comparison of this type of report can be achieved through configuration. There is no need for function definition or VBA development. It has high efficiency and flexible scalability. By pre-loading the data of the summary organization and sub-organization into the dictionary data structure, it can provide users with fast tracing and location of the cause of the difference at any time, provide rich comparison methods, and improve the limitations of the existing technology.

[0111] It is understandable that in the specific implementation of this application, related data such as user information is involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0112] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0113] According to another aspect of the embodiment of the present application, a data processing device for implementing the above data processing method is also provided. Figure 7 As shown, the device comprises:

[0114] An acquisition module 702 is used to acquire a summary table and table type related to the target business system, wherein the summary table is used to record the first business data to be compared;

[0115] A first determination module 704 is used to determine a group of anchor cells according to the characteristic data corresponding to each cell in the summary table, wherein the characteristic data is used to represent the cell attributes of the corresponding cell, and the cell attributes of different anchor cells in the group of anchor cells meet different preset attribute conditions;

[0116] A second determination module 706 is used to determine a plurality of business sub-tables based on a table type, and to determine a plurality of business sub-data corresponding to the plurality of business sub-tables based on a set of anchor cells, wherein the table type is the same as the table type of each sub-table in the plurality of business sub-tables, the set of anchor cells is used to determine a target cell that needs to be compared, and a corresponding target cell in one of the plurality of business sub-tables is used to record one type of data in the plurality of business sub-data;

[0117] The execution module 708 is used to perform a summary operation on multiple business sub-data to obtain second business data, compare the first business data and the second business data, determine the abnormal sub-table, and generate a target prompt message, wherein the target prompt message is used to indicate that the abnormal sub-table records abnormal data and the abnormal cell where the abnormal data is located.

[0118] As an optional solution, the device is used to determine a group of anchor cells according to the characteristic data corresponding to each cell in the summary table in the following manner: obtain the characteristic data of each cell in the summary table, wherein the characteristic data includes the border characteristic data and data characteristic data of the cell, the border characteristic data is used to indicate whether each border of the corresponding cell exists, and the data characteristic data is used to indicate the data format of the corresponding cell record; when the characteristic data satisfies the first attribute condition, determine the corresponding cell as the table starting area of ​​a group of anchor cells, wherein the table starting area has a first border and a second border, and the first adjacent cell in the first direction and the second direction of the table starting area has no border and fill color, or the first adjacent cell has no content, or the first adjacent cell does not exist, and the first direction and the second direction are perpendicular to each other; when the characteristic data satisfies the first attribute condition In the case of the second attribute condition, the corresponding cell is determined as the data starting area of ​​a group of anchor cells, wherein the data type of the second adjacent cell in the first direction and the second direction of the data starting area is a character type, and the data type of the third adjacent cell in the third direction and the fourth direction of the data starting area is not a character type, the third direction is opposite to the first direction, and the fourth direction is opposite to the second direction, and the cell corresponding to the data starting area has no border and fill color or has no content; in the case that the characteristic data satisfies the third attribute condition, the corresponding cell is determined as the table end area of ​​a group of anchor cells, wherein the table end area has a third border and a fourth border, and the fourth adjacent cell in the third direction and the fourth direction of the table end area has no border and fill color, or the fourth adjacent cell has no content, or the fourth adjacent cell does not exist.

[0119] As an optional solution, the device is used to determine multiple business sub-tables based on the table type, and determine multiple business sub-data corresponding to the multiple business sub-tables based on a set of anchor cells in the following manner: create a multi-level target index based on a set of anchor cells, wherein the multi-level target index is used to indicate the position of each row header and column header in the summary table; determine multiple business sub-tables based on the table type, and obtain multiple business sub-data from the multiple business sub-tables based on the multi-level target index and a predetermined target number of rows and a predetermined number of target columns.

[0120] As an optional scheme, the device is used to determine multiple business sub-tables based on the table type in the following manner, and obtain multiple business sub-data from the multiple business sub-tables based on the multi-level target index and the predetermined target number of rows and target number of columns: determine the first row header in the summary table according to the target number of rows in the multi-level target index, and determine the first column header in the summary table according to the target number of columns in the multi-level target index; determine the second row header of each sub-table in the multiple business sub-tables according to the target number of rows in the multi-level target index, and determine the second column header of each sub-table in the multiple business sub-tables according to the target number of columns in the multi-level target index; when the second row header is the same as the first row header, and the second column header is the same as the first column header, determine the data recorded in the cell determined by the second row header and the second column header as multiple business sub-data.

[0121] As an optional solution, the device is also used to: determine multiple business sub-tables based on the table type, and before determining multiple business sub-data corresponding to the multiple business sub-tables based on a set of anchor cells, obtain a pre-set parameter configuration file, wherein the parameter configuration file is used to record different anchor cells corresponding to different table types; determine the table type according to the identifier of the summary table; and query a set of anchor cells corresponding to the table type from the parameter configuration file.

[0122] As an optional scheme, the device is also used to: after querying a group of anchor cells corresponding to the table type of the target summary table from the parameter configuration file, if a group of anchor cells is queried from the parameter configuration file, obtain multiple business sub-data according to the group of anchor cells; if a group of anchor cells is not queried from the parameter configuration file, determine a group of anchor cells based on the feature data, and obtain multiple business sub-data according to the group of anchor cells, wherein the table type, the group of anchor cells and the corresponding association relationship are set to be stored in the parameter configuration file.

[0123] As an optional solution, the device is used to perform a summary operation on multiple business sub-data in the following manner to obtain second business data, compare the first business data and the second business data, determine the abnormal sub-table, and generate a target prompt message: sum up multiple target business sub-data to obtain the second business data; when the first business data and the second business data are different, compare the difference between the historical value and the current value of each data in the multiple target business sub-data to see if they meet a preset difference condition; when the difference between the historical value and the current value of the abnormal data in the multiple target business sub-data does not meet the preset difference condition, determine the table in which the abnormal data is recorded in the multiple target business sub-tables as an abnormal sub-table, and generate a target prompt message.

[0124] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program with a predetermined function, and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0125] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0126] According to one aspect of the present application, a computer program product is provided. The computer program product includes a computer program.

[0127] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0128] Figure 8 The structure block diagram of a computer system for implementing an electronic device according to an embodiment of the present application is schematically shown.

[0129] It should be noted that Figure 8 The computer system 800 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0130] like Figure 8 As shown, the computer system 800 includes a central processing unit 801 (CPU), which can perform various appropriate actions and processes according to the program stored in the read-only memory 802 (ROM) or the program loaded from the storage part 808 to the random access memory 803 (RAM). Various programs and data required for system operation are also stored in the random access memory 803. The central processing unit 801, the read-only memory 802 and the random access memory 803 are connected to each other through a bus 804. The input / output interface 805 (Input / Output interface, i.e., I / O interface) is also connected to the bus 804.

[0131] The following components are connected to the input / output interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a local area network card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the input / output interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 810 as needed so that a computer program read therefrom is installed into the storage section 808 as needed.

[0132] In particular, according to an embodiment of the present application, the process described in each method flow chart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer readable medium, and the computer program contains a program code for executing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 809, and / or installed from the removable medium 811. When the computer program is executed by the central processor 801, various functions defined in the system of the present application are executed.

[0133] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 809, and / or installed from the removable medium 811. When the computer program is executed by the central processor 801, various functions provided by the embodiment of the present application are performed.

[0134] According to another aspect of the embodiment of the present application, an electronic device for implementing the above data processing method is also provided. The electronic device may be Figure 1 The terminal device or server shown in the figure. This embodiment is described by taking the electronic device as a terminal device as an example. Fig. 9 As shown, the electronic device includes a memory 902 and a processor 904. The memory 902 stores a computer program, and the processor 904 is configured to execute the steps in any of the above method embodiments through the computer program.

[0135] Optionally, in this embodiment, the electronic device may be located in at least one network device among a plurality of network devices of a computer network.

[0136] Optionally, in this embodiment, the above-mentioned processor can be configured to execute the methods in each embodiment of the present application through a computer program.

[0137] Alternatively, a person skilled in the art may understand that: Fig. 9 The structure shown is for illustration only. Fig. 9 The structure of the electronic device is not limited. Fig. 9 More or fewer components (such as network interfaces, etc.) as shown in, or with Fig. 9 Different configurations shown.

[0138] Among them, the memory 902 can be used to store software programs and modules, such as program instructions / modules corresponding to the data processing method and device in the embodiments of the present application. The processor 904 executes various functional applications and data processing by running the software programs and modules stored in the memory 902, that is, realizing the above-mentioned data processing method. The memory 902 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 902 may further include a memory remotely located relative to the processor 904, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Among them, the memory 902 can be specifically, but not limited to, used to store information such as summary tables. As an example, such as Fig. 9 As shown, the memory 902 may include but is not limited to the acquisition module 702, the first determination module 704, the second determination module 706 and the execution module 708 in the data processing device. In addition, other module units in the data processing device may also be included but are not limited to, which will not be repeated in this example.

[0139] Optionally, the transmission device 906 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wired network and a wireless network. In one example, the transmission device 906 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices and routers via a network cable so as to communicate with the Internet or a local area network. In one example, the transmission device 906 is a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0140] In addition, the electronic device further comprises: a display 908 for displaying the abnormal sub-table; and a connection bus 910 for connecting various module components in the electronic device.

[0141] In other embodiments, the terminal device or server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting the multiple nodes through network communication. The nodes may form a peer-to-peer network, and any form of computing device, such as a server, terminal or other electronic device, may become a node in the blockchain system by joining the peer-to-peer network.

[0142] According to one aspect of the present application, a computer-readable storage medium is provided, and a processor of an electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the data processing method provided in various optional implementations of the above-mentioned data processing aspects.

[0143] Optionally, in this embodiment, the above-mentioned computer-readable storage medium can be configured to store data for executing the methods in various embodiments of the present application.

[0144] Optionally, in this embodiment, a person of ordinary skill in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by instructing hardware related to the terminal device through a program, and the program may be stored in a computer-readable storage medium, and the storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0145] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0146] If the integrated units in the above embodiments are implemented in the form of software functional units and sold or used as independent products, they can be stored in the above computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for one or more electronic devices to execute all or part of the steps of the methods described in each embodiment of the present application.

[0147] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0148] In the several embodiments provided in the present application, it should be understood that the disclosed application can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0149] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0150] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0151] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A data processing method, characterized in that: include: Obtaining a summary table and table type related to the target business system, wherein the summary table is used to record the first business data to be compared; Determining a group of anchor cells according to the characteristic data corresponding to each cell in the summary table, wherein the characteristic data is used to represent the cell attributes of the corresponding cells, and the cell attributes of different anchor cells in the group of anchor cells meet different preset attribute conditions; Determine a plurality of business sub-tables based on the table type, and determine a plurality of business sub-data corresponding to the plurality of business sub-tables based on the group of anchor cells, wherein the table type is the same as the table type of each sub-table in the plurality of business sub-tables, the group of anchor cells is used to determine a target cell that needs to be compared, and the target cell corresponding to a sub-table in the plurality of business sub-tables is used to record a type of data of the plurality of business sub-data; A summary operation is performed on the multiple business sub-data to obtain second business data, the first business data and the second business data are compared, an abnormal sub-table is determined, and a target prompt message is generated, wherein the target prompt message is used to indicate that abnormal data is recorded in the abnormal sub-table and the abnormal cell where the abnormal data is located.

2. The method according to claim 1, characterized in that The step of determining a group of anchor cells according to the characteristic data corresponding to each cell in the summary table includes: Acquire characteristic data of each cell in the summary table, wherein the characteristic data includes border characteristic data and data characteristic data of the cell, the border characteristic data is used to indicate whether each border of the corresponding cell exists, and the data characteristic data is used to indicate the data format of the corresponding cell record; In the case where the characteristic data satisfies the first attribute condition, determining the corresponding cell as the table start area of ​​the group of anchor cells, wherein the table start area has a first border and a second border, and the first adjacent cells in the first direction and the second direction of the table start area have no border and no fill color, or the first adjacent cell has no content, or the first adjacent cell does not exist, and the first direction and the second direction are perpendicular to each other; In the case where the characteristic data satisfies the second attribute condition, the corresponding cell is determined as the data starting area of ​​the group of anchor cells, wherein the data type of the second adjacent cells in the first direction and the second direction of the data starting area is a character type, and the data type of the third adjacent cells in the third direction and the fourth direction of the data starting area is not a character type, the third direction is opposite to the first direction, and the fourth direction is opposite to the second direction, and the cell corresponding to the data starting area has no border and fill color or no content; When the characteristic data satisfies the third attribute condition, the corresponding cell is determined as the table end area of ​​the group of anchor cells, wherein the table end area has a third border and a fourth border, and the fourth adjacent cells in the third direction and the fourth direction of the table end area have no borders and fill colors, or the fourth adjacent cell has no content, or the fourth adjacent cell does not exist.

3. The method according to claim 1, characterized in that The determining of a plurality of business sub-tables based on the table type, and determining a plurality of business sub-data corresponding to the plurality of business sub-tables based on the group of anchor cells, includes: Creating a multi-level target index based on the set of anchor cells, wherein the multi-level target index is used to indicate the position of each row header and column header in the summary table; A plurality of business sub-tables are determined based on the table type, and the plurality of business sub-data are acquired from the plurality of business sub-tables based on the multi-level target index and a predetermined target number of rows and a predetermined number of columns.

4. The method according to claim 3, characterized in that The determining of a plurality of business sub-tables based on the table type, and acquiring the plurality of business sub-data from the plurality of business sub-tables based on the multi-level target index and a predetermined target number of rows and a predetermined number of columns, comprises: Determine the first row title in the summary table according to the target number of rows in the multi-level target index, and determine the first column title in the summary table according to the target number of columns in the multi-level target index; Determine the second row title of each subtable in the plurality of business subtables according to the target number of rows in the multi-level target index, and determine the second column title of each subtable in the plurality of business subtables according to the target number of columns in the multi-level target index; When the second row header is the same as the first row header, and the second column header is the same as the first column header, the data recorded in the cell determined by the second row header and the second column header is determined as the plurality of business sub-data.

5. The method according to claim 1, characterized in that Before determining a plurality of business sub-tables based on the table type and determining a plurality of business sub-data corresponding to the plurality of business sub-tables based on the set of anchor cells, the method further includes: Obtaining a preset parameter configuration file, wherein the parameter configuration file is used to record different anchor cells corresponding to different table types; Determining the table type according to the identifier of the summary table; The set of anchor cells corresponding to the table type is queried from the parameter configuration file.

6. The method according to claim 5, characterized in that After querying the parameter configuration file for the set of anchor cells corresponding to the table type of the target summary table, the method further includes: When the group of anchor cells is found from the parameter configuration file, acquiring the plurality of business sub-data according to the group of anchor cells; In the case that the set of anchor cells is not found in the parameter configuration file, the set of anchor cells is determined based on the characteristic data, and the multiple business sub-data are obtained according to the set of anchor cells, wherein the table type, the set of anchor cells and the corresponding association relationship are set to be stored in the parameter configuration file.

7. The method according to claim 1, characterized in that The performing of aggregating operations on the plurality of business sub-data to obtain second business data, comparing the first business data with the second business data, determining abnormal sub-tables, and generating a target prompt message includes: Summing the plurality of target business sub-data to obtain the second business data; In the case that the first service data is different from the second service data, comparing the difference between the historical value and the current value of each data in the plurality of target service sub-data to see whether they meet a preset difference condition; When the difference between the historical value and the current value of the abnormal data in the multiple target business sub-data does not meet the preset difference condition, the table in the multiple target business sub-tables recording the abnormal data is determined as the abnormal sub-table, and a target prompt message is generated.

8. A data processing device, characterized in that: include: An acquisition module, used to acquire summary tables and table types related to the target business system, wherein the summary table is used to record the first business data to be compared; A first determination module is used to determine a group of anchor cells according to feature data corresponding to each cell in the summary table, wherein the feature data is used to represent cell attributes of the corresponding cells, and cell attributes of different anchor cells in the group of anchor cells meet different preset attribute conditions; a second determination module, configured to determine a plurality of business sub-tables based on the table type, and to determine a plurality of business sub-data corresponding to the plurality of business sub-tables based on the group of anchor cells, wherein the table type is the same as the table type of each sub-table in the plurality of business sub-tables, the group of anchor cells is used to determine a target cell that needs to be compared, and the target cell corresponding to a sub-table in the plurality of business sub-tables is used to record a type of data of the plurality of business sub-data; An execution module is used to perform a summary operation on the multiple business sub-data to obtain second business data, compare the first business data and the second business data, determine the abnormal sub-table, and generate a target prompt message, wherein the target prompt message is used to indicate that abnormal data is recorded in the abnormal sub-table and the abnormal cell where the abnormal data is located.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program, wherein the computer program can be executed by an electronic device to perform the method described in any one of claims 1 to 7.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method described in any one of claims 1 to 7 are implemented.

11. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 7 through the computer program.