Abnormal data processing method and device, storage medium and electronic equipment

Abstract

The application provides an abnormal data processing method and device, a storage medium and an electronic device. The method comprises the following steps: in response to a data processing instruction, obtaining each abnormal data to be processed; determining the transaction tracking identification information and the transaction code of each abnormal data; grouping each abnormal data according to the transaction tracking identification information and the transaction code of each abnormal data, and obtaining each abnormal data group; in the case where it is detected that there is a target abnormal data group to be processed in each abnormal data group, obtaining the transaction link information of the abnormal data in the target abnormal data group, and outputting the transaction link information, wherein the transaction link information is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group. By using the method provided in the application, the transaction link information of the target abnormal data group can be obtained, so that the source of the abnormal data can be located.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to an abnormal data processing method, apparatus, storage medium, and electronic device. Background Technology

[0002] During the operation of business systems, abnormal data such as non-standard transaction messages often occur, affecting data quality. To improve the data quality of business systems, anomaly detection is usually performed to discover and manage abnormal data. However, this often fails to trace the source of the abnormal data, making it impossible to prevent the generation of abnormal data from the source. Summary of the Invention

[0003] The technical problem to be solved by this invention is to provide an abnormal data processing method, apparatus, storage medium, and electronic device, capable of obtaining transaction link information of a target abnormal data group, thereby locating the source of the abnormal data. The specific solution is as follows:

[0004] An abnormal data processing method includes:

[0005] In response to data processing instructions, obtain the various abnormal data to be processed;

[0006] Determine the transaction tracking identifier and transaction code for each of the aforementioned abnormal data;

[0007] Based on the transaction tracking identifier and transaction code of each abnormal data, the abnormal data are grouped to obtain each abnormal data group;

[0008] If a target abnormal data group to be processed is detected in each of the abnormal data groups, the transaction link information of the abnormal data in the target abnormal data group is obtained and the transaction link information is output. The transaction link information is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group.

[0009] Optionally, in the above method, obtaining the various abnormal data to be processed includes:

[0010] Obtain pre-set business verification rules;

[0011] The data in the preset data lake source layer is verified based on the business verification rules.

[0012] Data that fails verification in the data lake source layer is treated as abnormal data to be processed.

[0013] Optionally, in the above method, determining the transaction tracking identifier information for each of the abnormal data includes:

[0014] Obtain the transaction tracking number for each of the aforementioned abnormal data;

[0015] The preset field in the transaction tracking number is determined as the transaction tracking identifier information of the abnormal data.

[0016] Optionally, in the above method, obtaining the transaction tracking number for each of the abnormal data includes:

[0017] For each of the abnormal data, it is detected whether the abnormal data includes a transaction tracking number. If the abnormal data does not contain a transaction tracking number, a first prompt message is output to obtain the transaction tracking number of the abnormal data. The first prompt message is used to prompt the preset data supply component to provide feedback on the transaction tracking number of the abnormal data.

[0018] Optionally, in the above method, the process of detecting the existence of a target abnormal data group to be processed in each of the abnormal data groups includes:

[0019] Determine the number of abnormal data in each of the abnormal data groups;

[0020] For each of the abnormal data groups, if the number of abnormal data in the abnormal data group is greater than a preset threshold, the abnormal data group is identified as a target abnormal data group to be processed.

[0021] An abnormal data processing device includes:

[0022] The execution unit is used to respond to data processing instructions and obtain various abnormal data to be processed;

[0023] A determining unit is used to determine the transaction tracking identifier information and transaction code for each of the abnormal data.

[0024] The grouping unit is used to group each of the abnormal data according to the transaction tracking identifier information and transaction code of each of the abnormal data to obtain each abnormal data group;

[0025] The output unit is configured to, when a target abnormal data group to be processed is detected in each of the abnormal data groups, acquire the transaction link information of the abnormal data in the target abnormal data group, and output the transaction link information, which is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group.

[0026] Optionally, the execution unit in the aforementioned apparatus includes:

[0027] The first acquisition subunit is used to acquire pre-set business verification rules;

[0028] The verification subunit is used to verify each piece of data in the preset data lake source layer based on the business verification rules.

[0029] The execution subunit is used to treat data that fails verification in the data lake source layer as abnormal data to be processed.

[0030] Optionally, the determining unit in the aforementioned apparatus includes:

[0031] The second acquisition subunit is used to acquire the transaction tracking number of each of the abnormal data;

[0032] A sub-unit is defined to identify a preset field in the transaction tracking number as the transaction tracking identifier information of the abnormal data.

[0033] A storage medium includes storage instructions, wherein, when the instructions are executed, the device in which the storage medium resides executes the abnormal data processing method described above.

[0034] An electronic device includes a memory and one or more instructions, wherein one or more instructions are stored in the memory and configured to be executed by one or more processors as described above in the abnormal data processing method.

[0035] Based on the above embodiments of the present invention, an abnormal data processing method, apparatus, storage medium, and electronic device are provided. The method includes: in response to a data processing instruction, obtaining various abnormal data to be processed; determining transaction tracking identifier information and transaction code for each of the abnormal data; grouping the abnormal data according to the transaction tracking identifier information and transaction code of each of the abnormal data to obtain various abnormal data groups; and, when a target abnormal data group to be processed is detected in each of the abnormal data groups, obtaining transaction link information of the abnormal data in the target abnormal data group and outputting the transaction link information, wherein the transaction link information is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group. By applying the method provided by the embodiments of the present invention, it is possible to group the abnormal data according to the transaction tracking identifier information and transaction code of each of the abnormal data, thereby determining the abnormal data in various business scenarios, and then obtaining the transaction link information of the target abnormal data group, thereby locating the source of the abnormal data. Attached Figure Description

[0036] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0037] Figure 1 A flowchart of an abnormal data processing method provided by the present invention;

[0038] Figure 2 A flowchart of a process for obtaining various abnormal data to be processed is provided by the present invention;

[0039] Figure 3 A flowchart of a process for determining transaction tracking identification information for each abnormal data point is provided by the present invention;

[0040] Figure 4 A flowchart of another abnormal data processing method provided by the present invention;

[0041] Figure 5 This is a schematic diagram of the structure of an abnormal data processing device provided by the present invention;

[0042] Figure 6 This is a schematic diagram of the structure of an electronic device provided by the present invention. Detailed Implementation

[0043] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0044] In this application, the terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0045] This invention provides an abnormal data processing method that can be applied to electronic devices. The method flowchart is shown below. Figure 1 As shown, it specifically includes:

[0046] S101: In response to data processing instructions, obtain the various exception data to be processed.

[0047] In this embodiment, abnormal data can be obtained from a preset storage area, which may be the source layer of the data lake.

[0048] Optionally, abnormal data can be data files that do not match the preset business verification rules.

[0049] S102: Determine the transaction tracking identifier and transaction code for each of the abnormal data.

[0050] In this embodiment, the transaction code represents the service code for interaction between different business systems or between the same business system. Different business scenarios will use different transaction codes for interaction.

[0051] Optionally, for each abnormal data, it can be determined whether the transaction code field in the abnormal data is empty. If it is not empty, the string in the transaction code field is determined as the transaction code. If it is empty, a prompt message is sent to the preset data supply component to obtain the transaction code fed back by the data supply component.

[0052] S103: Based on the transaction tracking identifier information and transaction code of each abnormal data, group each abnormal data to obtain each abnormal data group.

[0053] In this embodiment, the transaction tracking identifier information of each abnormal data in each abnormal data group is consistent, and the transaction code of each abnormal data in each abnormal data group is consistent.

[0054] Optionally, at least one of the transaction tracking identifier information and transaction code may be different for the abnormal data in different abnormal data groups.

[0055] In this embodiment, each abnormal data in each abnormal data group belongs to the same business scenario, while the abnormal data in different abnormal data groups belong to different business scenarios.

[0056] S104: If a target abnormal data group to be processed is detected in each of the abnormal data groups, the transaction link information of the abnormal data in the target abnormal data group is obtained and the transaction link information is output. The transaction link information is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group.

[0057] In this embodiment, the transaction link information of the target abnormal data group can be queried based on the transaction tracking number of one or more abnormal data in the target abnormal data group. The transaction link information may include system identifier, transaction code, transaction flow information, etc.

[0058] Optionally, transaction link information for abnormal data can be retrieved from a pre-defined transaction monitoring platform. After obtaining the transaction link information, the abnormal transaction message field of the abnormal data within the target abnormal data group can be determined, thereby locating the source of the problem in the abnormal data within the target abnormal data group. This abnormal transaction message field is the transaction message field that caused the data abnormality.

[0059] By applying the method provided in the embodiments of the present invention, each abnormal data can be grouped according to the transaction tracking identifier information and transaction code of each abnormal data, thereby determining the abnormal data in each business scenario, and then obtaining the transaction link information of the target abnormal data group, thereby locating the source of the abnormal data.

[0060] In one embodiment of the present invention, based on the above implementation process, optionally, the process of obtaining each abnormal data to be processed is as follows: Figure 2 As shown, it includes:

[0061] S201: Obtain pre-set business verification rules.

[0062] In this embodiment, business verification rules can be used to verify whether the data is abnormal.

[0063] S202: Verify each piece of data in the preset data lake source layer based on the business verification rules.

[0064] In this embodiment, business verification rules can be converted into rule information in a preset format, and then an automated script can be generated based on the rule information. Based on the automated script, various data in the data lake source layer can be verified.

[0065] S203: Data that fails verification in the data lake source layer is treated as abnormal data to be processed.

[0066] In this embodiment, after identifying the abnormal data to be processed, an abnormal data detail can be generated and output.

[0067] In one embodiment of the present invention, based on the above implementation process, optionally, the process of determining the transaction tracking identifier information for each of the abnormal data is as follows: Figure 3 As shown, it includes:

[0068] S301: Obtain the transaction tracking number for each of the aforementioned abnormal data.

[0069] In this embodiment, the transaction tracking number can be a unique identifier of the transaction to which the abnormal data belongs, and the transaction tracking number can include the initiator's security node number.

[0070] S302: Determine the preset field in the transaction tracking number as the transaction tracking identifier information of the abnormal data.

[0071] In this embodiment, the first n characters of the transaction tracking number can be used as the transaction tracking identifier information. For example, if the transaction tracking number is 108033Txn1677555607953334, the first 6 digits of the transaction tracking number can be used as the transaction tracking identifier information, then the transaction tracking identifier information is 108033.

[0072] In some embodiments, the initiator security node number in the transaction tracking number can be used as the transaction tracking identifier information.

[0073] In one embodiment of the present invention, based on the above implementation process, optionally, obtaining the transaction tracking number of each of the abnormal data includes:

[0074] For each of the abnormal data, it is detected whether the abnormal data includes a transaction tracking number. If the abnormal data does not contain a transaction tracking number, a first prompt message is output to obtain the transaction tracking number of the abnormal data. The first prompt message is used to prompt the preset data supply component to provide feedback on the transaction tracking number of the abnormal data.

[0075] In this embodiment, it can be detected whether the transaction tracking number field in the abnormal data is empty. If it is empty, it is determined that the abnormal data does not contain a transaction tracking number. In this case, the first prompt message is output so that the data supply component can provide the transaction tracking number of the abnormal data. If the transaction tracking number field is not empty, the string in the transaction tracking number field is used as the transaction tracking number.

[0076] In one embodiment of the present invention, based on the above implementation process, optionally, the process of detecting the existence of a target abnormal data group to be processed in each of the abnormal data groups includes:

[0077] Determine the number of abnormal data in each of the abnormal data groups.

[0078] For each of the abnormal data groups, if the number of abnormal data in the abnormal data group is greater than a preset threshold, the abnormal data group is identified as a target abnormal data group to be processed.

[0079] In this embodiment, there can be multiple target abnormal data groups. When there are multiple target abnormal data groups, the transaction link information of the abnormal data in each target abnormal data group can be queried sequentially according to the order of the number of abnormal data in the target abnormal data group from largest to smallest.

[0080] See Figure 4The flowchart of another abnormal data processing method provided by the present invention specifically includes the following steps:

[0081] Step 1: Generate a problem data file (abnormal data) containing the transaction tracking number and transaction code through rule escaping to check the results.

[0082] In this embodiment, business verification rules and source layer scripts can be translated into technical language and configured into automated scripts for technical rules. Through data link queries and manual surveys, the corresponding data lake source layer files are identified from the end-point verification table. These files are then verified, generating detailed records of problematic data. The file verification results include transaction tracking numbers and transaction codes.

[0083] Step 2: Cluster abnormal data according to business scenarios using transaction codes and transaction tracking numbers.

[0084] In this embodiment, the process of clustering the problem data is as follows:

[0085] Step a1: Extract the transaction tracking number from the source table, and extract the first 6 digits of the transaction tracking number as the initiator security node number, which is used as the transaction initiator of the abnormal data.

[0086] Step a2: Extract the transaction code from the source table.

[0087] Step a3: Cluster the abnormal data according to the transaction initiator and transaction code of each abnormal data. The same cluster group can represent the same transaction link, that is, a type of transaction scenario, which can be used as the basis for business scenario clustering.

[0088] In this embodiment, transactions are grouped and clustered based on the initiator and transaction code. Based on the clustering results, N transaction tracking numbers are sampled and the transaction chain is obtained by calling the application monitoring system. The number of samples can be adjusted according to the actual situation.

[0089] In this embodiment, due to non-standard fields in some component source layer files or special business scenarios, there may be cases where transaction tracking numbers or transaction codes are missing. If the problem data does not contain a transaction tracking number, the transaction tracking number field needs to be confirmed with the data supply component; if the problem data does not contain a transaction code, the transaction code field needs to be confirmed with the data supply component. If the verification rule configuration is correct, the contact person of the data supply component needs to be contacted based on the source layer file and the field being verified. Through manual confirmation, the transaction code and transaction field associated with the verification field of this source table are found.

[0090] Step 3: Automated acquisition of transaction links by calling the transaction monitoring system interface.

[0091] In this embodiment, an automated query tool can be built to call the query interface of the transaction monitoring platform and automatically obtain the transaction links under the above-mentioned different business scenarios, including: system name, transaction code, transaction flow, etc., thus establishing the connection between the data line and the transaction line.

[0092] Optionally, due to the large volume of business handled by the transaction monitoring platform, the tool provides a personalized query function and implements concurrency parameter management, enabling control over the number of queries and the number of concurrent requests. Return values ​​are used as indicators of program completion, optimizing the query method so that the query for the next link depends on the completion of the previous link, effectively controlling the number of queries and alleviating the pressure on the transaction monitoring platform. Simultaneously, to meet the requirement of querying links with a high number of issues, an adaptive link query method is provided. Based on a given threshold, important scenarios are identified, and transaction links are sampled from these important scenarios. That is, when the number of issue data for a single scenario in a business scenario cluster exceeds a certain threshold, the scenario is considered to have a high number of issues, requiring further analysis of transaction links. Transaction tracking numbers are sampled from these scenarios, and transaction monitoring is invoked to obtain the transaction links.

[0093] Step 4: Determine the source of the streaming message check fields in the upstream system through manual investigation.

[0094] By identifying transaction systems with a large amount of problematic data, and through manual verification, the transaction message fields that caused the data quality issues were determined. The analysis was then conducted based on the business scenario, and the source was traced back until the origin of the problematic data was found.

[0095] By applying the method provided in this invention, a clustering approach based on transaction tracking numbers and transaction codes is introduced when analyzing document verification problem data. This enables scenario-based and automated upstream tracing of transaction links, forming a complete operational system for problem data tracking. Scenario clustering makes key scenario analysis more convenient, resulting in more intuitive and comprehensive analysis results. By calling the transaction monitoring system interface, transaction links are automatically obtained, reducing the cost of manual queries and improving the efficiency of problem tracking. Simultaneously, it reduces errors during manual link analysis, improving the accuracy of transaction paths. Timely detection and early resolution of data quality issues, along with timely data governance, improves data quality.

[0096] and Figure 1 Corresponding to the method described above, this embodiment of the invention also provides an abnormal data processing device for processing abnormal data. Figure 1 The specific implementation of the method is shown in the following structural diagram. Figure 5 As shown, it specifically includes:

[0097] The execution unit 501 is used to obtain various abnormal data to be processed in response to data processing instructions;

[0098] Determining unit 502 is used to determine the transaction tracking identifier information and transaction code of each of the abnormal data;

[0099] Grouping unit 503 is used to group each abnormal data according to the transaction tracking identifier information and transaction code of each abnormal data to obtain each abnormal data group;

[0100] The output unit 504 is used to obtain the transaction link information of the abnormal data in the target abnormal data group when a target abnormal data group to be processed is detected in each of the abnormal data groups, and output the transaction link information, which is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group.

[0101] In one embodiment of the present invention, based on the above-described solution, optionally, the execution unit 501 includes:

[0102] The first acquisition subunit is used to acquire pre-set business verification rules;

[0103] The verification subunit is used to verify each piece of data in the preset data lake source layer based on the business verification rules.

[0104] The execution subunit is used to treat data that fails verification in the data lake source layer as abnormal data to be processed.

[0105] In one embodiment of the present invention, based on the above-described solution, optionally, the determining unit 502 includes:

[0106] The second acquisition subunit is used to acquire the transaction tracking number of each of the abnormal data;

[0107] A sub-unit is defined to identify a preset field in the transaction tracking number as the transaction tracking identifier information of the abnormal data.

[0108] In one embodiment of the present invention, based on the above-described solution, optionally, the second acquisition subunit includes:

[0109] The output module is used to detect whether the abnormal data includes a transaction tracking number for each abnormal data. If the abnormal data does not contain a transaction tracking number, the module outputs a first prompt message to obtain the transaction tracking number of the abnormal data. The first prompt message is used to prompt a preset data supply component to provide the transaction tracking number of the abnormal data.

[0110] In one embodiment of the present invention, based on the above-described solution, optionally, the output unit 504 includes:

[0111] The first processing subunit is used to determine the number of abnormal data in each of the abnormal data groups;

[0112] The second processing subunit is used to determine the abnormal data group as a target abnormal data group to be processed when the number of abnormal data in the abnormal data group is greater than a preset number threshold.

[0113] The specific principles and execution processes of each unit and module in the abnormal data processing device disclosed in the above embodiments of the present invention are the same as those of the abnormal data processing method disclosed in the above embodiments of the present invention. Please refer to the corresponding parts of the abnormal data processing method provided in the above embodiments of the present invention, and they will not be repeated here.

[0114] This invention also provides a storage medium that includes stored instructions, wherein the execution of the instructions controls the device where the storage medium is located to perform the above-described abnormal data processing method.

[0115] This invention also provides an electronic device, the structural schematic of which is shown below. Figure 6 As shown, it specifically includes a memory 601 and one or more instructions 602, wherein one or more instructions 602 are stored in the memory 601 and configured to be executed by one or more processors 603 to perform the following operations:

[0116] In response to data processing instructions, obtain the various abnormal data to be processed;

[0117] Determine the transaction tracking identifier and transaction code for each of the aforementioned abnormal data;

[0118] Based on the transaction tracking identifier and transaction code of each abnormal data, the abnormal data are grouped to obtain each abnormal data group;

[0119] If a target abnormal data group to be processed is detected in each of the abnormal data groups, the transaction link information of the abnormal data in the target abnormal data group is obtained and the transaction link information is output. The transaction link information is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group.

[0120] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For apparatus embodiments, since they are basically similar to method embodiments, the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0121] Finally, it should be noted that in this paper, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations.

[0122] For ease of description, the above apparatus is described in terms of its functions, divided into various units. Of course, in implementing this invention, the functions of each unit can be implemented in one or more software and / or hardware components.

[0123] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present invention.

[0124] The above provides a detailed description of an abnormal data processing method provided by the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A method for processing abnormal data, characterized in that, include: In response to data processing instructions, obtain the various abnormal data to be processed; Determine the transaction tracking identifier and transaction code for each of the aforementioned abnormal data; Based on the transaction tracking identifier and transaction code of each abnormal data, the abnormal data are grouped to obtain each abnormal data group; If a target abnormal data group to be processed is detected in each of the abnormal data groups, the transaction link information of the abnormal data in the target abnormal data group is obtained and the transaction link information is output. The transaction link information is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group.

2. The method according to claim 1, characterized in that, The process of obtaining the various abnormal data to be processed includes: Obtain pre-set business verification rules; The data in the preset data lake source layer is verified based on the business verification rules. Data that fails verification in the data lake source layer is treated as abnormal data to be processed.

3. The method according to claim 1, characterized in that, The process of determining the transaction tracking identifier information for each of the abnormal data includes: Obtain the transaction tracking number for each of the aforementioned abnormal data; The preset field in the transaction tracking number is determined as the transaction tracking identifier information of the abnormal data.

4. The method according to claim 3, characterized in that, The step of obtaining the transaction tracking number for each of the abnormal data includes: For each of the abnormal data, it is detected whether the abnormal data includes a transaction tracking number. If the abnormal data does not contain a transaction tracking number, a first prompt message is output to obtain the transaction tracking number of the abnormal data. The first prompt message is used to prompt the preset data supply component to provide feedback on the transaction tracking number of the abnormal data.

5. The method according to claim 1, characterized in that, The process of detecting the existence of a target abnormal data group to be processed in each of the abnormal data groups includes: Determine the number of abnormal data in each of the abnormal data groups; For each of the abnormal data groups, if the number of abnormal data in the abnormal data group is greater than a preset threshold, the abnormal data group is identified as a target abnormal data group to be processed.

6. An abnormal data processing device, characterized in that, include: The execution unit is used to respond to data processing instructions and obtain various abnormal data to be processed; A determining unit is used to determine the transaction tracking identifier information and transaction code for each of the abnormal data. The grouping unit is used to group each of the abnormal data according to the transaction tracking identifier information and transaction code of each of the abnormal data to obtain each abnormal data group; The output unit is configured to, when a target abnormal data group to be processed is detected in each of the abnormal data groups, acquire the transaction link information of the abnormal data in the target abnormal data group, and output the transaction link information, which is used to determine the abnormal transaction message field of the abnormal data in the target abnormal data group.

7. The apparatus according to claim 6, characterized in that, The execution unit includes: The first acquisition subunit is used to acquire pre-set business verification rules; The verification subunit is used to verify each piece of data in the preset data lake source layer based on the business verification rules. The execution subunit is used to treat data that fails verification in the data lake source layer as abnormal data to be processed.

8. The apparatus according to claim 6, characterized in that, The determining unit includes: The second acquisition subunit is used to acquire the transaction tracking number of each of the abnormal data; A sub-unit is defined to identify a preset field in the transaction tracking number as the transaction tracking identifier information of the abnormal data.

9. A storage medium, characterized in that, The storage medium includes storage instructions, wherein, when the instructions are executed, the device containing the storage medium is controlled to perform the abnormal data processing method as described in any one of claims 1 to 5.

10. An electronic device, characterized in that, It includes a memory, and one or more instructions, wherein one or more instructions are stored in the memory and configured to be executed by one or more processors as described in any one of claims 1 to 5.

Images