Abnormal file processing method and device, storage medium and electronic equipment

Abstract

The application discloses an abnormal file processing method and device, a storage medium and an electronic device. It relates to the field of big data. The method comprises the following steps: receiving an abnormal file, and obtaining a plurality of pieces of abnormal information in the abnormal file; calculating the total information quantity of the plurality of pieces of abnormal information, and determining whether the total information quantity is greater than a target information quantity; in the case where the total information quantity is less than or equal to the target information quantity, sequentially identifying a preset identifier in each piece of abnormal information, processing the abnormal information according to the preset identifier in each piece of abnormal information, obtaining an updated abnormal file, and storing the updated abnormal file in a database; in the case where the total information quantity is greater than the target information quantity, sending the abnormal file and the total information quantity to a server, and displaying alarm information on the server. Through the application, the problem of low efficiency in processing abnormal information in an abnormal file by manual work in the related art is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of big data, in particular, to an abnormal file processing method and device, a storage medium and an electronic device. BACKGROUND

[0002] With the increasing of business data in financial institutions, the scenario of processing large files with large data volume is also increasing. When batch processing of multiple data information in a large file is performed, if abnormal information (such as a field of a certain information is too long, or a rare character appears in a certain information and cannot be processed) appears in the large file, the abnormal information is usually recorded, and an operation and maintenance personnel needs to manually intervene in the processing.

[0003] However, with the gradual increase of data information in the large file, if the file data volume is very large, reaching tens of millions or even hundreds of millions, the cost of manual processing is huge, and during manual processing, the large file needs to be downloaded from the file server to the local machine, and the modified file needs to be re-uploaded to the file server after processing the file according to different situations, which affects the efficiency of batch processing.

[0004] At present, there is no effective solution to the problem of low efficiency of manually processing abnormal information in an abnormal file in the related art. SUMMARY

[0005] The present application provides an abnormal file processing method and device, a storage medium and an electronic device to solve the problem of low efficiency of manually processing abnormal information in an abnormal file in the related art.

[0006] According to one aspect of the present application, an abnormal file processing method is provided. The method comprises: receiving an abnormal file and obtaining multiple abnormal information in the abnormal file, wherein the abnormal file includes multiple abnormal information and multiple non-abnormal information; calculating the total information quantity of the multiple abnormal information, and determining whether the total information quantity is greater than a target information quantity; in the case that the total information quantity is less than or equal to the target information quantity, identifying a preset identifier in each abnormal information in turn, and processing the abnormal information according to the preset identifier in each abnormal information to obtain an updated abnormal file, and storing the updated abnormal file in a database, wherein the preset identifier is used to determine whether to perform error correction processing on the abnormal information; in the case that the total information quantity is greater than the target information quantity, sending the abnormal file and the total information quantity to a server, and displaying an alarm information on the server, wherein the alarm information is used to represent that the function of processing the abnormal information in the abnormal file is not available.

[0007] Optionally, determining whether the total information amount is greater than the target information amount includes: obtaining the file name of the abnormal file and the application name that generated the abnormal file, and determining the parameter table associated with the abnormal file based on the file name and application name; obtaining the maximum modifiable information amount in the parameter table, determining the maximum modifiable information amount as the target information amount, and comparing the total information amount with the target information amount to obtain the comparison result.

[0008] Optionally, sequentially identifying the preset identifier in each abnormal message and processing the abnormal message according to the preset identifier in each abnormal message includes: determining whether the abnormal message has a first identifier in the parameter table, wherein the first identifier is used to indicate that the abnormal message is allowed to be deleted; if the abnormal message does not have a first identifier, sequentially identifying whether there is an abnormal field among multiple fields in the abnormal message; if there is an abnormal field in the abnormal message, processing the abnormal message according to the abnormal field.

[0009] Optionally, after determining whether the abnormal information has a first identifier in the parameter table, the method further includes: if the abnormal information has a first identifier, deleting the abnormal information from the abnormal file; if the abnormal information does not have a first identifier, after sequentially identifying whether there is an abnormal field among multiple fields in the abnormal information, the method further includes: if there is no abnormal field in the abnormal information, adding a second identifier to the abnormal information, wherein the second identifier is used to indicate that the abnormal information needs to be manually processed.

[0010] Optionally, processing the abnormal information based on the abnormal field includes: determining whether the abnormal field exists in the parameter table, where the third identifier indicates that the abnormal field can be deleted; if the abnormal field has a third identifier, deleting the abnormal field from the abnormal information; if the abnormal field does not have a third identifier, obtaining the business content corresponding to the abnormal file and calculating the relevance between the abnormal field and the business content; if the relevance is greater than or equal to a preset relevance, adding a second identifier to the abnormal information, where the second identifier indicates that the abnormal information requires manual processing; and if the relevance is less than a preset relevance, deleting the abnormal field from the abnormal information.

[0011] Optionally, calculating the relevance between the abnormal field and the business content includes: obtaining the business information required to handle the business content, and obtaining multiple pieces of business information; sequentially determining whether there is a correlation between the abnormal field and each piece of business information; if there is a correlation between the abnormal field and the target business information, determining that the relevance is greater than the preset relevance; if there is no correlation between the abnormal field and each piece of business information, determining that the relevance is less than the preset relevance.

[0012] Optionally, after obtaining the updated exception file, the method further includes: identifying whether a second identifier exists in the updated exception file, wherein the second identifier is used to represent that the exception information needs to be manually processed; in a case where the second identifier does not exist in the updated exception file, determining that the updated exception file is normal; and in a case where the second identifier exists in the updated exception file, sending the updated exception file to the server.

[0013] According to another aspect of the present application, an exception file processing apparatus is provided. The apparatus includes: an obtaining unit configured to receive an exception file and obtain a plurality of pieces of exception information in the exception file, wherein the exception file includes a plurality of pieces of exception information and a plurality of pieces of normal information; a calculating unit configured to calculate a total information amount of the plurality of pieces of exception information and determine whether the total information amount is greater than a target information amount; a processing unit configured to, in a case where the total information amount is less than or equal to the target information amount, identify a preset identifier in each piece of exception information in sequence, process the exception information according to the preset identifier in each piece of exception information, obtain an updated exception file, and store the updated exception file in a database, wherein the preset identifier is used to determine whether to perform error correction processing on the exception information; and a first sending unit configured to, in a case where the total information amount is greater than the target information amount, send the exception file and the total information amount to a server and display an alarm information on the server, wherein the alarm information is used to represent that the server does not have a function of processing the exception information in the exception file.

[0014] According to another aspect of the present application, a computer storage medium is also provided, the computer storage medium is used to store a program, wherein the program is used to control a device where the computer storage medium is located to execute an exception file processing method when the program is running.

[0015] According to another aspect of the present application, an electronic device is also provided, which includes one or more processors and a memory; the memory stores computer readable instructions, and the processor is used to run the computer readable instructions, wherein the computer readable instructions are used to execute an exception file processing method when the computer readable instructions are running.

[0016] By the present application, the following steps are adopted: receiving an exception file, and obtaining a plurality of pieces of exception information in the exception file, wherein the exception file includes a plurality of pieces of exception information and a plurality of pieces of non-exception information; calculating a total information quantity of the plurality of pieces of exception information, and determining whether the total information quantity is greater than a target information quantity; in a case where the total information quantity is less than or equal to the target information quantity, identifying a preset identifier in each piece of exception information in turn, and processing the exception information according to the preset identifier in each piece of exception information to obtain an updated exception file, and storing the updated exception file in a database, wherein the preset identifier is used to determine whether to perform error correction processing on the exception information; in a case where the total information quantity is greater than the target information quantity, sending the exception file and the total information quantity to a server, and displaying alarm information on the server, wherein the alarm information is used to represent that there is no function to process the exception information in the exception file. The problem of low efficiency of processing the exception information in the exception file by manual processing in the related art is solved. By determining whether the exception information can be automatically processed, and in a case where the exception information can be automatically processed, determining a processing method for the exception information according to the identifier, and processing using the processing method, the effect of automatically processing a large amount of exception data and improving the exception data processing efficiency is achieved. BRIEF DESCRIPTION OF DRAWINGS

[0017] The accompanying drawings, which form a part of the present application, are intended to provide further understanding of the present application, and are used to interpret the application and its specification, and do not constitute improper limitations to the present application. In the drawings:

[0018] Figure 1 is a flowchart of an exception file processing method according to an embodiment of the present application;

[0019] Figure 2 is a flowchart of an optional exception file processing method according to an embodiment of the present application;

[0020] Figure 3 is a flowchart of an optional exception information processing method according to an embodiment of the present application;

[0021] Figure 4 is a schematic diagram of an exception file processing device according to an embodiment of the present application;

[0022] Figure 5 is a schematic diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] It should be noted that the embodiments and features in the present application can be combined with each other without conflict. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0024] In order to enable persons skilled in the art to better understand the technical scheme of the present application, the technical scheme in the embodiments of the present application will be clearly and completely described in the following with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by persons skilled in the art without creative labor should belong to the scope of protection of the present application.

[0025] It should be noted that the terms "first", "second" and the like in the description and claims of the present application and the above drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented. In addition, the terms "comprise" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to the process, method, product or device.

[0026] It should be noted that the related information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for display, analyzed data, etc.) involved in the present disclosure are all information and data authorized by the user or authorized by all parties. For example, an interface is provided between the system and the related user or institution. Before obtaining the related information, the interface needs to send a request to the aforementioned user or institution, and after receiving the consent information fed back by the aforementioned user or institution, the related information is obtained.

[0027] It should be noted that the abnormal file processing method, device, storage medium and electronic equipment determined by the present disclosure can be used in the field of big data, and can also be used in any field other than the field of big data. The application field of the abnormal file processing method, device, storage medium and electronic equipment determined by the present disclosure is not limited.

[0028] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties. The collection, use and processing of related data need to comply with relevant regulations and standards, and provide corresponding operation entrances for users to choose authorization or refusal.

[0029] According to the embodiments of the present application, an abnormal file processing method is provided.

[0030] Figure 1is a flowchart of an abnormal file processing method according to an embodiment of the present application. As shown in Figure 1 the method comprises the following steps:

[0031] In step S101, an abnormal file is received, and a plurality of pieces of abnormal information in the abnormal file are obtained, wherein the abnormal file comprises a plurality of pieces of abnormal information and a plurality of pieces of non-abnormal information.

[0032] Specifically, after a preset batch processing operation is performed on a large file by a file batch processing device, if there is abnormal information in the large file, the preset batch processing operation will display a failed operation result and mark the abnormal information that exists. At this time, the large file needs to be sent to an abnormal file processing system, so that the abnormal information existing in the large file is processed by the abnormal file processing system, thereby ensuring that the large file can be normally processed by the file batch processing device.

[0033] After the abnormal file processing system receives the abnormal file, a plurality of pieces of abnormal information need to be obtained from the abnormal file, wherein the abnormal information can be information that cannot be processed by the file batch processing device during processing and is marked, wherein each piece of abnormal information can comprise a plurality of data, and each data is composed of a field, for example, the abnormal information A comprises: field A: name: Zhang San; field B: age: 20, and the like.

[0034] In step S102, the total information amount of the plurality of pieces of abnormal information is calculated, and it is determined whether the total information amount is greater than a target information amount.

[0035] Specifically, after receiving the abnormal file, since there is abnormal information and non-abnormal information in the abnormal file, the total information amount of the abnormal information is determined, so as to determine whether the abnormal information in the abnormal file can be processed by the abnormal file processing system.

[0036] For example, the size of the abnormal file can be 100G, the target information amount is 50G, and the abnormal information amount in the abnormal file is 60G. In this case, it is indicated that the abnormal information amount is too large. At this time, it can not be due to the existence of abnormal data in the file that causes the abnormal file to be unable to be processed, but due to other reasons that cause the abnormality. At this time, an operation and maintenance personnel needs to be accessed to determine the abnormal reason.

[0037] In step S103, in a case where the total information amount is less than or equal to the target information amount, a preset identifier in each piece of abnormal information is identified in sequence, and the abnormal information is processed according to the preset identifier in each piece of abnormal information, to obtain an updated abnormal file, and the updated abnormal file is stored in a database, wherein the preset identifier is used to determine whether to perform error correction processing on the abnormal information.

[0038] Specifically, in the case that the total information quantity is less than or equal to the target information quantity, it is indicated that there is an abnormality in the information in the file, at this time, each abnormal information obtained can be identified, so as to determine whether the problem in the abnormal information can be automatically corrected according to the identification, and determine how to correct the problem in the abnormal information according to the identification, and then the abnormal information in the abnormal file is processed to obtain an updated abnormal file.

[0039] It should be noted that after obtaining the updated abnormal file, the updated abnormal file needs to be batch processed by the file batch processing device again, at this time, if there is abnormal information in the updated abnormal file that cannot be automatically processed, an error will still be reported, at this time, since the amount of abnormal information in the updated abnormal file is small, the abnormal information in the large file with abnormal information can be processed by the operation and maintenance personnel, so as to obtain a large file without abnormal information.

[0040] In step S104, in the case that the total information quantity is greater than the target information quantity, the abnormal file and the total information quantity are sent to the server, and an alarm information is displayed on the server, wherein the alarm information is used to indicate that there is no function to process the abnormal information in the abnormal file.

[0041] Specifically, in the case that the total information quantity is greater than the target information quantity, it is indicated that there is a large amount of abnormal information in the abnormal file, at this time, the operation and maintenance personnel need to intervene in the processing, then the abnormal file and the total information quantity are sent to the server, and an alarm information is displayed on the server, so as to inform the operation and maintenance personnel of the abnormal file with abnormality and the information quantity of the abnormal information, and then the operation and maintenance personnel can process the abnormal file.

[0042] Figure 2 The flowchart of the optional abnormal file processing method provided by the embodiment of the present application is shown in FIG. 1. Figure 2 First, the abnormal information in the abnormal file is obtained, and the total information quantity of the abnormal information is calculated, and the total information quantity is compared with the target information quantity, wherein the target information quantity can be the maximum processable information quantity of the abnormal file processing system, or can be set according to the file size of the abnormal file.

[0043] In the case that the total information quantity is greater than the target information quantity, the operation and maintenance personnel need to manually intervene in the processing of the abnormal file, in the case that the total information quantity is less than or equal to the target information quantity, the abnormal information automatic processing module is entered, the abnormal information is processed according to the identification in each abnormal information, and after obtaining the updated abnormal file, it is judged whether there is still abnormal information in the updated abnormal file, in the case that there is still abnormal information, the operation and maintenance personnel process it, in the case that there is no abnormal information, the updated abnormal file is subjected to a preset batch processing operation, so as to achieve the effect of processing the abnormal file.

[0044] The abnormal file processing method provided by the embodiments of the present application receives an abnormal file and obtains a plurality of pieces of abnormal information in the abnormal file, wherein the abnormal file includes a plurality of pieces of abnormal information and a plurality of pieces of non-abnormal information; the total information quantity of the plurality of pieces of abnormal information is calculated, and it is determined whether the total information quantity is greater than a target information quantity; in the case where the total information quantity is less than or equal to the target information quantity, a preset identifier in each piece of abnormal information is identified in turn, and the abnormal information is processed according to the preset identifier in each piece of abnormal information to obtain an updated abnormal file, and the updated abnormal file is stored in a database, wherein the preset identifier is used to determine whether to perform error correction processing on the abnormal information; in the case where the total information quantity is greater than the target information quantity, the abnormal file and the total information quantity are sent to a server, and an alarm information is displayed on the server, wherein the alarm information is used to represent that the abnormal information in the abnormal file does not have a function of being processed. The problem of low efficiency of processing the abnormal information in the abnormal file by manual operation in the related art is solved. By determining whether the abnormal information can be automatically processed, and in the case where the abnormal information can be automatically processed, the processing method of the abnormal information is determined according to the identifier, and the processing method is used for processing, thereby achieving the effects of automatically processing a large amount of abnormal data and improving the efficiency of abnormal data processing.

[0045] In order to accurately determine the target information quantity, optionally, in the abnormal file processing method provided by the embodiments of the present application, determining whether the total information quantity is greater than the target information quantity includes: obtaining the file name of the abnormal file and the application name of generating the abnormal file, and determining the parameter table associated with the abnormal file according to the file name and the application name; obtaining the maximum modifiable information quantity in the parameter table, and determining the maximum modifiable information quantity as the target information quantity, and comparing the total information quantity with the target information quantity to obtain a comparison result.

[0046] Specifically, when the target information quantity is determined, the file name of the abnormal file and the application name of generating the abnormal file can be obtained first, wherein the application name of generating the abnormal file is also the application name of the business application of generating the abnormal file. After the name of the abnormal file and the application name are determined, the parameter table associated with the abnormal file can be determined in a plurality of parameter tables in the database, and the maximum modifiable information quantity is obtained from the parameter table, so as to obtain the maximum modifiable information quantity of the abnormal file. In the case where the information quantity of the abnormal information in the abnormal file is greater than the maximum modifiable information quantity, it is represented that the abnormal information in the abnormal file cannot be automatically modified, and then the operation and maintenance personnel need to intervene, thereby achieving the effect of ensuring the accuracy of file modification.

[0047] It should be noted that the parameter table can include the related content of each exception information, such as the line number of the exception information in the exception file, the English abbreviation, the file name, the exception information line can be ignored identifier (that is, the first identifier), and the like.

[0048] Optionally, in the exception file processing method provided in the embodiments of the present application, the preset identifier in each piece of exception information is sequentially identified, and the exception information is processed according to the preset identifier in each piece of exception information, including: determining whether the exception information exists in the first identifier in the parameter table, wherein the first identifier is used to represent that the exception information is allowed to be deleted; in the case that the exception information does not exist in the first identifier, whether an exception field exists in the multiple fields in the exception information is sequentially identified; in the case that the exception field exists in the exception information, the exception information is processed according to the exception field.

[0049] Specifically, when the identifier is identified, the parameter table corresponding to the exception file will include the information content of each piece of exception information in the exception file, such as the line number of the exception information in the exception file, the English abbreviation, the file name, the exception information line can be ignored identifier (that is, the first identifier), and the like, so that whether the exception information exists in the first identifier can be determined from the parameter table, and in the case that the first identifier exists in the related data recorded in the parameter table, it is represented that the exception information is useless information in the exception file, and then the exception information in the exception file can be directly deleted, so as to obtain the exception file without exception information.

[0050] Further, in the case that the exception information does not exist in the first identifier, it is represented that the exception information cannot be deleted, at this time, whether an exception field exists in the multiple fields in the exception information is sequentially identified, and in the case that the exception field exists, the processing method of the exception information is determined according to the information of the exception field.

[0051] Optionally, in the exception file processing method provided in the embodiments of the present application, after determining whether the exception information exists in the first identifier in the parameter table, the method further includes: in the case that the exception information exists in the first identifier, deleting the exception information from the exception file; and in the case that the exception information does not exist in the first identifier, after sequentially identifying whether an exception field exists in the multiple fields in the exception information, the method further includes: in the case that the exception field does not exist in the exception information, adding a second identifier in the exception information, wherein the second identifier is used to represent that the exception information needs to be manually processed.

[0052] Specifically, in the case that the first identifier exists in the related data recorded in the parameter table, it is represented that the exception information is useless information in the exception file, and then the exception information in the exception file can be directly deleted, so as to obtain the exception file without exception information.

[0053] Further, in the case that the abnormal information does not exist the first identifier, and in the case that the abnormal information does not exist the abnormal field, it is represented that the abnormal information cannot be deleted, and in the case that the abnormal field also does not exist, the second identifier needs to be added in the abnormal information, so that after the processing of all abnormal information is completed, which abnormal information needs to be manually processed is determined through the second identifier, and the efficiency of manually processing the abnormal information is improved.

[0054] Optionally, in the abnormal file processing method provided by the embodiment of the present application, the processing of the abnormal information according to the abnormal field comprises: determining whether the abnormal field exists a third identifier in the parameter table, wherein the third identifier is used to represent that the abnormal field is allowed to be deleted; in the case that the abnormal field exists the third identifier, deleting the abnormal field in the abnormal information; in the case that the abnormal field does not exist the third identifier, obtaining the business content corresponding to the abnormal file, and calculating the correlation degree between the abnormal field and the business content; in the case that the correlation degree is greater than or equal to a preset correlation degree, adding a second identifier in the abnormal information, wherein the second identifier is used to represent that the abnormal information needs to be manually processed; in the case that the correlation degree is less than the preset correlation degree, deleting the abnormal field in the abnormal information.

[0055] It should be noted that in the data related to each abnormal information in the parameter table, the related information of each field in the abnormal information is included, that is, in the case that a certain field has the third identifier, it is recorded in the parameter table, so that it can be queried from the parameter table.

[0056] Specifically, in the case that the abnormal information exists the abnormal field, it is needed to determine whether the abnormal field exists the third identifier in the parameter table, in the case that the third identifier exists, it is represented that the field is a deletable field, and then the abnormal field in the abnormal information is directly deleted, in the case that the third identifier does not exist, it is needed to determine whether the abnormal field can be deleted.

[0057] Further, when it is determined whether the abnormal field can be deleted, it can be determined by determining the correlation degree between the abnormal field and the business content, for example, in the case that the abnormal field is: user name: XX, the abnormal reason can be that the user name has an unusual character, which cannot be recognized, at this time, since the user name is important information related to the business, the correlation degree is high, at this time, the abnormal field cannot be deleted, if the correlation degree between the abnormal field and the business content is less than a preset correlation degree, it is represented that the abnormal field is not important information, and can be deleted, so as to ensure that the deleted content is all irrelevant to the business.

[0058] Optionally, in the abnormal file processing method provided in the embodiments of the present application, the correlation between the abnormal field and the business content comprises: obtaining business information required for the business, obtaining a plurality of business information; judging whether there is an association relationship between the abnormal field and each business information in turn; in the case that there is an association relationship between the abnormal field and the target business information, determining that the correlation is greater than the preset correlation; in the case that there is no association relationship between the abnormal field and each business information, determining that the correlation is less than the preset correlation.

[0059] Specifically, when calculating the correlation, the business information required for the business can be obtained first, for example, the business A is a loan business, and the business information can include loan amount, lender, repayment time and other information. After the business information is determined, the association relationship between the abnormal field and each business information can be judged, for example, when the abnormal field is "user name: XX", since the abnormal field has a greater association relationship with the lender, the abnormal field cannot be deleted. In the case that there is no greater correlation between the abnormal field and all business information, for example, when the abnormal field is "user gender: female", the abnormal field can be deleted. After the abnormal field is deleted, the business can still be performed, thereby ensuring that the deleted content is irrelevant to the business, and the information contained in the obtained file after batch processing of the file can still be used to normally perform the business.

[0060] Optionally, in the abnormal file processing method provided in the embodiments of the present application, after obtaining the updated abnormal file, the method further comprises: identifying whether a second identifier exists in the updated abnormal file, wherein the second identifier is used to represent that the abnormal information needs to be manually processed; in the case that the second identifier does not exist in the updated abnormal file, determining that the updated abnormal file is normal; in the case that the second identifier exists in the updated abnormal file, sending the updated abnormal file to the server.

[0061] Specifically, after completing the automatic updating of the abnormal file, it is necessary to identify whether the second identifier exists in the updated abnormal file. In the case that the second identifier exists, it represents that there is abnormal information in the abnormal file that cannot be automatically solved, and at this time, manual processing is required. Therefore, the position or line number of the abnormal information containing the second identifier needs to be counted and displayed, thereby improving the efficiency of manual processing when manual processing is performed.

[0062] Further, in the case that the second identifier does not exist in the updated abnormal file, it represents that there is no abnormal information in the updated abnormal file. At this time, the updated abnormal file can be subjected to the file batch processing operation again, thereby completing the batch processing of the file and ensuring the accuracy of the batch processing.

[0063] Figure 3 is a flowchart of an optional abnormal information processing method provided by an embodiment of the present application, as shown in Figure 3 After receiving the abnormal file, the abnormal information automatic processing module first acquires a plurality of abnormal information in the abnormal file, acquires related data corresponding to each abnormal information in the parameter table, and determines whether the abnormal information exists in the first identifier in the data recorded in the parameter table. In the case of the first identifier, delete the abnormal information in the abnormal file, and start the above operation on the next abnormal information.

[0064] Further, in the case where the first identifier does not exist in the abnormal information, it is determined in the parameter table whether the abnormal field in the abnormal information exists in the third identifier. In the case of the third identifier, delete the abnormal field under the abnormal information in the abnormal file. In the case where the third identifier does not exist in the abnormal field, add the second identifier to the abnormal field, and start the above operation on the next abnormal information until all the abnormal information in the abnormal file is processed to obtain the updated abnormal file, thereby achieving the effect of quickly and conveniently processing the abnormal information and assisting the operation and maintenance personnel in screening the abnormal information, and improving the processing efficiency of the abnormal file.

[0065] It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described herein can be executed in an order different from that shown herein.

[0066] The embodiment of the present application also provides an abnormal file processing device. It should be noted that the abnormal file processing device of the embodiment of the present application can be used to execute the abnormal file processing method provided by the embodiment of the present application. The abnormal file processing device provided by the embodiment of the present application is introduced as follows.

[0067] Figure 4 is a schematic diagram of an abnormal file processing device provided by an embodiment of the present application. As shown in Figure 4 The device comprises an acquisition unit 41, a calculation unit 42, a processing unit 43, and a first sending unit 44.

[0068] The acquisition unit 41 is configured to receive an abnormal file and acquire a plurality of abnormal information in the abnormal file, wherein the abnormal file comprises a plurality of abnormal information and a plurality of non-abnormal information.

[0069] The calculation unit 42 is configured to calculate the total information amount of the plurality of abnormal information, and determine whether the total information amount is greater than the target information amount.

[0070] The processing unit 43 is configured to, in a case where the total information quantity is less than or equal to the target information quantity, sequentially identify the preset identifier in each piece of abnormal information, and process the abnormal information according to the preset identifier in each piece of abnormal information to obtain an updated abnormal file, and store the updated abnormal file into the database, wherein the preset identifier is used to determine whether to perform error correction processing on the abnormal information.

[0071] The first sending unit 44 is configured to, in a case where the total information quantity is greater than the target information quantity, send the abnormal file and the total information quantity to the server, and display an alarm information on the server, wherein the alarm information is used to represent that the abnormal information in the abnormal file does not have a processing function.

[0072] The abnormal file processing apparatus provided by the embodiment of the present application receives the abnormal file through the obtaining unit 41, and obtains a plurality of pieces of abnormal information in the abnormal file, wherein the abnormal file includes a plurality of pieces of abnormal information and a plurality of pieces of non-abnormal information; the computing unit 42 calculates a total information quantity of the plurality of pieces of abnormal information, and judges whether the total information quantity is greater than a target information quantity; the processing unit 43, in a case where the total information quantity is less than or equal to the target information quantity, sequentially identifies a preset identifier in each piece of abnormal information, and processes the abnormal information according to the preset identifier in each piece of abnormal information to obtain an updated abnormal file, and stores the updated abnormal file into the database, wherein the preset identifier is used to determine whether to perform error correction processing on the abnormal information; and the first sending unit 44, in a case where the total information quantity is greater than the target information quantity, sends the abnormal file and the total information quantity to the server, and displays an alarm information on the server, wherein the alarm information is used to represent that the abnormal information in the abnormal file does not have a processing function. The problem of low efficiency in processing the abnormal information in the abnormal file by manual work in the related art is solved, it is determined whether the abnormal information can be automatically processed, in a case where the abnormal information can be automatically processed, the processing method for the abnormal information is determined according to the identifier, and the processing method is used for processing, thereby achieving the effects of automatically processing a large amount of abnormal data and improving the efficiency of abnormal data processing.

[0073] Optionally, in the abnormal file processing apparatus provided by the embodiment of the present application, the computing unit 42 includes: a first obtaining module configured to obtain a file name of the abnormal file and an application name of generating the abnormal file, and determine a parameter table associated with the abnormal file according to the file name and the application name; and a second obtaining module configured to obtain a maximum modifiable information quantity in the parameter table, determine the maximum modifiable information quantity as the target information quantity, and compare the total information quantity with the target information quantity to obtain a comparison result.

[0074] Optionally, in the abnormal file processing apparatus provided by the embodiment of the present application, the processing unit 43 comprises: a judging module, configured to judge whether the abnormal information exists a first identifier in the parameter table, wherein the first identifier is used to represent that the abnormal information is allowed to be deleted; an identifying module, configured to identify whether an abnormal field exists in the multiple fields in the abnormal information in sequence in the case that the abnormal information does not exist the first identifier; and a processing module, configured to process the abnormal information according to the abnormal field in the case that the abnormal field exists in the abnormal information.

[0075] Optionally, in the abnormal file processing apparatus provided by the embodiment of the present application, the apparatus further comprises: a deleting unit, configured to delete the abnormal information from the abnormal file in the case that the abnormal information exists the first identifier; and an adding unit, configured to add a second identifier in the abnormal information in the case that the abnormal field does not exist in the abnormal information after identifying whether the abnormal field exists in the multiple fields in the abnormal information in sequence in the case that the abnormal information does not exist the first identifier, wherein the second identifier is used to represent that the abnormal information needs to be manually processed.

[0076] Optionally, in the abnormal file processing apparatus provided by the embodiment of the present application, the processing module comprises: a first judging sub-module, configured to judge whether the abnormal field exists a third identifier in the parameter table, wherein the third identifier is used to represent that the abnormal field is allowed to be deleted; a first deleting sub-module, configured to delete the abnormal field in the abnormal information in the case that the abnormal field exists the third identifier; a calculating sub-module, configured to acquire the service content corresponding to the abnormal file and calculate the relevance between the abnormal field and the service content in the case that the abnormal field does not exist the third identifier; an adding sub-module, configured to add the second identifier in the abnormal information in the case that the relevance is greater than or equal to a preset relevance, wherein the second identifier is used to represent that the abnormal information needs to be manually processed; and a second deleting sub-module, configured to delete the abnormal field in the abnormal information in the case that the relevance is less than the preset relevance.

[0077] Optionally, in the abnormal file processing apparatus provided by the embodiment of the present application, the calculating sub-module comprises: an acquiring sub-module, configured to acquire service information required for processing the service content, to obtain multiple service information; a second judging sub-module, configured to judge whether an association relationship exists between the abnormal field and each service information in sequence; a first determining sub-module, configured to determine that the relevance is greater than the preset relevance in the case that the association relationship exists between the abnormal field and the target service information; and a second determining sub-module, configured to determine that the relevance is less than the preset relevance in the case that the association relationship does not exist between the abnormal field and each service information.

[0078] Optionally, in the abnormal file processing apparatus provided by the embodiment of the present application, the apparatus further comprises an identification unit configured to identify whether the second identifier exists in the updated abnormal file, wherein the second identifier is used to represent that the abnormal information needs to be manually processed; the apparatus further comprises a determination unit configured to determine that the updated abnormal file is normal in the case that the second identifier does not exist in the updated abnormal file; and the apparatus further comprises a second sending unit configured to send the updated abnormal file to the server in the case that the second identifier exists in the updated abnormal file.

[0079] The abnormal file processing apparatus comprises a processor and a memory, and the obtaining unit 41, the calculation unit 42, the processing unit 43, the first sending unit 44 and the like are stored in the memory as program units, and the corresponding functions are realized by the processor executing the program units stored in the memory.

[0080] The processor comprises a core, and the core is used to call the corresponding program units from the memory. One or more than one core can be set, and the efficiency of manually processing the abnormal information in the abnormal file in the related art is improved by adjusting the core parameters.

[0081] The memory can comprise a non-permanent memory in a computer readable medium, a random access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM) or a flash memory (flash RAM), and the memory comprises at least one memory chip.

[0082] The embodiment of the present application provides a computer readable storage medium, which stores a program, and the program is executed by a processor to realize the abnormal file processing method.

[0083] The embodiment of the present application provides a processor, which is used to run a program, and the program is executed to realize the abnormal file processing method.

[0084] Figure 5 As shown in a schematic diagram of an electronic device according to the embodiment of the present application, Figure 5 As shown in a schematic diagram of an electronic device according to the embodiment of the present application,

[0085] The present application further provides a computer program product, which is adapted to execute a program that is initialized with the steps of the abnormal file processing method when executed on a data processing device.

[0086] Those skilled in the art will appreciate that embodiments of the application can be readily used as software, hardware, or a combination of software and hardware. In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0087] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more functions specified in the flowchart block or blocks. Figure 1 one or more functions specified in the flowchart block or blocks.

[0088] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks. Figure 1 one or more functions specified in the flowchart block or blocks. Figure 1 one or more functions specified in the flowchart block or blocks.

[0089] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more functions specified in the flowchart block or blocks. Figure 1 one or more functions specified in the flowchart block or blocks.

[0090] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0091] The memory can include non-persistent memory and / or persistent memory, such as flash memory, read-only memory (ROM), and / or volatile / non-volatile random access memory (RAM), among others. The memory is an example of computer readable media.

[0092] Computer-readable media includes permanent and non-permanent, movable and non-movable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette, magnetic tape disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible to a computing device. According to the definition herein, computer-readable media does not include transitory media such as modulated data signals and carriers.

[0093] It should also be noted that the terms "comprising", "containing", or any other variant thereof are intended to cover non-exclusive inclusions, so that a process, method, article or apparatus that includes a list of elements does not only include those elements, but also includes other elements not explicitly listed, or further includes elements inherent in such a process, method, article or apparatus. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or apparatus that includes the element.

[0094] The above only is an embodiment of the present application, and is not intended to limit the present application. For those skilled in the art, the present application can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. within the spirit and principle of the present application shall be included in the scope of claims of the present application.

Claims

1. An abnormal file processing method characterized by, The method comprises the following steps: receiving an exception file and obtaining a plurality of pieces of exception information in the exception file, wherein the exception file comprises a plurality of pieces of exception information and a plurality of pieces of non-exception information; calculating a total information amount of the plurality of pieces of exception information and determining whether the total information amount is greater than a target information amount, wherein the total information amount refers to a total data amount of the plurality of pieces of exception information, and the target information amount is a maximum modifiable information amount in a parameter table associated with the exception file; in a case where the total information amount is less than or equal to the target information amount, sequentially identifying a preset identifier in each piece of exception information, processing the exception information according to the preset identifier in each piece of exception information, obtaining an updated exception file, and storing the updated exception file in a database, wherein the preset identifier is used to determine whether to perform error correction processing on the exception information; in a case where the total information amount is greater than the target information amount, sending the exception file and the total information amount to a server, and displaying alarm information on the server, wherein the alarm information is used to represent that the function of processing the exception information in the exception file is not available.

2. The method of claim 1, wherein, The determination of whether the total information amount is greater than the target information amount comprises: obtaining a file name of the exception file and an application name for generating the exception file, and determining a parameter table associated with the exception file according to the file name and the application name; obtaining a maximum modifiable information amount in the parameter table, determining the maximum modifiable information amount as the target information amount, and comparing the total information amount with the target information amount to obtain a comparison result.

3. The method of claim 2, wherein, The sequential identification of the preset identifier in each piece of exception information and the processing of the exception information according to the preset identifier in each piece of exception information comprise: determining in the parameter table whether the exception information has a first identifier, wherein the first identifier is used to represent that the exception information is allowed to be deleted; in a case where the exception information does not have the first identifier, sequentially determining whether an exception field exists in a plurality of fields in the exception information; in a case where the exception field exists in the exception information, processing the exception information according to the exception field.

4. The method of claim 3, wherein, After determining in the parameter table whether the exception information has the first identifier, the method further comprises: in a case where the exception information has the first identifier, deleting the exception information from the exception file; in a case where the exception information does not have the first identifier, after sequentially determining whether the exception field exists in the plurality of fields in the exception information, the method further comprises: in a case where the exception field does not exist in the exception information, adding a second identifier in the exception information, wherein the second identifier is used to represent that the exception information needs to be manually processed.

5. The method of claim 3, wherein, The processing of the exception information according to the exception field comprises: determining in the parameter table whether the exception field has a third identifier, wherein the third identifier is used to represent that the exception field is allowed to be deleted; in a case where the exception field has the third identifier, deleting the exception field in the exception information; In a case where the third identifier is not present in the abnormal field, obtaining service content corresponding to the abnormal file, and calculating a correlation degree between the abnormal field and the service content; In a case where the correlation degree is greater than or equal to a preset correlation degree, adding a second identifier in the abnormal information, wherein the second identifier is used to represent that the abnormal information needs manual processing; In a case where the correlation degree is less than the preset correlation degree, deleting the abnormal field in the abnormal information.

6. The method of claim 5, wherein, The calculation of the correlation degree between the abnormal field and the service content includes: Obtaining service information required for handling the service content, to obtain a plurality of service information; Judging whether there is an association relationship between the abnormal field and each service information in turn; In a case where the association relationship exists between the abnormal field and the target service information, it is determined that the correlation degree is greater than the preset correlation degree; In a case where the association relationship does not exist between the abnormal field and each service information, it is determined that the correlation degree is less than the preset correlation degree.

7. The method of claim 1, wherein, After obtaining the updated abnormal file, the method further includes: Identifying whether a second identifier is present in the updated abnormal file, wherein the second identifier is used to represent that the abnormal information needs manual processing; In a case where the second identifier is not present in the updated abnormal file, it is determined that the updated abnormal file is normal; In a case where the second identifier is present in the updated abnormal file, the updated abnormal file is sent to the server.

8. An abnormal file processing apparatus characterized by comprising: It includes: An acquisition unit is configured to receive an abnormal file and acquire a plurality of abnormal information in the abnormal file, wherein the abnormal file includes a plurality of abnormal information and a plurality of normal information; A calculation unit is configured to calculate a total information amount of the plurality of abnormal information, and judge whether the total information amount is greater than a target information amount, wherein the total information amount refers to a total data amount of the plurality of abnormal information, and the target information amount is a maximum modifiable information amount in a parameter table associated with the abnormal file; A processing unit is configured to, in a case where the total information amount is less than or equal to the target information amount, identify a preset identifier in each abnormal information in turn, and process the abnormal information according to the preset identifier in each abnormal information, to obtain an updated abnormal file, and store the updated abnormal file in a database, wherein the preset identifier is used to determine whether to perform error correction processing on the abnormal information; A first sending unit is configured to, in a case where the total information amount is greater than the target information amount, send the abnormal file and the total information amount to a server, and display an alarm information on the server, wherein the alarm information is used to represent that there is no function to process the abnormal information in the abnormal file.

9. A computer storage medium, characterized in that The computer storage medium is used to store a program, wherein the program controls a device where the computer storage medium is located to execute the abnormal file processing method in any one of claims 1 to 7 when running. The computer storage medium is used to store a program, wherein the program controls a device where the computer storage medium is located to execute the abnormal file processing method in any one of claims 1 to 7 when running.

10. An electronic device, comprising: An apparatus, including one or more processors and memory storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the exception file processing method of any one of claims 1-7.

Images