File verification method, storage medium, electronic equipment and program product

Abstract

The invention discloses a file verification method, a storage medium, electronic equipment and a program product. The method can be applied to the field of financial science and technology. The method comprises the steps that a file verification rule of a to-be-verified file is obtained, and the file verification rule is used for guiding the verification process of the to-be-verified file; determining an associated file of the to-be-verified file based on the file verification rule, the associated file being used for representing a file having a data interaction relationship with the to-be-verified file; according to the association relationship between the associated file and the to-be-verified file, associated information of the to-be-verified file is determined, and the associated information is used for representing information related to the to-be-verified file and the associated file in the data interaction process; the to-be-verified file is verified based on the associated information, a verification result is obtained, and the verification result is used for representing whether the to-be-verified file is abnormal or not. By means of the file verification method and device, the problem that the file verification accuracy is low in the related technology is solved.

Description

Technical Field

[0001] The present application relates to the field of computer technology and can also be applied to the field of financial technology. Specifically, it relates to a file verification method, storage medium, electronic device and program product. Background Art

[0002] Data migration is a key link in the process of modern enterprise information upgrade, system integration or migration, involving the transfer of a large amount of data from the source system to the target system. In this process, ensuring the integrity and accuracy of the data is crucial to avoid business interruption, maintain data security and system stability.

[0003] Traditional file verification methods, such as record number comparison, sample data comparison, data structure inspection, etc., can initially verify the consistency of data, but have limitations in dealing with logical omissions or duplications of accounting information. They often fail to effectively detect and repair accounting defects in the original files, increasing the risks and potential problems after data migration, which in turn results in low file verification accuracy in related technologies.

[0004] Currently, no effective solution has been proposed to address the problem of low file verification accuracy in related technologies. Summary of the invention

[0005] The main purpose of this application is to provide a file verification method, storage medium, electronic device and program product to solve the problem of low file verification accuracy in related technologies.

[0006] In order to achieve the above-mentioned purpose, according to one aspect of the present application, a file verification method is provided. The method includes: obtaining a file verification rule of a file to be verified, wherein the file verification rule is used to guide the verification process of the file to be verified; determining an associated file of the file to be verified based on the file verification rule, wherein the associated file is used to indicate a file that has a data interaction relationship with the file to be verified; determining the associated information of the file to be verified based on the association relationship between the associated file and the file to be verified, wherein the associated information is used to indicate the information involved in the data interaction process between the file to be verified and the associated file; verifying the file to be verified based on the associated information to obtain a verification result, wherein the verification result is used to indicate whether there is an abnormality in the file to be verified.

[0007] Furthermore, the file to be verified is verified based on the associated information to obtain a verification result, including: comparing the associated information and the file to be verified to obtain difference data between the associated information and the file to be verified; in response to the difference data satisfying a preset condition, determining that the verification result is that there is an abnormality in the file to be verified, wherein the preset condition is a pre-set condition for indicating whether there is an abnormality in the file to be verified; in response to the difference data not satisfying the preset condition, determining that the verification result is that there is no abnormality in the file to be verified.

[0008] Furthermore, the associated file includes an upstream associated file and a downstream associated file. According to the association relationship between the associated file and the file to be verified, the associated information of the file to be verified is determined, including: determining the output data of the upstream associated file according to the association relationship, and determining the reference data of the downstream associated file, wherein the data output by the upstream associated file is applied to the file to be verified, and the data output by the file to be verified is applied to the downstream associated file, the output data is used to represent the data to be input to the file to be verified after data processing of the upstream associated file, and the reference data is used to represent the data to be input to the file to be verified; the output data and the reference data are input into the project processing logic corresponding to the file to be verified to obtain the associated information, wherein the project processing logic is used to represent the operations required to implement the project corresponding to the file to be verified.

[0009] Furthermore, the method also includes: obtaining a project type corresponding to the project information contained in the file to be verified; and determining a project processing logic corresponding to the project information based on the project type.

[0010] Furthermore, obtaining the project type corresponding to the project information contained in the file to be verified includes: determining the project type based on the identification information of the project information; or determining historical project information whose similarity with the project information is greater than a preset similarity, and determining the historical project type corresponding to the historical project information as the project type.

[0011] Furthermore, the associated files of the file to be verified are determined based on the file verification rules, including: determining a project data chain corresponding to the file verification rule, wherein the project data chain is used to represent a data chain containing at least one project node, and different project nodes are used to achieve different project purposes; determining a project node position of the file to be verified according to the project data chain, wherein the project node position is used to represent the position of the project node corresponding to the file to be verified in the project data chain; and determining associated files according to the project node position and the project data chain.

[0012] Furthermore, determining the project data chain corresponding to the file verification rule includes: determining at least one data processing logic involved in the file verification rule; in response to at least one data processing logic containing multiple data processing logics, connecting the multiple data processing logics in series based on the logical order of the multiple data processing logics to obtain the project data chain; in response to at least one data processing logic containing a single data processing logic, determining the single data processing logic as the project data chain.

[0013] In order to achieve the above-mentioned purpose, according to another aspect of the present application, a file verification device is provided. The device includes: a first acquisition module, used to obtain the file verification rules of the file to be verified, wherein the file verification rules are used to guide the verification process of the file to be verified; a first determination module, used to determine the associated files of the file to be verified based on the file verification rules, wherein the associated files are used to indicate the files that have a data interaction relationship with the file to be verified; a second determination module, used to determine the associated information of the file to be verified based on the association relationship between the associated files and the file to be verified, wherein the associated information is used to indicate the information involved in the data interaction process between the file to be verified and the associated files; a verification module, used to verify the file to be verified based on the associated information to obtain a verification result, wherein the verification result is used to indicate whether there is an abnormality in the file to be verified.

[0014] In order to achieve the above-mentioned purpose, according to another aspect of the present application, a computer-readable storage medium is provided, the computer-readable storage medium includes a stored executable program, wherein when the executable program is running, the device where the computer-readable storage medium is located is controlled to execute the above-mentioned file verification method.

[0015] In order to achieve the above-mentioned purpose, according to another aspect of the present application, an electronic device is provided, comprising: a memory storing an executable program; and a processor for running the program, wherein the above-mentioned file verification method is executed when the program is running.

[0016] In order to achieve the above-mentioned purpose, according to another aspect of the present application, a computer program product is provided, including a computer program, and the computer program implements the above-mentioned file verification method when executed by a processor.

[0017] In the embodiment of the present application, the file verification rules of the file to be verified are first obtained; then the associated files of the file to be verified are determined based on the file verification rules; then the associated information of the file to be verified is determined based on the association relationship between the associated files and the file to be verified; finally, the file to be verified is verified based on the associated information to obtain the verification result. It is easy to notice that the present application obtains the file verification rules of the file to be verified, and then determines the associated files that have a data interaction relationship with the file to be verified based on the file verification rules, and then determines the associated information of the file to be verified according to the data interaction relationship between the associated files and the file to be verified, and guides the file verification process through the associated information and the associated files to obtain the verification result. The above process guides the verification by obtaining the associated files and associated information of the file to be verified, provides powerful guiding data information for the file verification process, and ensures that all relevant files are included in the verification scope, thereby avoiding omissions and errors, reducing the risk of data migration, and improving the integrity and accuracy of data migration, thereby solving the technical problem of low file verification accuracy in the related technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings constituting a part of the present application are used to provide a further understanding of the present application. The illustrative embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0019] Figure 1 A hardware structure block diagram of a computer terminal for implementing a file verification method is shown;

[0020] Figure 2 is a flow chart of a file verification method according to an embodiment of the present application;

[0021] Figure 3 is a schematic diagram of a file verification device according to an embodiment of the present application;

[0022] Figure 4 It is a structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0024] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0025] Example 1

[0026] According to an embodiment of the present application, a method embodiment of file verification is also provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0027] The method embodiment provided in the first embodiment of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Figure 1 FIG. 1 shows a hardware structure block diagram of a computer terminal for implementing a file verification method. Figure 1 As shown, the computer terminal 10 (or mobile device) may include one or more (102a, 102b, ..., 102n are used to illustrate) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission device 106 for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the BUS bus), a network interface, a power supply and / or a camera. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0028] It should be noted that the one or more processors 102 and / or other data processing circuits described above may generally be referred to herein as "data processing circuits". The data processing circuits may be embodied in whole or in part as software, hardware, firmware, or any other combination thereof. In addition, the data processing circuit may be a single independent processing module, or may be incorporated in whole or in part into any of the other components in the computer terminal 10 (or mobile device). As described in the embodiments of the present application, the data processing circuit acts as a processor control (e.g., selection of a variable resistor terminal path connected to an interface).

[0029] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the file verification method in the embodiment of the present application. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, the above-mentioned file verification method is realized. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the computer terminal 10 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0030] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0031] The display may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the computer terminal 10 (or mobile device).

[0032] Under the above operating environment, this application provides Figure 2 The file verification method shown. Figure 2 1 is a flowchart of a file verification method according to an embodiment of the present application. Figure 2 As shown, the method may include the following steps:

[0033] Step S202, obtaining a file verification rule for the file to be verified, wherein the file verification rule is used to guide the verification process of the file to be verified.

[0034] The above-mentioned files to be verified may refer to data files that need to be transferred from the old system to the new system. The types of files to be verified may include but are not limited to various key information in business operations, such as transaction records, customer data, financial data, etc. The specific files to be verified need to be determined based on actual conditions and are not limited here.

[0035] The above-mentioned file verification rules may refer to a series of standards and processes used to guide and regulate the verification process of the files to be verified before and after migration. The types of file verification rules may include but are not limited to data consistency verification, data integrity verification, business logic verification, data relevance verification, and abnormal data processing. The specific file verification rules need to be determined based on the type of files to be verified and the actual situation. There is no limitation here. The file verification rules can be used to determine the accuracy and consistency of data during the migration process.

[0036] In an optional embodiment, during the data migration process, the file verification rules of the migration data, i.e., the files to be verified, are first obtained. The file verification rules can be generated based on the data type of the files to be verified to ensure the accuracy and consistency of the data during the migration process. The above process can not only effectively detect basic defects such as logical omissions, duplications, and data formats in the files, but also further analyze the impact of these defects on business continuity and data consistency, ensuring that only files that have been strictly inspected and meet the standards can be migrated to the new system, thereby ensuring the comprehensiveness and efficiency of the verification, significantly reducing errors and anomalies in the data migration process, and thus providing guarantees for the smooth launch and stable operation of the new system.

[0037] Step S204: determining the associated files of the file to be verified based on the file verification rule, wherein the associated files are used to represent files that have a data interaction relationship with the file to be verified.

[0038] The above data interaction relationship may refer to the relationship between different files in the data processing process, in which different files interact and transfer information through data fields or data records. The data interaction relationship may be direct, for example, the output of one file is directly used as the input of another file; or it may be indirect, that is, multiple files exchange and process data through intermediate tables or logical processing links.

[0039] The types of the above-mentioned associated files may include but are not limited to upstream associated files, downstream associated files and cross-associated files. The specific associated files need to be determined according to actual needs and are not limited here. The associated files can be used to ensure data consistency, discover potential errors in the data processing process, and perform targeted verification to avoid unnecessary full data checks, thereby improving the efficiency of data verification.

[0040] In an optional embodiment, the file verification mechanism in the data migration process is deepened by determining the associated files of the file to be verified based on the file verification rules. This method can not only ensure the accuracy and consistency of data migration, but also significantly improve the overall performance and reliability of the data processing system by identifying and correcting data interaction errors between files. Compared with the traditional verification method that only focuses on the integrity of a single file, the file verification method proposed in this application can more comprehensively evaluate the integrity of data migration and effectively avoid business interruptions and data security issues caused by broken data links or data inconsistencies. In addition, by focusing on associated files, the present application can perform targeted verification and reduce unnecessary data checks, thereby greatly improving the efficiency of data verification and reducing the cost of data migration.

[0041] Step S206, determining the association information of the file to be verified according to the association relationship between the associated file and the file to be verified, wherein the association information is used to represent the information involved in the data interaction process between the file to be verified and the associated file.

[0042] The above-mentioned association relationship may refer to the logical connection and dependency formed between the file to be verified and the associated file during the data interaction process during the data migration and processing process. The association relationship is reflected in the mapping between data fields, the reference of data records and the connection of data processing logic, which can be used to ensure the consistency, integrity and validity of data when it is transmitted between different files.

[0043] The above-mentioned associated information may refer to a specific description of the key data and processing details involved in the data interaction between the file to be verified and the associated file. The type of associated information may include but is not limited to field mapping information, data processing logic, data conversion rules, and data verification conditions. The specific associated information needs to be determined according to actual needs and is not limited here. The associated information can be used for data consistency verification, data integrity confirmation, data processing logic verification, and abnormal data location.

[0044] In an optional embodiment, by determining the association relationship between the file to be verified and the associated file, and then determining the associated information based on the association relationship, a deeper level of support is provided for file verification during the data migration process. This method can not only ensure the accuracy and completeness of data migration, but also provide a more comprehensive data verification perspective through detailed data interaction analysis, effectively prevent data errors and inconsistencies, and ensure business continuity and data security. Compared with traditional verification methods that only rely on field value matching, the technical solution of the present application can gain a deeper insight into the data transmission process, promptly discover and resolve potential data processing anomalies, and greatly improve the efficiency and quality of data verification.

[0045] Step S208, verifying the file to be verified based on the associated information to obtain a verification result, wherein the verification result is used to indicate whether there is an abnormality in the file to be verified.

[0046] The above-mentioned verification results may refer to the conclusions drawn after checking the verification file based on the associated information through verification algorithms and logical analysis. The types of verification results may include but are not limited to consistency verification results, integrity verification results, logic verification results, and format verification results. In addition to the above types, the verification results may be quantitative, such as the number of erroneous records in the file; or qualitative, such as whether the data conversion rules are implemented correctly, whether the data field mapping is accurate, etc. The specific verification results need to be determined according to the verification process, which is not limited here. The verification results can be used to confirm data quality, locate and correct problems, and provide a basis for the final decision.

[0047] In an optional embodiment, a verification scheme based on associated information can perform a comprehensive and in-depth verification of files in the data migration process, and the obtained verification results can not only efficiently confirm the accuracy, completeness and logic of the data, but also provide detailed verification at the data format level. Compared with the traditional verification method that only relies on simple field comparison, the file verification method of the present application can perform more accurate anomaly detection based on richer information dimensions, such as the mapping of data fields, the logic of data processing, the relationship of data references, etc., thereby ensuring the high-quality completion of data migration. At the same time, the present application reduces the need for manual intervention, improves verification efficiency, and reduces error rates through an automated verification process, providing strong technical support for the company's data migration projects.

[0048] In the embodiment of the present application, the file verification rules of the file to be verified are first obtained; then the associated files of the file to be verified are determined based on the file verification rules; then the associated information of the file to be verified is determined based on the association relationship between the associated files and the file to be verified; finally, the file to be verified is verified based on the associated information to obtain the verification result. It is easy to notice that the present application obtains the file verification rules of the file to be verified, and then determines the associated files that have a data interaction relationship with the file to be verified based on the file verification rules, and then determines the associated information of the file to be verified according to the data interaction relationship between the associated files and the file to be verified, and guides the file verification process through the associated information and the associated files to obtain the verification result. The above process guides the verification by obtaining the associated files and associated information of the file to be verified, provides powerful guiding data information for the file verification process, and ensures that all relevant files are included in the verification scope, thereby avoiding omissions and errors, reducing the risk of data migration, and improving the integrity and accuracy of data migration, thereby solving the technical problem of low file verification accuracy in the related technology.

[0049] Optionally, in the file verification method provided in the embodiment of the present application, the file to be verified is verified based on the associated information to obtain a verification result, including: comparing the associated information and the file to be verified to obtain difference data between the associated information and the file to be verified; in response to the difference data satisfying a preset condition, determining that the verification result is that there is an abnormality in the file to be verified, wherein the preset condition is a pre-set condition for indicating whether there is an abnormality in the file to be verified; in response to the difference data not satisfying the preset condition, determining that the verification result is that there is no abnormality in the file to be verified.

[0050] The above-mentioned difference data may refer to the data that is inconsistent or does not conform to the preset rules found by comparing the association information between the file to be verified and the associated files. The types of difference data may include but are not limited to field value differences, data structure differences, data format differences, and data logic differences. The specific difference data needs to be determined according to the actual situation and is not limited here. The difference data can be used for problem identification, data quality assurance, business process verification, and decision support.

[0051] The above-mentioned preset conditions may refer to a series of pre-set standards or rules when performing file verification, which are used to determine whether the difference data between the associated information and the file to be verified constitutes an anomaly. The types of preset conditions may include but are not limited to consistency thresholds, integrity checks, and logical rules. The specific preset conditions need to be determined based on the requirements of data quality and business continuity, and are not limited here. The preset conditions can be used to ensure the accuracy and completeness of the data migration and processing process.

[0052] In an optional embodiment, preset conditions are set according to data quality and business continuity requirements, and then the associated information is compared with the file to be verified to obtain difference data; then it is determined whether the difference data meets the preset conditions. If so, the verification result is determined to be that there is an anomaly in the file to be verified; if not, the verification result is determined to be that there is no anomaly in the file to be verified. The above file verification method based on associated information effectively improves the quality and efficiency of file verification in the data migration process by accurately comparing the difference data and performing anomaly analysis in combination with preset conditions. It can not only quickly identify key problems in data processing, but also accurately define the scope of anomalies under complex business logic, avoiding possible misjudgments or omissions in traditional verification methods.

[0053] Optionally, in the file verification method provided in the embodiment of the present application, the associated files include upstream associated files and downstream associated files, and the associated information of the file to be verified is determined according to the association relationship between the associated files and the file to be verified, including: determining the output data of the upstream associated file according to the association relationship, and determining the reference data of the downstream associated file, wherein the data output by the upstream associated file is applied to the file to be verified, and the data output by the file to be verified is applied to the downstream associated file, the output data is used to represent the data to be input to the file to be verified after data processing of the upstream associated file, and the reference data is used to represent the data to be input to the file to be verified; the output data and the reference data are input into the project processing logic corresponding to the file to be verified to obtain the associated information, wherein the project processing logic is used to represent the operations required to implement the project corresponding to the file to be verified.

[0054] The above-mentioned upstream associated file may refer to a file located before the file to be verified in the data processing flow. The upstream associated file contains the original data or preliminary processed data required for the file to be verified. The upstream associated file may provide data input for the file to be verified to ensure the consistency and integrity of the data in the processing chain.

[0055] The above-mentioned upstream associated file may refer to a file located after the file to be verified in the data processing flow. The upstream associated file receives the processing result or output data of the file to be verified as input for its subsequent processing. The downstream associated file may be used to verify the correctness of the output data of the file to be verified and ensure that the data can continue to flow according to the established business logic and data processing flow.

[0056] The above output data may refer to the data that needs to be input into the file to be verified after the upstream associated file has undergone specific data processing. The output data can be used to ensure that the data input of the file to be verified meets expectations, meets the requirements of data processing, and maintains the continuity of the data processing chain.

[0057] The above-mentioned reference data may refer to upstream data that needs to be referenced during the processing of the file to be verified. These data may be used to verify the data processing result of the file to be verified itself, and ensure the accuracy and consistency of the data during the processing.

[0058] The above-mentioned project processing logic may refer to the specific operational process required to implement the project corresponding to the file to be verified. The project processing logic may include but is not limited to data processing algorithms, data conversion rules, data verification conditions, data merging and distribution strategies, etc. The specific project processing logic needs to be determined according to actual needs and is not limited here. The project processing logic can be used to guide and standardize the data processing process to ensure the accuracy, integrity and efficiency of the data.

[0059] In an optional embodiment, first, the output data is determined according to the upstream associated file, and these data are received as input by the file to be verified after data processing; then, the reference data is determined according to the downstream associated file, that is, the data that needs to be provided to the downstream file after the file to be verified is processed. By combining the output data and the reference data with the project processing logic of the file to be verified, the associated information of the file to be verified is obtained. In the above process, by analyzing the data dependency relationship of the upstream and downstream files, the logical errors and data inconsistencies that may exist in the data migration process can be found, and the coherence of the data processing chain and the integrity of the data can be ensured. Secondly, this method can effectively locate the source of the data problem. Once the data anomaly is found, it can be quickly traced back to the upstream associated file or the downstream associated file, which is convenient for the rapid resolution of the problem. Thirdly, through the analysis of the automated output data and reference data, and the combination with the project processing logic, the present application can significantly improve the efficiency of file verification, reduce the error rate of manual verification, and reduce the cost and risk of data migration projects.

[0060] Optionally, in the file verification method provided in the embodiment of the present application, the method further includes: obtaining a project type corresponding to the project information contained in the file to be verified; and determining a project processing logic corresponding to the project information based on the project type.

[0061] The above-mentioned project information may refer to various details and attributes related to the data migration project. The project information may include but is not limited to the source of data, the target of data, the structure of data, the processing requirements of data, the time range of data, the business background of data, etc. The specific project information needs to be determined based on the file to be verified and is not limited here. The project information can be used to help understand the background, purpose and expected effect of data migration, determine the project type, and provide a basis for formulating effective data migration strategies and project processing logic.

[0062] The above-mentioned project type may refer to the category to which the project belongs after classifying the data migration project. The project type may be divided into multiple categories according to different dimensions such as the purpose of data migration, the nature of data, and the complexity of data processing. Project types may include but are not limited to full data migration, incremental data migration, data structure conversion, data quality improvement, data model reconstruction, etc. Each type has its specific processing logic. The specific project type needs to be determined based on the actual files to be inspected. It is not limited here. The project type can be used to clarify the project category and project processing logic, so as to ensure that data processing is performed according to the corresponding project type and processing logic.

[0063] In an optional embodiment, by obtaining the project information contained in the file to be verified and determining its project type, and further determining the project processing logic based on the project type, a more accurate and efficient strategy is provided for file verification in the data migration process. The above process can formulate a verification plan that matches the characteristics of the data migration project to ensure the pertinence and effectiveness of the verification process. For example, for data structure conversion projects, the accuracy of data field mapping can be verified; for data quality improvement projects, it is necessary to strengthen the verification of data cleaning effects. By deeply combining project information with project types, the present application can achieve comprehensive analysis and refined management of data migration projects, significantly improve the accuracy and efficiency of data migration, thereby reducing risks in the data migration process and ensuring business continuity and data security.

[0064] Optionally, in the file verification method provided in the embodiment of the present application, the project type corresponding to the project information contained in the file to be verified is obtained, including: determining the project type based on the identification information of the project information; or, determining historical project information whose similarity with the project information is greater than a preset similarity, and determining the historical project type corresponding to the historical project information as the project type.

[0065] The above-mentioned identification information may refer to a set of key data used to distinguish the characteristics of different projects or files. The identification information may include but is not limited to the name, version, type, creation date, modification record, business field, data source, data target and other key metadata of the project or file. The specific identification information needs to be determined according to the actual situation and is not limited here. The identification information can be used to connect the file to be verified with the project type and quickly determine the project type to which the file belongs.

[0066] The preset similarity may refer to a preset similarity threshold, which is used to determine the similarity between the project information of the file to be verified and the historical project information. When the similarity between the two exceeds the preset similarity, it can be considered that they are similar in project type, so that relevant processing experience of historical project types can be used for reference.

[0067] The above-mentioned historical project information may refer to the project details and data processing information recorded in the data migration projects executed in the past. The historical project information may include but is not limited to the project objectives, scope, process, results, etc. The specific historical project information needs to be determined based on the system records and is not limited here. Historical project information can serve as an important part of enterprise knowledge management and help accumulate and pass on the management experience and technical knowledge of data migration projects.

[0068] The above-mentioned historical project types may refer to categories summarized based on historical project information. The historical project types reflect the characteristics and processing logic of different data migration tasks, such as data structure conversion, data quality improvement, full data migration, etc. The historical project types can be used as templates for new projects to guide the planning and execution of new projects and improve the consistency and efficiency of project management.

[0069] In an optional embodiment, the project type can be determined in two ways: first, determining the project type based on the identification information of the project information; second, comparing the similarity between the project information and the historical project information with the preset similarity, and determining the historical project type corresponding to the historical project information with a similarity greater than the preset similarity as the project type. The above process not only simplifies the process of project classification, improves the accuracy of project type judgment, and enhances the system's adaptability to unknown or non-standard project types, but also provides strong guidance and guarantee for data processing of new projects through knowledge reuse and risk assessment.

[0070] Optionally, in the file verification method provided in the embodiment of the present application, the associated files of the file to be verified are determined based on the file verification rules, including: determining the project data chain corresponding to the file verification rule, wherein the project data chain is used to represent a data chain containing at least one project node, and different project nodes are used to achieve different project purposes; determining the project node position of the file to be verified according to the project data chain, wherein the project node position is used to represent the position of the project node corresponding to the file to be verified in the project data chain; and determining the associated files according to the project node position and the project data chain.

[0071] The above-mentioned project data chain may refer to a series of data processing steps and a collection of technical nodes experienced from the original data generation point to the final use point during the data migration or data processing process. The types of project data chains may include but are not limited to full data migration chain, incremental data migration chain, data quality improvement chain, and data structure conversion chain. The specific project data chain needs to be determined according to the project type and project purpose, and is not limited here. The project data chain can be used to track each step of data processing, facilitate auditing and problem location, conduct process control, and improve the efficiency and accuracy of data migration.

[0072] The above-mentioned project node may refer to a specific data processing unit in the project data chain. The project node represents a key step or function in the data processing process, such as reading of data source, preprocessing of data, verification of data, writing of data target, etc.

[0073] The above-mentioned project node position may refer to the arrangement order and position of the project nodes in the project data chain. The project node position reflects the process order of data processing, that is, the flow path of data from one node to another in the project data chain. The project node position can be used to control the flow direction and order of data in the processing process, ensure the continuity of data processing, clarify the dependencies of data processing, and help manage the dependencies before and after data processing.

[0074] In an optional embodiment, by determining the project data chain based on the file verification rules, and determining the project node position of the file to be verified in the project data chain accordingly, and further determining the associated files of the file to be verified, the refined management and automated control of file verification during the data migration process is realized. The above process effectively solves the neglect of the data processing flow and node dependency in traditional file verification. By clarifying the project data chain, it is not only possible to comprehensively track the data processing flow, but also to accurately locate the position of the file in the data processing process, so as to more accurately and efficiently determine the upstream and downstream associated files of the file to be verified, and ensure the consistency of data processing and the pertinence of data verification.

[0075] Optionally, in the file verification method provided in the embodiment of the present application, determining the project data chain corresponding to the file verification rule includes: determining at least one data processing logic involved in the file verification rule; in response to at least one data processing logic containing multiple data processing logics, concatenating the multiple data processing logics based on the logical order of the multiple data processing logics to obtain the project data chain; in response to at least one data processing logic containing a single data processing logic, determining the single data processing logic as the project data chain.

[0076] The above-mentioned logical sequence may refer to the order and dependency between various data processing logics or steps in the data processing flow. The types of logical sequences may include but are not limited to linear sequence, branching sequence, loop sequence, and parallel sequence. The specific logical sequence needs to be determined according to the actual situation and is not limited here. The logical sequence ensures the coherence and consistency of data processing and reflects the entire processing path of data from input to output and from source system to target system.

[0077] The above-mentioned series connection may refer to connecting multiple data processing logics in their logical order to form a complete project data chain. The types of series connection may include but are not limited to linear series connection, branch series connection, loop series connection and parallel series connection. The specific series connection type needs to be determined according to the logical order and is not limited here. The series connection process ensures seamless connection between data processing logics, so that data can be transferred from one processing logic to the next processing logic according to the established process order until the end of data processing.

[0078] In an optional embodiment, the project data chain is determined based on at least one data processing logic in the file verification rule, including the following two situations: For the case of multiple data processing logics, the logics are connected in an orderly manner according to the internal association and execution order between each logic to construct a complex but orderly project data chain. This process not only ensures the consistency of data processing, but also effectively avoids errors and omissions in the data processing process through clear dependency management, and improves the comprehensiveness and accuracy of file verification; when the file verification rule only involves a single data processing logic, it is directly determined as a project data chain, thereby simplifying the generation process of the project data chain and improving the efficiency and response speed of file verification. Especially in the scenario where the data migration requirements are relatively simple and the data processing logic is relatively simple, this method can quickly locate and verify files, reduce unnecessary processing steps, and save time and computing resources.

[0079] The file verification method provided in the embodiment of the present application guides the verification by obtaining the associated files and associated information of the file to be verified, thereby providing powerful guiding data information for the file verification process, and at the same time ensuring that all relevant files are included in the verification scope, thereby avoiding omissions and errors, reducing the risk of data migration, and improving the integrity and accuracy of data migration, thereby solving the technical problem of low file verification accuracy in related technologies.

[0080] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0081] Example 2

[0082] The present application also provides a file verification device. It should be noted that the file verification device of the present application can be used to execute the file verification method provided by the present application. The file verification device provided by the present application is introduced below.

[0083] According to an embodiment of the present application, a device for implementing the above-mentioned file verification method is also provided. Figure 3 is a schematic diagram of a file verification device according to an embodiment of the present application, such as Figure 3As shown, the device includes: a first acquisition module 302, used to obtain a file verification rule of a file to be verified, wherein the file verification rule is used to guide the verification process of the file to be verified; a first determination module 304, used to determine the associated file of the file to be verified based on the file verification rule, wherein the associated file is used to indicate a file that has a data interaction relationship with the file to be verified; a second determination module 306, used to determine the associated information of the file to be verified according to the association relationship between the associated file and the file to be verified, wherein the associated information is used to indicate information involved in the data interaction process between the file to be verified and the associated file; a verification module 308, used to verify the file to be verified based on the associated information to obtain a verification result, wherein the verification result is used to indicate whether there is an abnormality in the file to be verified.

[0084] The file verification device provided in the embodiment of the present application and the file verification method provided in the embodiment of the present application guide the verification by obtaining the associated files and associated information of the file to be verified, thereby providing powerful guiding data information for the file verification process, and at the same time ensuring that all relevant files are included in the verification scope, thereby avoiding omissions and errors, reducing the risk of data migration, and improving the integrity and accuracy of data migration, thereby solving the technical problem of low file verification accuracy in related technologies.

[0085] Optionally, in the file verification device provided in the embodiment of the present application, the verification module includes: a comparison unit, used to compare the associated information and the file to be verified to obtain difference data between the associated information and the file to be verified; a first determination unit, used to determine that the verification result is that there is an abnormality in the file to be verified in response to the difference data satisfying a preset condition, wherein the preset condition is a pre-set condition for indicating whether there is an abnormality in the file to be verified; and a second determination unit, used to determine that the verification result is that there is no abnormality in the file to be verified in response to the difference data not satisfying the preset condition.

[0086] Optionally, in the file verification device provided in the embodiment of the present application, the associated files include upstream associated files and downstream associated files, and the second determination module includes: a third determination unit, used to determine the output data of the upstream associated files according to the association relationship, and determine the reference data of the downstream associated files, wherein the data output by the upstream associated files are applied to the file to be verified, and the data output by the file to be verified are applied to the downstream associated files, the output data is used to represent the data to be input to the file to be verified after data processing of the upstream associated files, and the reference data is used to represent the data to be input to the file to be verified; an input unit, used to input the output data and the reference data into the project processing logic corresponding to the file to be verified to obtain association information, wherein the project processing logic is used to represent the operations required to implement the project corresponding to the file to be verified.

[0087] Optionally, in the file verification device provided in the embodiment of the present application, the device also includes: a second acquisition module, used to obtain the project type corresponding to the project information contained in the file to be verified; and a third determination module, used to determine the project processing logic corresponding to the project information based on the project type.

[0088] Optionally, in the file verification device provided in the embodiment of the present application, the second acquisition module includes: a fourth determination unit, used to determine the project type based on the identification information of the project information; or, a fifth determination unit, used to determine historical project information whose similarity with the project information is greater than a preset similarity, and determine that the historical project type corresponding to the historical project information is the project type.

[0089] Optionally, in the file verification device provided in the embodiment of the present application, the first determination module includes: a sixth determination unit, used to determine the project data chain corresponding to the file verification rule, wherein the project data chain is used to represent a data chain containing at least one project node, and different project nodes are used to achieve different project purposes; a seventh determination unit, used to determine the project node position of the file to be verified according to the project data chain, wherein the project node position is used to represent the position of the project node corresponding to the file to be verified in the project data chain; an eighth determination unit, used to determine the associated file based on the project node position and the project data chain.

[0090] Optionally, in the file verification device provided in the embodiment of the present application, the sixth determination unit includes: determining at least one data processing logic involved in the file verification rule; in response to at least one data processing logic containing multiple data processing logics, connecting the multiple data processing logics in series based on the logical order of the multiple data processing logics to obtain a project data chain; in response to at least one data processing logic containing a single data processing logic, determining the single data processing logic as a project data chain.

[0091] It should be noted that the above-mentioned modules or units can be hardware components or software components stored in a memory (e.g., memory 104) and processed by one or more processors (e.g., processors 102a, 102b, ..., 102n), and the above-mentioned modules can also be run as part of the device in the computer terminal 10 provided in Example 1.

[0092] Example 3

[0093] An embodiment of the present application may provide an electronic device, Figure 4 is a structural block diagram of an electronic device according to an embodiment of the present application. Figure 4 As shown, the electronic device may include: one or more ( Figure 4(only one is shown) processor 402, memory 404, storage controller, and peripheral interface, wherein the peripheral interface is connected to the radio frequency module, audio module and display.

[0094] Among them, the memory can be used to store software programs and modules, such as program instructions / modules corresponding to the methods and devices in the embodiments of the present application, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, realizing the above-mentioned method. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0095] The processor can call the information and application stored in the memory through the transmission device to perform the following steps: obtain the file verification rules of the file to be verified, wherein the file verification rules are used to guide the verification process of the file to be verified; determine the associated files of the file to be verified based on the file verification rules, wherein the associated files are used to represent files that have a data interaction relationship with the file to be verified; determine the associated information of the file to be verified based on the association relationship between the associated files and the file to be verified, wherein the associated information is used to represent the information involved in the data interaction process between the file to be verified and the associated files; verify the file to be verified based on the associated information to obtain a verification result, wherein the verification result is used to indicate whether there is an abnormality in the file to be verified.

[0096] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: compare the associated information and the file to be verified to obtain difference data between the associated information and the file to be verified; in response to the difference data satisfying a preset condition, determine that the verification result is that there is an abnormality in the file to be verified, wherein the preset condition is a pre-set condition for indicating whether there is an abnormality in the file to be verified; in response to the difference data not satisfying the preset condition, determine that the verification result is that there is no abnormality in the file to be verified.

[0097] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: determine the output data of the upstream associated file according to the association relationship, and determine the reference data of the downstream associated file, wherein the data output by the upstream associated file is applied to the file to be verified, and the data output by the file to be verified is applied to the downstream associated file, the output data is used to represent the data to be input to the file to be verified after the upstream associated file has been processed, and the reference data is used to represent the data to be input to the file to be verified; the output data and the reference data are input into the project processing logic corresponding to the file to be verified to obtain the association information, wherein the project processing logic is used to represent the operations required to implement the project corresponding to the file to be verified.

[0098] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: obtaining the project type corresponding to the project information contained in the file to be verified; and determining the project processing logic corresponding to the project information based on the project type.

[0099] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: determine the project type based on the identification information of the project information; or determine historical project information whose similarity with the project information is greater than a preset similarity, and determine the historical project type corresponding to the historical project information as the project type.

[0100] The processor can also call the information and application stored in the memory through the transmission device to perform the following steps: determine the project data chain corresponding to the file verification rule, wherein the project data chain is used to represent a data chain containing at least one project node, and different project nodes are used to achieve different project purposes; determine the project node position of the file to be verified according to the project data chain, wherein the project node position is used to represent the position of the project node corresponding to the file to be verified in the project data chain; determine the associated file according to the project node position and the project data chain.

[0101] The processor can also call the information and application programs stored in the memory through the transmission device to perform the following steps: determine at least one data processing logic involved in the file verification rule; in response to at least one data processing logic containing multiple data processing logics, connect the multiple data processing logics in series based on the logical order of the multiple data processing logics to obtain a project data chain; in response to at least one data processing logic containing a single data processing logic, determine the single data processing logic as a project data chain.

[0102] The present application embodiment provides a file verification scheme. The file verification method provided by the present application embodiment guides verification by obtaining the associated files and associated information of the file to be verified, provides powerful guiding data information for the file verification process, and ensures that all related files are included in the verification scope, thereby avoiding omissions and errors, reducing the risk of data migration, and improving the integrity and accuracy of data migration, thereby solving the technical problem of low file verification accuracy in related technologies.

[0103] It can be understood by those skilled in the art that Figure 4 The structure shown is for illustration only, and the electronic device may also be a smart phone (such as an Android phone, an iOS phone, etc.), a tablet computer, a PDA, a mobile Internet device (Mobile Internet Devices, MID), a PAD, or other terminal devices. Figure 4 The structure of the electronic device is not limited. Figure 4 More or fewer components (such as network interfaces, display devices, etc.) shown in, or having Figure 4 Different configurations are shown.

[0104] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the hardware related to the terminal device through a program, and the program can be stored in a computer-readable storage medium, and the storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0105] Example 4

[0106] The embodiment of the present application further provides a storage medium. Optionally, in this embodiment, the storage medium can be used to store the program code executed by the file verification method provided in the first embodiment.

[0107] Optionally, in this embodiment, the above storage medium may be located in any computer terminal in a computer terminal group in a computer network, or in any mobile terminal in a mobile terminal group.

[0108] The present application also provides a computer program product, which, when executed on a data processing device, is suitable for executing the steps of the file verification method.

[0109] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0110] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0111] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0112] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0113] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0114] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0115] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A file verification method, characterized in that: include: Obtaining a file verification rule for the file to be verified, wherein the file verification rule is used to guide the verification process of the file to be verified; Determine an associated file of the file to be verified based on the file verification rule, wherein the associated file is used to represent a file that has a data interaction relationship with the file to be verified; Determining association information of the file to be verified according to the association relationship between the associated file and the file to be verified, wherein the association information is used to represent information involved in a data interaction process between the file to be verified and the associated file; The file to be verified is verified based on the associated information to obtain a verification result, wherein the verification result is used to indicate whether there is an abnormality in the file to be verified.

2. The method according to claim 1, characterized in that Verifying the file to be verified based on the associated information to obtain a verification result includes: Comparing the associated information with the file to be verified to obtain difference data between the associated information and the file to be verified; In response to the difference data satisfying a preset condition, determining that the verification result is that the file to be verified has the abnormality, wherein the preset condition is a pre-set condition for indicating whether the file to be verified has the abnormality; In response to the difference data not satisfying the preset condition, determining that the verification result is that the file to be verified does not have the abnormality.

3. The method according to claim 1, characterized in that The associated file includes an upstream associated file and a downstream associated file. According to the associated relationship between the associated file and the file to be verified, the associated information of the file to be verified is determined, including: Determine output data of the upstream associated file according to the association relationship, and determine reference data of the downstream associated file, wherein the data output by the upstream associated file is applied to the file to be verified, and the data output by the file to be verified is applied to the downstream associated file, the output data is used to represent the data to be input to the file to be verified after the upstream associated file has been processed, and the reference data is used to represent the data to be input to the file to be verified; The output data and the reference data are input into the project processing logic corresponding to the file to be verified to obtain the associated information, wherein the project processing logic is used to represent the operations required to implement the project corresponding to the file to be verified.

4. The method according to claim 3, characterized in that The method further comprises: Get the project type corresponding to the project information contained in the file to be verified; The project processing logic corresponding to the project information is determined based on the project type.

5. The method according to claim 4, characterized in that Get the project type corresponding to the project information contained in the file to be verified, including: Determining the project type based on identification information of the project information; Or, determine historical project information whose similarity with the project information is greater than a preset similarity, and determine that the historical project type corresponding to the historical project information is the project type.

6. The method according to claim 1, characterized in that Determining the associated files of the file to be verified based on the file verification rule includes: Determine a project data chain corresponding to the file verification rule, wherein the project data chain is used to represent a data chain containing at least one project node, and different project nodes are used to achieve different project purposes; Determine the project node position of the file to be verified according to the project data chain, wherein the project node position is used to indicate the position of the project node corresponding to the file to be verified in the project data chain; The associated file is determined according to the project node position and the project data link.

7. The method according to claim 6, characterized in that Determining the project data chain corresponding to the file verification rule includes: Determine at least one data processing logic involved in the file verification rule; In response to the at least one data processing logic including a plurality of data processing logics, the plurality of data processing logics are connected in series based on a logical sequence of the plurality of data processing logics to obtain a project data chain; In response to the at least one data processing logic including a single data processing logic, the single data processing logic is determined to be the project data chain.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored executable program, wherein when the executable program is executed, the device where the computer-readable storage medium is located is controlled to execute the method according to any one of claims 1 to 7.

9. An electronic device, characterized in that: include: A memory storing an executable program; A processor, configured to run the program, wherein the program executes the method according to any one of claims 1 to 7 when running.

10. A computer program product comprising computer instructions, characterized in that When the computer instructions are executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images