Data processing method and device, equipment and storage medium

Abstract

The application provides a data processing method, device and equipment and a storage medium, which can be used in the field of big data platforms. The method comprises the following steps: detecting whether the version of a target data dictionary file of a new business system is updated; if it is detected that the version is updated, obtaining the target data dictionary file of the new version of the new business system and a data migration rule file corresponding to the target data dictionary file of the previous version of the new business system, wherein the data migration rule file is used to describe the data migration rule of migrating data from an original business system to the new business system. According to the data migration rule file and the target data dictionary file after the version is updated, the content of the version adjustment of the target data dictionary file is determined. According to the adjusted content, the content to be adjusted in the data migration rule file is determined and marked, and the marked data migration rule file is output. The method of the application improves the efficiency and accuracy of the cross-platform migration of the core banking system.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of big data platforms, and in particular to a data processing method and device, equipment and a storage medium. BACKGROUND

[0002] At present, in the core banking system, a large number of data tables are needed to store huge amounts of customer, account, transaction information and associated information. When the bank needs to migrate the core banking system across platforms, it needs to migrate these large amounts of data to the new business system. Among them, the data dictionary needs to be determined according to the requirements of the new business system and the actual business needs during the migration process, and the data migration rules are formulated to determine the data structure of these data tables and information data in the new business system. However, the current cross-platform migration method of the core banking system has the problems of low migration efficiency and easy errors.

[0003] Therefore, how to improve the efficiency of cross-platform migration of the core banking system is a problem to be solved. SUMMARY

[0004] The present application provides a data processing method, device, equipment and storage medium to solve the problem of how to improve the efficiency of cross-platform migration of the core banking system.

[0005] In a first aspect, the present application provides a data processing method, comprising:

[0006] detecting whether the version of the target data dictionary file of the new business system is updated; the target data dictionary file comprises a target data structure in the new business system;

[0007] If the version is detected to be updated, the target data dictionary file of the new version of the new business system is obtained, and the data migration rule file corresponding to the target data dictionary file of the previous version of the new business system; the data migration rule file is used to describe the data migration rule of migrating data from the original business system to the new business system, and the data migration rule file comprises: the target data structure, the original data structure in the original business system, and the migration rule of the target data structure and the original data structure;

[0008] According to the data migration rule file and the target data dictionary file after version update, the content of this version adjustment of the target data dictionary file is determined;

[0009] According to the adjusted content, the content to be adjusted in the data migration rule file is determined;

[0010] The content to be adjusted is marked in the data migration rule file; wherein different adjustment methods have different marking methods;

[0011] output the marked data migration rule file.

[0012] In a second aspect, the present application provides a data processing apparatus, comprising:

[0013] a detection module configured to detect whether a version of a target data dictionary file of a new business system is updated, wherein the target data dictionary file comprises a target data structure in the new business system;

[0014] a obtaining module configured to, if it is detected that the version is updated, obtain a target data dictionary file of a new version of the new business system, and a data migration rule file corresponding to a target data dictionary file of a previous version of the new business system, wherein the data migration rule file is used to describe a data migration rule of migrating data from an original business system to the new business system, and the data migration rule file comprises the target data structure, an original data structure in the original business system, and a migration rule of the target data structure and the original data structure;

[0015] a processing module configured to determine content of a version adjustment of the target data dictionary file according to the data migration rule file and the target data dictionary file after the version is updated, and determine content to be adjusted in the data migration rule file according to the adjusted content;

[0016] a marking module configured to mark the content to be adjusted in the data migration rule file, wherein different adjustment modes of the content adopt different marking modes;

[0017] an output module configured to output the marked data migration rule file.

[0018] In a third aspect, the present application provides an electronic device, comprising a processor, a communication interface, and a memory, wherein the processor is in communication connection with the communication interface and the memory respectively;

[0019] the memory stores computer execution instructions;

[0020] the communication interface communicates with an external device;

[0021] the processor executes the computer execution instructions stored in the memory to implement the method according to any one of the first aspect.

[0022] In a fourth aspect, the present application provides a computer readable storage medium, wherein the computer readable storage medium stores computer execution instructions, and the computer execution instructions are executed by a processor to implement the data processing method according to any one of the first aspect.

[0023] In a fifth aspect, the present application provides a computer program product, which, when executed by a processor, is configured to implement the data processing method according to any one of the first aspect.

[0024] The data processing method, device, equipment and storage medium provided by the present application can determine the content of the version adjustment of the target data dictionary file according to the data migration rule file and the version-updated target data dictionary file by means of automatic comparison when detecting the version update of the target data dictionary, and mark the content according to the adjustment mode to obtain the marked data migration rule file, thereby improving the comparison efficiency of the target data dictionary and the original data dictionary, and further improving the efficiency and accuracy of the cross-platform migration of the core banking system and saving the labor cost. BRIEF DESCRIPTION OF DRAWINGS

[0025] The accompanying drawings, which are incorporated herein and constitute part of the specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0026] Figure 1 A flowchart of a data processing method provided by an embodiment of the present application;

[0027] Figure 2 A structural diagram of a data migration rule file provided by an embodiment of the present application;

[0028] Figure 3 A structural diagram of a target data dictionary file provided by an embodiment of the present application;

[0029] Figure 4 A structural diagram of an adjustment content linkage change provided by an embodiment of the present application;

[0030] Figure 5 A flowchart of another data processing method provided by an embodiment of the present application;

[0031] Figure 6 A flowchart of still another data processing method provided by an embodiment of the present application;

[0032] Figure 7 A flowchart of yet another data processing method provided by an embodiment of the present application;

[0033] Figure 8 A flowchart of still another data processing method provided by an embodiment of the present application;

[0034] Figure 9 A structural diagram of a data processing device provided by an embodiment of the present application;

[0035] Figure 10A structural schematic diagram of an electronic device is provided for an embodiment of the present application.

[0036] The specific embodiments of the present application have been shown through the above-described drawings, and will be described in more detail hereinafter. These drawings and the written description are not intended to restrict the scope of the present application in any way, but to illustrate the concept of the present application for those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0037] The exemplary embodiments will be described in detail herein with reference to the attached drawings. In the following description, the same numbers are used to indicate the same or similar components. The embodiments described in the following exemplary embodiments are not meant to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present application as detailed in the appended claims.

[0038] It should be noted that the user information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of the relevant data need to comply with relevant laws, regulations and standards, and provide corresponding operation portal for the user to choose authorization or refusal.

[0039] It should be noted that the data processing method, device, equipment and storage medium of the present application can be used in the field of big data platform, and can also be used in any field other than the field of big data platform. The application field of the method and device configured by the system of the present application is not limited.

[0040] Firstly, some terms involved in the present application are explained.

[0041] Core banking system: the core business system of a bank, which is customer-centered, performs account processing and provides 24-hour service.

[0042] Data dictionary: a data table structure, for example, which data tables are included, which fields are included in each data table, and the value rule definition of each field. Among them, the original data dictionary is the data table structure of the original business system before data migration; the target data dictionary is the data table structure of the new business system after data migration.

[0043] In the cross-platform migration of a core banking system, a large number of data tables included in an original business system and huge customer, account and transaction information and associated information stored in the data tables need to be migrated to a new business system. In the migration process, a target data dictionary needs to be determined according to the requirements of the business system and actual business needs, and migration rules of the information data are formulated in combination of the original data dictionary in the original business system and the target data dictionary, so as to smoothly migrate the information data in the original business system to the new business system.

[0044] The main changes in the change of the original data dictionary to the target data dictionary are from the business side and the technical side. The business side determines the content of the data dictionary changed in the banking business according to the actual business needs, such as business scenarios and business processes. The content change may be, for example, data tables and data fields that meet new business needs. The technical side adjusts the data structure of the data that needs to be changed in the data dictionary to support the changes of the business side. The change may be, for example, the data structure of the data table and the data structure of the data field. Since the business side usually analyzes the business needs step by step and gradually excavates the items that need to be adjusted during the analysis, such as excavating the special business scenarios that need to be added and determining the detailed items required in the special business scenarios. In multiple adjustments of the data dictionary, the contents that need to be adjusted are constantly compared between the target data dictionary and the original data dictionary, and the data in the data table, and the data migration rules are adjusted multiple times according to the differences between the contents.

[0045] Currently, the differences between the data structure in the target data dictionary and the last version of the target data structure included in the data migration rule file are compared and analyzed by manual methods, and the corresponding data migration rules are adjusted according to the comparison and analysis results. Under the existing adjustment method, there is a problem of low efficiency in the cross-platform migration of the core banking system, and since the adjustment of the data dictionary usually needs to be adjusted multiple times before it can be determined, a large amount of human cost is consumed in the multiple comparison processes, and there is a problem of easy errors in manual adjustment.

[0046] Therefore, the present application provides a data processing method. When the version update of the target data dictionary is detected, the contents of the version adjustment of the target data dictionary file are determined by automatic comparison according to the data migration rule file and the version-updated target data dictionary file, and the contents are marked according to the adjustment method to obtain a marked data migration rule file, thereby improving the comparison efficiency of the target data dictionary and the original data dictionary, and further improving the efficiency and accuracy of the cross-platform migration of the core banking system and saving the human cost.

[0047] It should be understood that the data processing method provided in the present application is not limited to the scenario of cross-platform migration of the core banking system, but can also be applied to the cross-platform migration scenarios of other big data platforms, such as the cross-platform migration scenarios of other financial systems, the cross-platform migration scenarios of other Internet big data platforms, and the like.

[0048] The execution subject of the data processing method provided in the present application can be a terminal device with a data processing function, or a processing chip of the terminal device. When the execution subject is a terminal device with a data processing function, the terminal device can be, for example, a computer, a mobile phone or other computing device with a computing function. The computing device can be deployed with software or program code for running the data processing method, and the software or program code is used to process, compare, mark and the like data. The execution subject of the method can also be a cloud platform with a data processing function. When the execution subject is a cloud platform, the processing of data in the method can be performed in the cloud. The cloud platform can be logically divided into multiple parts according to actual needs, and each part has a different function. Each part of the data processing platform can be deployed in any two or three of the electronic device (located on the user side), the edge environment and the cloud environment. The edge environment is an environment including a set of edge electronic devices close to the electronic device, and the edge electronic devices include edge servers, edge small stations with computing power, and the like. Each part of the data processing platform deployed in different environments or devices cooperates to realize the function of the data processing platform. It should be understood that the present application does not limit the division of which parts of the data processing platform are specifically deployed in which environment, and the actual application can be adaptively deployed according to the computing power of the electronic device, the resource occupation of the edge environment and the cloud environment, or specific application requirements.

[0049] The following will take the data processing software deployed on the computing device as an example to specifically describe the technical solutions of the present application and how the technical solutions of the present application solve the above technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes can not be described again in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

[0050] Figure 1 A flowchart of a data processing method provided in an embodiment of the present application is shown in FIG. 1. As shown in FIG. 1, the method can include the following steps. Figure 1

[0051] S101, detecting whether the version of the target data dictionary file of the new business system is updated.

[0052] ​The target data dictionary file includes the target data structure of the new business system. This target data structure corresponds to the target data dictionary of a previous version on the platform where the new business system resides. The target data structure may include data structures identical to those of the original business system, as well as data structures different from those of the original business system. This target data structure was determined in the previous version of the business system based on changes in both the business and technical aspects. This application does not impose any restrictions on the specific structure of this target data structure.

[0053] The method for detecting whether the target data dictionary file of the new business system has been updated could be, for example, by detecting whether an update request has been received from staff, or by detecting whether the version identifier of the target data dictionary file has changed. This version identifier could be, for example, the version number of the target data dictionary file. This application does not limit the method used to monitor whether the version has been updated.

[0054] S102. If a version update is detected, obtain the target data dictionary file of the new version of the new business system, and the data migration rule file corresponding to the target data dictionary file of the previous version of the new business system.

[0055] The data migration rule file describes the data migration rules for migrating data from the original business system to the new business system. This file includes: the target data structure, the original data structure in the original business system, and the migration rules between the target data structure and the original data structure. For example, Figure 2 This is a schematic diagram of the structure of a data migration rule file provided in an embodiment of this application, as shown below. Figure 2 As shown, the data migration rule file may include n data tables. Taking one of the data tables as an example, it specifically includes the target data structure, the original data structure, and the migration rules. The content of the target data structure is the content included in the target data dictionary file of the previous version of the new business system. Figure 3 This is a schematic diagram of the structure of a target data dictionary file provided in an embodiment of this application, such as... Figure 3 As shown, the target data structure may include, for example, the Chinese and English names of the corresponding data tables in the target data dictionary file, the Chinese and English names of the fields, the data dictionary number, the data type, the field length, and the valid value range, etc., where the data type... Figure 3Take char type as an example, the type represents a string represented by a specified fixed length, for example, char(9) is a string represented by a specified fixed length of 9 characters, and the data type in the application is not limited to char type, for example, it can also be int, short and other common variable types. The original data structure is the content included in the original data dictionary file in the original business system, which is similar to the structure shown in the figure, and will not be described here. The migration rule of the target data structure and the original data structure can be the data migration rule of the original business system migrated to the new business system of the previous version. Figure 3

[0056] The target data dictionary file, and the data migration rule file can be obtained from a storage medium in which the files are stored according to the version identifier of the target data dictionary file, can be manually imported by staff, or can be generated according to the target data dictionary and the data migration rule.

[0057] S103, according to the data migration rule file, and the version updated target data dictionary file, determine the content of the target data dictionary file this time.

[0058] The content of this version adjustment is determined according to whether there is a difference between the content included in the target data dictionary file and the content included in the target data structure in the data migration rule file. For example, there is a difference between the data table included in the target data dictionary file and the data table included in the target data structure, for example, a data table is added or deleted; or the content included in the same data table in the target data dictionary file and the target data structure is different, for example, a field is added or the content of the field is adjusted. The content with the difference in the above two is taken as the content of the target data dictionary file this time.

[0059] S104, according to the adjusted content, determine the content to be adjusted in the data migration rule file.

[0060] When there is adjustment content, it means that when migrating the target data structure, the corresponding data migration rule of the target data structure needs to be adjusted, so that the target data structure can be migrated from the platform where the original business system is located to the new business system of the new version. According to the adjusted content, determine the migration rule to be adjusted in the data migration rule file, which corresponds to the adjusted content, for example, the position of the adjusted content can be determined according to the position of the adjusted content.

[0061] Exemplary, Figure 4 A structure diagram of adjusting the content of the linkage change provided by the embodiment of the application. As shown in Figure 4 ​As shown, according to the target data structure in the data migration rule file and the data structure of the target data dictionary file after version update, the data in the target data structure that needs to be adjusted is determined, and according to the data in the adjusted target data structure and the data in the original data structure, the adjustment of the migration rule corresponding to the data is determined.

[0062] S105, marking the content to be adjusted in the data migration rule file.

[0063] Different adjustment modes are marked in different ways. For example, the different adjustment modes can be data adjustment modes such as adding, deleting, and modifying, and the different marking methods can be color marking, note marking, display format marking, etc. For example, different colors can be used to mark the data adjustment modes such as adding, deleting, and modifying, or different notes can be used, or different display formats can be used for marking, or at least two of the above marking methods can be used simultaneously.

[0064] S106, outputting the marked data migration rule file.

[0065] The marked data migration rule file is used to indicate which data migration rules need to be adjusted, so that the business system can be migrated from the platform where the original business system is located to the platform where the new business system is located through the data migration rule. The marked data migration rule file can be directly output to the terminal device of the staff, such as a computer, a mobile phone, etc., or directly output to the terminal device of the new business system, or output to a storage medium, etc.

[0066] The method provided by the embodiment of the application determines the content of the target data dictionary file adjusted this time according to the data migration rule file and the target data dictionary file after version update, determines the content to be adjusted in the data migration rule file according to the content, and outputs the data migration rule file marked with the content to be adjusted. Through the automatic comparison method, it is indicated that the data migration rule needs to be adjusted to migrate the business system from the platform where the original business system is located to the platform where the new business system is located, thereby improving the comparison efficiency of the target data dictionary and the original data dictionary, and further improving the efficiency and accuracy of the cross-platform migration of the core banking system, and saving the labor cost.

[0067] Next, how to determine the content of the target data dictionary file adjusted this time according to the data migration rule file and the target data dictionary file after version update in step S103 is described in detail. Figure 5 The flowchart of another data processing method provided by the embodiment of the application is shown in FIG. 6. Figure 5As shown, step S103 can include:

[0068] S501, the full content of the target data structure part in the data migration rule file is generated into at least one first text file according to the dimension of the data table.

[0069] The first text file can be, for example, an excel file, or a database text file, or other processable data text file, and the like. The at least one first text file is generated according to the dimension of the data table, that is, one first text file is generated for each data table. For example, if the target data structure part in the data migration rule file includes 100 data tables, 100 first text files are generated. The first text file includes all the contents of the data table in the target data structure part in the data migration rule file.

[0070] S502, the full content of the target data structure in the version-updated target data dictionary file is generated into at least one second text file according to the dimension of the data table.

[0071] The second text file is of the same type as the first text file. The second text file includes all the contents of the data table in the target data structure in the version-updated target data dictionary file.

[0072] The first text file and the second text file are named according to the data table name, and the data in the data table is stored according to the field order, and the data between each field is separated by a preset character. Taking Figure 3 as an example, the name of the first text file and the second text file can be Figure 3 as shown in the Chinese name of the data table, or the English name of the data table. In Figure 3 the data table content shown, the field order is the row number order in the corresponding data table, which can be shown in Table 1 as follows:

[0073] Table 1

[0074] Column Chinese name of data table … Chinese name of field Data dictionary number … 1 Product transaction restriction table … Saleable product number ZD-JC0-00000001 … 2 Product transaction restriction table … Transaction code ZD-JC0-00000002 … 3 Product transaction restriction table … Channel business scenario code ZD-JC0-00000003 … … … … … … …

[0075] The data in the field 1 includes the Chinese name of the data table, the Chinese name of the field, the data dictionary number, and the like, and each data is a field. The preset character used to separate the data in each field can be, for example, a vertical line, an underscore, a diagonal line, and the like. The specific selection of the preset character is not limited in the present application, as long as it can separate the data in each field.

[0076] S503, the content of the preset field in each field in the first text file is taken as the key value corresponding to the field, and the content of the preset field in each field in the second text file is taken as the key value corresponding to the field.

[0077] This key value is used to determine whether the data in the fields being compared between the first and second text files are of the same type during the comparison, thus ensuring the accuracy of the comparison. This preset field can be, for example, the name of the data field representing the data in that field, such as the Chinese name of the field or the data dictionary number in Table 1 above, as long as it ensures that the data in the fields being compared between the first and second text files are of the same type.

[0078] For example, continuing with Table 1 above, we can use the Chinese name of the field corresponding to column 1 in the first text file as the key value for that column, and similarly, use the Chinese name of the field corresponding to column 1 in the second text file as the key value for that column. When comparing, we simply compare the contents of the remaining fields in columns with the same key value in both text files.

[0079] Another possible implementation is to use the content of preset fields in the first text file as the keys for all fields, and the content of preset fields in the second text file as the keys for all fields. In this implementation, the keys for all fields in the first text file are from the same column, and the keys for all fields in the second text file are also from the same column. For example, the keys for all fields in the first text file are the Chinese names of the fields shown in Table 1 above, and the keys for all fields in the second text file are also the Chinese names of the fields shown in Table 1 above. When comparing, simply select the fields with the same key content for comparison.

[0080] S504. Based on the key values ​​corresponding to each field in the first text file and the key values ​​corresponding to each field in the second text file, compare the remaining contents of the first text file and the second text file to determine the content of this version adjustment of the target data dictionary file.

[0081] The remaining content could be, for example, Figure 3 The data dictionary file includes the data dictionary number, data type, field length, and valid value range. If any content differs between the first and second text files, that content is identified as one of the adjustments made to the target data dictionary file in this version. After comparing all the content from the first and second text files, all the different content is identified as the adjustments made to the target data dictionary file in this version.

[0082] The following example uses an Excel file containing both the data migration rule file and the target data dictionary file to illustrate how to determine the content of the target data dictionary file's version adjustments based on the data migration rule file and the updated target data dictionary file. Figure 6This is a flowchart illustrating another data processing method provided in an embodiment of this application. Figure 6 As shown, the method may include:

[0083] S601, Displays the data migration rule file, and a comparison control.

[0084] The data migration rule file can be, for example, Figure 2 The file shown is an Excel file. This comparison control is used to perform comparison operations, such as selecting files, setting key values, performing comparisons, and obtaining comparison results. Specifically, the file selection option can choose between the data migration rule file and the target data dictionary file to be compared, or it can select a specific data table file within the data migration rule file and the target data dictionary file (i.e.,...). Figure 4 (Referring to the first and second text files mentioned earlier). By setting key values, each file can have a key value used for comparing the remaining content. This key value setting can be done for a single text file or in batches for multiple text files. The comparison function primarily compares the data tables in the data migration rule file and the target data dictionary file, and also compares the remaining content in the first and second text files based on the key values. This function can be implemented using a text comparison program, such as a VBA (Visual Basic for Applications) program in Excel, an automated comparison tool included in Excel, or a third-party plugin. The comparison results can be displayed by marking, or the marked data migration rule file can be directly output.

[0085] S602. In response to the user's operation on the comparison control, determine the content of the target data dictionary file adjusted in this version based on the data migration rule file and the target data dictionary file after the version update.

[0086] The user's operation on the comparison control can be performed, for example, by clicking or inputting through the interactive interface of the comparison control, according to the functions included in step S601. Optionally, the comparison control can also directly obtain the data migration rule file and the target data dictionary file after the version update based on the version number, and automatically set the key values. The user only needs to operate the comparison function to obtain the comparison result with one click.

[0087] The method provided by the embodiments of the present application can compare the first text file generated by the target data structure part of the data migration rule file and the second text file generated by the target data structure in the target data dictionary file after version update, compare all contents in the first text file and the second text file, and thus automatically obtain the content of the target data dictionary file adjusted this time, thereby improving the comparison efficiency and accuracy and reducing the labor cost.

[0088] In any of the foregoing implementation manners, the method of the present application can further include a function of checking the legality of the content adjusted this time in the comparison process. The legality of the content adjusted this time in the target data dictionary file is checked to obtain a legality checking result. The legality checking may, for example, be checking the legality of the remaining content in step S504, such as checking the data type, valid value range, data dictionary number, and the like. For example, if the data type of a certain data in the target data dictionary file is char(5) and the valid value range is (1, 123456), the valid value range exceeds the limit of the data type, and thus it is determined to be illegal. Similarly, the data dictionary number can be checked to see whether it meets the naming rule requirement, the data type can be checked to see whether it is an uncommon type, and the like. These contents can be determined according to actual requirements, and the present application does not limit them.

[0089] In this implementation manner, when the content to be adjusted is marked in the data migration rule file, the content of the target data dictionary file adjusted this time and the legality checking result representing the content that fails the checking can also be marked in the data migration rule file.

[0090] In one possible implementation manner, the content of the target data dictionary file adjusted this time and the legality checking result representing the content that fails the checking are directly marked in the data migration rule file, for example, by using any one or more of color, remarks, text format, and the like.

[0091] In another possible implementation manner, the marking is performed in the form of a subtable inserted for summarization. Figure 7 A flowchart of another data processing method provided by the embodiments of the present application is shown in FIG. 8. Figure 7 As shown in FIG. 8, the implementation manner can include the following steps.

[0092] S701, marking the content to be adjusted in the data migration rule file and inserting a new subtable before the first subtable in the data migration rule file.

[0093] For example, for the content added in the target data dictionary, a line is added in the target data structure part of the data migration rule file, and the added line is marked with a corresponding color. The added line can be added before the first line of the target data structure, after the last line, or between any two lines, which is not limited in the present application. For the content deleted in the target data dictionary, the line of the target data structure corresponding to the content in the data migration rule file is marked with a corresponding color. For the modified content in the target data dictionary, the line of the target data structure corresponding to the content in the data migration rule file is marked with a corresponding color, and the content before and after the modification is displayed. The color marking can be marked by any different color, for example, yellow for addition, green for deletion, and blue for modification. The specific color of the marking is not limited in the present application.

[0094] S702, in the new sub-table, the content marked to be adjusted in the data migration rule file, the shortcut link corresponding to the content to be adjusted, and the content in the target data dictionary file this time version adjustment.

[0095] The content to be adjusted in the new sub-table, for example, can include the sub-table identifier of the sub-table to be adjusted, for example, the name of the sub-table, and can also include the identifier of the content to be adjusted in each sub-table to be adjusted, for example, the key value of the content, so as to display all the content to be adjusted in the data migration rule file, and facilitate subsequent adjustment of the migration rule corresponding to the content to be adjusted.

[0096] The shortcut link is used to jump from the new sub-table to the position of the content to be adjusted in the data migration rule file. The shortcut link can be a hyperlink, and the user can directly jump to the position of the content to be adjusted in the data migration rule file by operating the shortcut link, so as to quickly adjust the migration rule corresponding to the content to be adjusted.

[0097] The content in the target data dictionary file this time version adjustment, which is represented by the content of the failed legality verification, can also include a corresponding shortcut link, so that the user can quickly locate the content of the failed legality verification, and then modify the content to meet the legality verification.

[0098] It should be understood that the present application only takes the example of inserting a new sub-table before the first sub-table in the data migration rule file to realize the summary, and the summary method can also be realized by generating a summary document or generating a summary interactive page, which is not described here.

[0099] The method provided by the embodiment of the application enables the user to quickly understand all the to-be-adjusted contents in the data migration rule file according to the summary sub-table, and enables the user to quickly jump to the specific position of the to-be-adjusted content in the data migration rule file through the shortcut link, thereby reducing the amount of data to be viewed by the user, improving the efficiency of the user in determining the to-be-adjusted content, preventing the to-be-adjusted content from being missed by the user, and further improving the efficiency and accuracy of cross-platform migration of the business system.

[0100] After the marked data migration rule file is output in step S106, the method can further perform business system migration according to the marked data migration rule file. Figure 8 A flowchart of another data processing method provided by the embodiment of the application is shown in FIG. 8. As shown in the figure, the method can further include the following steps. Figure 8

[0101] S801, in response to the received adjustment instruction.

[0102] The adjustment instruction is used to instruct adjustment of the to-be-adjusted content in the data migration rule file. The to-be-adjusted content is the content adjusted by the target data dictionary file this time, i.e., the content in the target data dictionary file that is different from the target data structure part in the data migration rule file. The adjustment instruction can be actively requested after the software for implementing the data processing method completes confirmation of the to-be-adjusted content, or can be passively obtained in response to user operation of the interactive page of the data processing method software.

[0103] S802, adjusting the data migration rule file according to the to-be-adjusted content in the data migration rule file.

[0104] The migration rule in the data migration rule file is adjusted according to the to-be-adjusted content in the data migration rule file, so that the migration rule can meet the migration from the original data structure to the target data structure of the new version (i.e., the data structure of the target data dictionary). The adjustment of the data migration rule file can be automatically obtained according to the difference between the original data structure and the target data structure of the new version, or can be performed by receiving manual adjustment of the migration rule in the data migration rule file by the user.

[0105] S803, using the adjusted data migration rule file to migrate data from the original business system to the new business system.

[0106] According to the migration rule of each item of data in the adjusted data migration rule file, the data in the original data dictionary in the original business system is migrated to the new business system.

[0107] ​Figure 9 A structural schematic diagram of a data processing device is provided for an embodiment of the present application. As shown in the figure, the device can include a detection module 11, an acquisition module 12, a processing module 13, a marking module 14, and an output module 15. Figure 9

[0108] The detection module 11 is configured to detect whether the version of a target data dictionary file of a new business system is updated, the target data dictionary file including a target data structure in the new business system.

[0109] The acquisition module 12 is configured to, if it is detected that the version is updated, acquire a target data dictionary file of a new version of the new business system, and a data migration rule file corresponding to a target data dictionary file of a previous version of the new business system. The data migration rule file is used to describe a data migration rule for migrating data from an original business system to the new business system, and the data migration rule file includes the target data structure, an original data structure in the original business system, and a migration rule of the target data structure and the original data structure.

[0110] The processing module 13 is configured to determine, according to the data migration rule file and the target data dictionary file after the version is updated, content of a version adjustment of the target data dictionary file, and determine, according to the adjusted content, content to be adjusted in the data migration rule file.

[0111] The marking module 14 is configured to mark the content to be adjusted in the data migration rule file, wherein different adjustment modes of the content use different marking modes.

[0112] The output module 15 is configured to output the marked data migration rule file.

[0113] In a possible implementation, the processing module 13 is specifically configured to generate at least one first text file according to the dimensions of a data table, using the full content of a target data structure part in the data migration rule file, and generate at least one second text file according to the dimensions of the data table, using the full content of the target data structure in the target data dictionary file after the version is updated. The content of a preset field in each field in the first text file is taken as a key value corresponding to the field, and the content of the preset field in each field in the second text file is taken as a key value corresponding to the field. The first text file and the second text file are compared according to the key values of the fields in the first text file and the key values of the fields in the second text file, to determine the content of the version adjustment of the target data dictionary file. The first text file and the second text file are named according to the names of the data tables, store data in the data tables according to the order of the fields, and separate the data of each field by using a preset character.

[0114] ​In any of the foregoing implementation manners, the marking module 14 is specifically configured to, for the newly added content, add a line in the target data structure part in the data migration rule file and mark with a corresponding color; for the deleted content, mark the line in the target data structure corresponding to the content in the data migration rule file with a corresponding color; and for the modified content, mark the line in the target data structure corresponding to the content in the data migration rule file with a corresponding color and display the content before and after the modification.

[0115] In any of the foregoing implementation manners, when the data migration rule file and the target data dictionary file are both excel format files, the processing module 13 is specifically configured to display the data migration rule file, and in response to an operation of a comparison control by a user, determine the content of the target data dictionary file adjusted this time according to the data migration rule file and the target data dictionary file updated in version.

[0116] Optionally, the processing module 13 is further configured to perform a legality verification on the content of the target data dictionary file adjusted this time, obtain a legality verification result, mark the content to be adjusted in the data migration rule file, and mark the content in the content of the target data dictionary file adjusted this time for which the legality verification result represents a verification failure.

[0117] In this implementation manner, the marking module 14 is specifically configured to mark the content to be adjusted in the data migration rule file and insert a new subtable before the first subtable in the data migration rule file. The new subtable is used to aggregate the content to be adjusted in the data migration rule file, a shortcut link corresponding to the content to be adjusted, and the content in the content of the target data dictionary file adjusted this time for which the legality verification result represents a verification failure. The shortcut link is used to jump from the new subtable to the position of the content to be adjusted in the data migration rule file.

[0118] Optionally, the processing module 13 is further configured to, after the output module 15 outputs the marked data migration rule file, in response to a received adjustment instruction, adjust the data migration rule file according to the content to be adjusted in the data migration rule file. The data is migrated from the original business system to the new business system by using the adjusted data migration rule file.

[0119] The data processing apparatus provided in the embodiment of the application can execute the actions of the data processing software in the method embodiment, and has similar implementation principles and technical effects, which will not be described herein again.

[0120] Figure 10A structural schematic diagram of an electronic device is provided for an embodiment of the present application. The electronic device is used to execute the data processing method described above, and can be a terminal device with data processing function as described above. As shown in Figure 10 The electronic device 1000 can include at least one processor 1001, a memory 1002, and a communication interface 1003.

[0121] The memory 1002 is used to store programs. Specifically, the programs can include program codes including computer operation instructions.

[0122] The memory 1002 can include a high-speed RAM memory, and can also include a non-volatile memory such as at least one disk memory.

[0123] The processor 1001 is used to execute the computer operation instructions stored in the memory 1002 to implement the method described in the foregoing method embodiments. The processor 1001 can be a CPU, or an ASIC, or one or more integrated circuits configured to implement the embodiments of the present application.

[0124] The processor 1001 can communicate with external devices through the communication interface 1003, which can be the electronic device of the user as described above. In a specific implementation, if the communication interface 1003, the memory 1002 and the processor 1001 are independently implemented, the communication interface 1003, the memory 1002 and the processor 1001 can be connected to each other through a bus and complete communication between each other. The bus can be an ISA bus, a PCI bus or an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0125] Optionally, in a specific implementation, if the communication interface 1003, the memory 1002 and the processor 1001 are integrated on a chip, the communication interface 1003, the memory 1002 and the processor 1001 can complete communication through an internal interface.

[0126] The application further provides a computer readable storage medium, which can include a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media capable of storing program codes. Specifically, the computer readable storage medium stores program instructions, and the program instructions are used for the method in the above embodiments.

[0127] The application further provides a program product, which includes execution instructions stored in a readable storage medium. At least one processor of a computing device can read the execution instructions from the readable storage medium, and the at least one processor executes the execution instructions to enable the computing device to implement the above data processing method.

[0128] Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. It is intended that the application encompass any and all variations or modifications of the application that fall within the scope of the general principles thereof. It is intended that the specification and examples be considered as exemplary only, with the true scope and spirit of the application being indicated by the following claims.

[0129] It is to be understood that the application is not limited to the precise construction described above and shown in the attached drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the application. The scope of the application is limited only by the claims that follow.

Claims

1. A data processing method, characterized by, The method comprises: detecting whether a version of a target data dictionary file of a new business system is updated; the target data dictionary file comprises a target data structure in the new business system; if it is detected that the version is updated, obtaining a target data dictionary file of a new version of the new business system, and a data migration rule file corresponding to a target data dictionary file of a previous version of the new business system; the data migration rule file is used to describe a data migration rule of migrating data from an original business system to the new business system, and the data migration rule file comprises: the target data structure, an original data structure in the original business system, and a migration rule of the target data structure and the original data structure; generating at least one first text file according to a dimension of a data table, from full content of a target data structure part in the data migration rule file; generating at least one second text file according to a dimension of a data table, from full content of a target data structure in the target data dictionary file after version update; the first text file and the second text file are named according to a data table name, and data in a data table is stored according to a field order; content of a preset field in each field in the first text file is taken as a key value corresponding to the field; content of a preset field in each field in the second text file is taken as a key value corresponding to the field; comparing the first text file and the second text file according to the key values corresponding to the fields in the first text file and the key values corresponding to the fields in the second text file, to determine content of a version adjustment of the target data dictionary file this time; determining content to be adjusted in the data migration rule file according to the adjusted content; marking the content to be adjusted in the data migration rule file; wherein content of different adjustment modes is marked in different ways; outputting the data migration rule file marked. The data migration rule file and the target data dictionary file are both excel format files; 2. The method of claim 1, wherein, determining the content of the version adjustment of the target data dictionary file this time according to the data migration rule file and the target data dictionary file after version update, comprises: displaying the data migration rule file and a comparison control; in response to a user operation on the comparison control, determining the content of the version adjustment of the target data dictionary file this time according to the data migration rule file and the target data dictionary file after version update. The method further comprises:

3. The method of claim 1, wherein, performing a legality verification on the content of the version adjustment of the target data dictionary file this time, to obtain a legality verification result; the marking of the content to be adjusted in the data migration rule file comprises: marking the content to be adjusted in the data migration rule file and content of the version adjustment of the target data dictionary file this time, which is represented by a content of which the legality verification fails. ​ 4. The method of claim 3, wherein, The content to be adjusted is marked in the data migration rule file, and the content represented by the validity check result of the target data dictionary file this time version adjustment represents the content of the check failure, comprising: Marking the content to be adjusted in the data migration rule file, and inserting a new sub-table before the first sub-table in the data migration rule file; In the new sub-table, the content to be adjusted in the data migration rule file, the shortcut link corresponding to the content to be adjusted, and the content represented by the validity check result of the target data dictionary file this time version adjustment are summarized. Check failure content; wherein the shortcut link is used to jump from the new sub-table to the location of the content to be adjusted in the data migration rule file.

5. The method of claim 1, wherein, The content to be adjusted in the data migration rule file includes: For the newly added content, a row is added in the target data structure part of the data migration rule file, and the corresponding color is marked; For the deleted content, the row of the target data structure corresponding to the content in the data migration rule file is marked with the corresponding color; For the modified content, the row of the target data structure corresponding to the content in the data migration rule file is marked with the corresponding color, and the content before and after modification is displayed.

6. The method of claim 1, wherein, After outputting the marked data migration rule file, the method further comprises: in response to the received adjustment instruction; According to the content to be adjusted in the data migration rule file, the data migration rule file is adjusted; Use the adjusted data migration rule file to migrate data from the original business system to the new business system.

7. A data processing apparatus, characterized by, Comprising: The detection module is used for detecting whether the version of the target data dictionary file of the new business system is updated; the target data dictionary file includes the target data structure in the new business system; If the version is detected to be updated, the target data dictionary file of the new version of the new business system and the data migration rule file corresponding to the target data dictionary file of the last version of the new business system are obtained; The data migration rule file is used for describing the data migration rule of migrating data from the original business system to the new business system, and the data migration rule file includes: target data structure, original data structure in the original business system, and migration rule of the target data structure and the original data structure; The processing module is configured to generate at least one first text file according to the dimensions of the data table based on the full content of the target data structure part in the data migration rule file; generate at least one second text file according to the full content of the target data structure in the target data dictionary file after version update based on the dimensions of the data table; the first text file and the second text file are named according to the data table name, and data in the data table is stored according to the field order; the data between each field is separated by a preset character; the content of a preset field in each field in the first text file is taken as a key value corresponding to the field; the content of a preset field in each field in the second text file is taken as a key value corresponding to the field; the first text file and the second text file are compared according to the key values of the fields in the first text file and the key values of the fields in the second text file, so as to determine the content of the target data dictionary file adjusted this time; and the content to be adjusted in the data migration rule file is determined according to the adjusted content. The marking module is configured to mark the content to be adjusted in the data migration rule file; wherein the content of different adjustment modes is marked by different marking modes. The output module is configured to output the marked data migration rule file.

8. An electronic device, comprising: The processor, the communication interface, and the memory are included. The processor is in communication connection with the communication interface and the memory respectively. The communication interface communicates with external devices. The processor executes the computer execution instruction stored in the memory to realize the method in any one of claims 1 to 6. The computer readable storage medium stores computer execution instructions, and the computer execution instructions are executed by the processor to realize the method in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, ​

Images