Automatic processing method and tool for production management data of nuclear power plant

Abstract

The invention belongs to the technical field of nuclear power plant production management data migration, and particularly relates to a nuclear power plant production management data automatic processing method and tool. Comprising a data model development module, a source data development module, a data verification module, a data migration development module and an unstructured data migration development module. The automatic processing method and tool for the production management data of the nuclear power plant, provided by the invention, have the beneficial effects that the problems that demand management versions are disordered, data quality inspection depends on manpower and the like in the current data migration can be solved; and the working efficiency and quality of data migration in the replacement process of the nuclear power production management platform are improved. According to the method, stable and powerful guarantee is provided for connection operation of historical data between a new system and an old system, and the method plays an important role in construction and protection of data assets.

Description

Technical Field

[0001] The present invention belongs to the technical field of nuclear power plant production management data migration, and in particular relates to a method and tool for automatic processing of nuclear power plant production management data. Background Art

[0002] The existing EAM system of nuclear power plants has been in operation for many years, and a large amount of historical data has been accumulated. These historical data are huge in quantity, generated a long time ago, with inconsistent data structure, irregular data format, inaccurate content in some parts, and involve a wide range of business departments.

[0003] When replacing the original EAM system, you need to consider factors such as business definition, architecture change, application transformation, and data security, and perform operations such as deduplication, formatting, and normalization on old data to ensure data quality and accuracy. Back up metadata before migration to ensure data security; use professional tools and technical means to migrate cleaned historical data to the new platform, and verify the migrated data after the migration is completed. Summary of the invention

[0004] The purpose of the present invention is to provide a method and tool for automated processing of nuclear power plant production management data, which can solve the problem that data demand and data analysis and processing in the process of nuclear power plant production management data migration rely heavily on manual operations, and improve the accuracy, efficiency and standardization of data migration during system switching.

[0005] The technical solution of the present invention is as follows: a nuclear power plant production management data automation processing tool, including a data model development module, a source data development module, a data verification module, a data migration development module and an unstructured data migration development module.

[0006] The data model development module includes a data object, and the data object includes equipment, work applications, work orders, tables of isolated data and connection relationships, field basic information, field rule information and data templates in nuclear power production management. Through the database connector, the database address, port, account number and password are entered to connect to the database, the table of the target database is read, the table relationship and field are automatically identified, and the data model is generated. The data model is the data object, including the main field information of these data objects. After the data model is saved, the data template, data model verification rule library and data model service are automatically generated. The data template is a data form containing the main field information of a data object; the data model verification rules are some rules for fields in this data form / model, and the data model service is an interface service for data update of the data object.

[0007] The source data development module develops source data by connecting the tables and fields corresponding to the source database and importing the data model as a reference. Through visual development tools, it establishes the association between tables, converts, maps, and calculates fields, including field mapping and field conversion, including data screening, data supplementation, and data calculation and conversion. After the source data development is completed, data debugging is performed to form a source data packet.

[0008] During the source data development and data migration development process, the data verification module calls the verification rule library of the data model to perform data verification. Through the data verification module, quality inspection of source data development and data migration is achieved. The verification content includes whether required fields are missing, whether the field type is incorrect, and whether the field value is incorrect.

[0009] The data migration development module implements the data migration development process from the original database to the target database in a graphical way. In the data migration development, the source data packet is converted and mapped by data screening, sorting, connection, union, and expression calculation, and the data is written to the target database through the data model service, the data import results are recorded, and a data import report is generated.

[0010] The unstructured data migration development module first migrates the structured data of the production files that need to be migrated in the source system to the target system; then, based on the file code + version, the file entity is downloaded from the source document system and saved to the object storage server of the target system. For the attachment files associated with the work order business data, the download address of the attachment is obtained from the source system, the attachment files are downloaded and uploaded to the object storage server, and the file ID is recorded in the corresponding work order and other business data association relationships.

[0011] A method for automatically processing production management data of a nuclear power plant comprises the following steps:

[0012] Step 1: Connect to the target database and create a data model based on data migration requirements;

[0013] Step 2: Connect to the source database, import the data model, develop the source data, and form a source data package;

[0014] Step 3: Import the source data package and data model, perform data migration development through the data migration tool, execute data migration tasks, complete data import, and automatically generate a data import report;

[0015] Step 4: Connect to the source document system, use the unstructured data migration tool to migrate and develop unstructured data such as production files and attachments, execute data migration tasks, complete data import, and automatically generate data import reports.

[0016] The working steps of step 1 are as follows:

[0017] Step 11: Sort out the data migration requirements and clarify the scope of data migration;

[0018] Step 12: Connect to the target database, select the database table, and automatically generate the data model;

[0019] Step 13: Edit, debug and save the data model;

[0020] Step 14: Generate data templates, data validation rule base and data services.

[0021] The working steps of step 2 are as follows:

[0022] Step 21: Connect to the source database and select the database table;

[0023] Step 22: Import the data model;

[0024] Step 23: Develop source data, establish table connection relationships, perform field conversion and field mapping, and form a source data package;

[0025] Step 24: Debug the source data packet;

[0026] Step 25: Set data validation rules to verify data quality.

[0027] The working steps of step 3 are as follows:

[0028] Step 31: Create a data migration task;

[0029] Step 32: Import source data package and data model;

[0030] Step 33: Perform source data packet conversion, including data screening, sorting, connection, union, and expression calculation;

[0031] Step 34: Map the fields of the source data package and the data model;

[0032] Step 35: Perform data debugging;

[0033] Step 36: Set up a scheduled data migration task;

[0034] Step 37: Execute the data migration task to complete the data migration;

[0035] Step 38: Generate a data migration report.

[0036] The beneficial effects of the present invention are as follows: the method and tool for automated processing of nuclear power plant production management data proposed by the present invention can solve the problems of chaotic demand management versions and manual reliance on data quality inspection that currently occur in data migration, and improve the work efficiency and quality of data migration during the replacement of the nuclear power production management platform. The present invention provides a stable and powerful guarantee for the connection and operation of historical data between the old and new systems, and plays an important role in the construction and protection of data assets. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 This is a flow chart of a method for automated processing of nuclear power plant production management data provided by the present invention. DETAILED DESCRIPTION

[0038] The present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0039] A nuclear power plant production management data automation processing tool comprises a data model development module, a source data development module, a data verification module, a data migration development module and an unstructured data migration development module.

[0040] The data model development module includes a certain data object, and the data object includes the table of equipment, work application, work order, isolation and other data in nuclear power production management, as well as the connection relationship, field basic information, field rule information and data template. Through the database connector, input the database address, port, account and password to connect to the database, read the table of the target database, automatically identify the table relationship and field, and generate a data model. The data model is the data wide table of the data object, such as equipment, work application, work order, etc., including the main field information of these data objects, and the data model can be edited, debugged and saved. After the data model is saved, the data template, data model verification rule library and data model service can be automatically generated. The data template is a data form containing the main field information of a certain data object; the data model verification rule is some rules for the field in this data form / model, such as self-defined generation, non-empty rules; the data model service is the interface service for data update of the data object. In the data model debugging, data can be imported by data template import and data service call to verify the accuracy of the data model.

[0041] The source data development module develops source data by connecting the tables and fields corresponding to the source database and importing the data model as a reference. Through visual development tools, it establishes the relationship between tables, converts, maps, and calculates fields, including field mapping and field conversion (including data screening, data supplementation, and data calculation and conversion). After the source data development is completed, data debugging can be performed to form a source data package. The source data package includes the data model and data that can be further applied after the source data is developed.

[0042] The data verification module can call the data model's verification rule library to perform data verification during the source data development and data migration development process. Verification rules support flexible configuration and can be deleted or added. The data verification module can be used to implement quality inspection of source data development and data migration. The verification content includes whether the required fields are missing, whether the field type is incorrect, whether the field value is incorrect, etc.

[0043] The data migration development module implements the data migration development process from the original database to the target database in a graphical way. In data migration development, the source data package is converted and mapped through tools such as data filtering, sorting, connection, union, and expression calculation, and the data is written to the target database through the data model service. It supports the execution of data migration tasks through manual and scheduled tasks, records data import results, and generates data import reports. Based on the data size of the source data table, you can choose full and incremental synchronization methods according to the creation time and update time in the source data.

[0044] The unstructured data migration development module first migrates the structured data of the production files that need to be migrated in the source system to the target system; then, based on the file code + version, the file entity is downloaded from the source document system and saved to the object storage server of the target system. For attachment files associated with business data such as work orders, the download address of the attachment is obtained from the source system, the attachment file is downloaded and uploaded to the object storage server, and the file ID is recorded in the corresponding work order and other business data association relationship.

[0045] A method for automatically processing production management data of a nuclear power plant comprises the following steps:

[0046] Step 1: Connect to the target database and create a data model based on data migration requirements.

[0047] The working steps of step 1 are as follows:

[0048] Step 11: Sort out the data migration requirements and clarify the scope of data migration;

[0049] Step 12: Connect to the target database, select the database table, and automatically generate the data model;

[0050] Step 13: Edit, debug and save the data model;

[0051] Step 14: Generate data templates, data validation rule base and data services.

[0052] Step 2: Connect to the source database, import the data model, develop the source data, and form a source data package.

[0053] The working steps of step 2 are as follows:

[0054] Step 21: Connect to the source database and select the database table;

[0055] Step 22: Import the data model;

[0056] Step 23: Develop source data, establish table connection relationships, perform field conversion and field mapping, and form a source data package;

[0057] Step 24: Debug the source data packet;

[0058] Step 25: Set data validation rules to verify data quality.

[0059] Step 3: Import the source data package and data model, perform data migration development through the data migration tool, execute data migration tasks, complete data import, and automatically generate a data import report.

[0060] The working steps of step 3 are as follows:

[0061] Step 31: Create a data migration task;

[0062] Step 32: Import source data package and data model;

[0063] Step 33: Perform source data packet conversion, including data screening, sorting, connection, union, and expression calculation;

[0064] Step 34: Map the fields of the source data package and the data model;

[0065] Step 35: Perform data debugging;

[0066] Step 36: Set up a scheduled data migration task;

[0067] Step 37: Execute the data migration task to complete the data migration;

[0068] Step 38: Generate a data migration report.

[0069] Step 4: Connect to the source document system, use the unstructured data migration tool to migrate and develop unstructured data such as production files and attachments, execute data migration tasks, complete data import, and automatically generate data import reports.

[0070] The working steps of step 4 are as follows:

[0071] Step 41: Migrate production file structured data;

[0072] Step 42: Connect to the source file system, download and migrate the production file entity to the target system object storage server;

[0073] Step 43: Obtain the download address of the attachment from the source system, download the attachment file and upload it to the object storage server, and record the file ID in the corresponding work order and other business data association relationships.

Claims

1. A tool for automated processing of production management data of a nuclear power plant, characterized in that: It includes data model development module, source data development module, data verification module, data migration development module and unstructured data migration development module.

2. A nuclear power plant production management data automation processing tool as claimed in claim 1, characterized in that: The data model development module includes a data object, and the data object includes equipment, work applications, work orders, tables of isolated data and connection relationships, field basic information, field rule information and data templates in nuclear power production management. Through the database connector, the database address, port, account number and password are entered to connect to the database, the table of the target database is read, the table relationship and field are automatically identified, and the data model is generated. The data model is the data object, including the main field information of these data objects. After the data model is saved, the data template, data model verification rule library and data model service are automatically generated. The data template is a data form containing the main field information of a data object; the data model verification rules are some rules for fields in this data form / model, and the data model service is an interface service for data update of the data object.

3. A nuclear power plant production management data automation processing tool as claimed in claim 1, characterized in that: The source data development module develops source data by connecting the tables and fields corresponding to the source database and importing the data model as a reference. Through visual development tools, it establishes the association between tables, converts, maps, and calculates fields, including field mapping and field conversion, including data screening, data supplementation, and data calculation and conversion. After the source data development is completed, data debugging is performed to form a source data packet.

4. A nuclear power plant production management data automation processing tool as claimed in claim 1, characterized in that: During the source data development and data migration development process, the data verification module calls the verification rule library of the data model to perform data verification. Through the data verification module, quality inspection of source data development and data migration is achieved. The verification content includes whether required fields are missing, whether the field type is incorrect, and whether the field value is incorrect.

5. The tool for automated processing of production management data of a nuclear power plant according to claim 1, characterized in that: The data migration development module implements the data migration development process from the original database to the target database in a graphical way. In the data migration development, the source data packet is converted and mapped by data screening, sorting, connection, union, and expression calculation, and the data is written to the target database through the data model service, the data import results are recorded, and a data import report is generated.

6. A nuclear power plant production management data automation processing tool as claimed in claim 1, characterized in that: The unstructured data migration development module first migrates the structured data of the production files that need to be migrated in the source system to the target system; then, based on the file code + version, the file entity is downloaded from the source document system and saved to the object storage server of the target system. For the attachment files associated with the work order business data, the download address of the attachment is obtained from the source system, the attachment files are downloaded and uploaded to the object storage server, and the file ID is recorded in the corresponding work order and other business data association relationships.

7. A method for automatically processing production management data of a nuclear power plant, characterized in that: The following steps are involved: Step 1: Connect to the target database and create a data model based on data migration requirements; Step 2: Connect to the source database, import the data model, develop the source data, and form a source data package; Step 3: Import the source data package and data model, perform data migration development through the data migration tool, execute data migration tasks, complete data import, and automatically generate a data import report; Step 4: Connect to the source document system, use the unstructured data migration tool to migrate and develop unstructured data such as production files and attachments, execute data migration tasks, complete data import, and automatically generate data import reports.

8. A method for automatically processing production management data of a nuclear power plant according to claim 7, characterized in that: The working steps of step 1 are as follows: Step 11: Sort out the data migration requirements and clarify the scope of data migration; Step 12: Connect to the target database, select the database table, and automatically generate the data model; Step 13: Edit, debug and save the data model; Step 14: Generate data templates, data validation rule base and data services.

9. A method for automatically processing production management data of a nuclear power plant according to claim 7, characterized in that: The working steps of step 2 are as follows: Step 21: Connect to the source database and select the database table; Step 22: Import the data model; Step 23: Develop source data, establish table connection relationships, perform field conversion and field mapping, and form a source data package; Step 24: Debug the source data packet; Step 25: Set data validation rules to verify data quality.

10. A method for automatically processing production management data of a nuclear power plant according to claim 7, characterized in that: The working steps of step 3 are as follows: Step 31: Create a data migration task; Step 32: Import source data package and data model; Step 33: Perform source data packet conversion, including data screening, sorting, connection, union, and expression calculation; Step 34: Map the fields of the source data package and the data model; Step 35: Perform data debugging; Step 36: Set up a scheduled data migration task; Step 37: Execute the data migration task to complete the data migration; Step 38: Generate a data migration report.

Images