Data migration method and device, nonvolatile storage medium and computer equipment

By generating data migration indexes and utilizing tree structures, the problem of low data integrity during data migration in large factories is solved, efficient and accurate data migration is achieved, and data consistency and integrity are ensured.

CN119166616APending Publication Date: 2024-12-20QINGHAI SALT LAKE IND
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202411229935.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2024-12-20

AI Technical Summary

Technical Problem

The existing technology has low data integrity after migration when data is migrated in large factories and lacks effective solutions.

Method used

By obtaining the data of multiple objects in the original database, determining the association relationship between objects, generating a data migration index, and migrating the data to the target database based on the index, using a tree structure to ensure the integrity and consistency of the data.

Benefits of technology

Improve the accuracy and completeness of data migration in large factories, avoid data loss and errors, ensure the data consistency between the target database and the original database, and improve the migration efficiency and quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119166616A_ABST
    Figure CN119166616A_ABST
Patent Text Reader

Abstract

The invention discloses a data migration method and device, a nonvolatile storage medium and computer equipment. The method comprises the following steps: acquiring respective data of a plurality of objects in a factory included in an original database; determining an association relationship among respective data of the plurality of objects; generating a data migration index according to the association relationship; and migrating respective data of the plurality of objects to the target database based on the data migration index. According to the data migration method and device, the technical problem that the completeness of migrated data is relatively low when the data of a large factory is migrated in related technologies is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of data processing, and in particular to a data migration method, device, non-volatile storage medium and computer equipment. Background Art

[0002] Many companies use digital delivery platforms as the data foundation for digitalization, informatization, and intelligence in the process of building new factories. However, with the construction of multiple projects and brands on digital delivery platforms, the data reuse effect between platforms is extremely poor. For different delivery platforms, once business goals such as data sharing, integration, and migration are to be achieved, it usually involves repeated data entry and multiple entry, and the amount of data involved is huge.

[0003] In the related art, data migration is generally achieved by converting the content of the current database into XML format and then importing the XML format file into the target database. However, for the migration of large-scale factory data, the data of large-scale factories is relatively complex, and the integrity of data migration achieved in this way is low.

[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0005] Embodiments of the present invention provide a data migration method, apparatus, non-volatile storage medium and computer equipment to at least solve the technical problem of low integrity of migrated data when migrating data of a large factory in the related art.

[0006] According to one aspect of an embodiment of the present invention, a data migration method is provided, including: obtaining data of respective objects in a factory included in an original database; determining association relationships between the data of respective objects; generating a data migration index based on the association relationships; and migrating the data of respective objects to a target database based on the data migration index.

[0007] Optionally, a data migration index is generated based on the association relationship, including: generating nodes corresponding to multiple objects respectively to obtain multiple nodes; connecting the multiple nodes based on the association relationship to form a tree structure including multiple nodes; and using the tree structure as the data migration index.

[0008] Optionally, based on the data migration index, migrating the data of the multiple objects to the target database includes: migrating the tree structure to the target database; and migrating the data of the multiple objects to the target database according to the multiple nodes in the tree structure.

[0009] Optionally, according to multiple nodes in the tree structure, the data of each of the multiple objects are migrated to the target database, including: determining the objects corresponding to the multiple nodes respectively; determining the data of the objects corresponding to the multiple nodes respectively in the original database, wherein the data of the objects corresponding to the multiple nodes respectively include at least: basic data, three-dimensional model data, and two-dimensional drawing data; and migrating the data of the objects corresponding to the multiple nodes respectively to the target database.

[0010] Optionally, the data of each of the multiple objects in the factory included in the original database is obtained, including: encoding the physical objects in the factory; splitting the spatial areas in the factory and encoding the split spatial areas; determining multiple objects based on the encoded physical objects and the encoded split spatial areas; and determining the data of each of the multiple objects in the original database.

[0011] Optionally, the method further includes: verifying the data migrated to the target database based on multiple objects to obtain a verification result; and determining that the data migration is completed when the verification result indicates that the verification has passed.

[0012] According to another aspect of an embodiment of the present invention, a data migration device is also provided, including: an acquisition module for acquiring data of respective objects in a factory included in an original database; a determination module for determining the association relationship between the data of respective objects; a generation module for generating a data migration index according to the association relationship; and a migration module for migrating the data of respective objects to a target database based on the data migration index.

[0013] According to another aspect of an embodiment of the present invention, a non-volatile storage medium is provided. The non-volatile storage medium includes a stored program, wherein when the program is running, the device where the non-volatile storage medium is located is controlled to execute any one of the above data migration methods.

[0014] According to yet another aspect of an embodiment of the present invention, a computer device is provided. The computer device includes a processor, and the processor is used to run a program. When the program is run, any one of the above-mentioned data migration methods is executed.

[0015] According to yet another aspect of an embodiment of the present invention, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, any one of the above-mentioned data migration methods is implemented.

[0016] In an embodiment of the present invention, a method of constructing a data migration index is adopted, by obtaining the data of each of the multiple objects in the factory included in the original database; determining the association relationship between the data of each of the multiple objects; generating a data migration index according to the association relationship; and migrating the data of each of the multiple objects to the target database based on the data migration index, thereby achieving the purpose of migrating a large amount of data according to the data migration index, thereby realizing the technical effect of improving the integrity of the migrated data, and further solving the technical problem of low integrity of the migrated data when migrating the data of a large factory in the related technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0018] Figure 1 A hardware structure block diagram of a computer terminal for implementing a data migration method is shown;

[0019] Figure 2 is a flow chart of a data migration method provided according to an embodiment of the present invention;

[0020] Figure 3 is a schematic diagram of a technical route for data migration provided according to an optional embodiment of the present invention;

[0021] Figure 4 is a schematic diagram of a data hierarchical structure provided according to an optional embodiment of the present invention;

[0022] Figure 5 is a schematic diagram of data classification provided according to an optional embodiment of the present invention;

[0023] Figure 6 is a schematic diagram of a data reconstruction structure provided according to an optional embodiment of the present invention;

[0024] Figure 7 is a schematic diagram of a quality control process of data migration provided according to an optional embodiment of the present invention;

[0025] Figure 8 is a structural block diagram of a data migration device provided according to an optional embodiment of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] According to an embodiment of the present invention, a method embodiment of data migration is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0029] The method embodiment provided in the first embodiment of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Figure 1 FIG. 1 shows a hardware structure block diagram of a computer terminal for implementing a data migration method. Figure 1 As shown, the computer terminal 10 may include one or more (102a, 102b, ..., 102n are used to illustrate) processors (the processor may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the BUS bus), a network interface, a power supply and / or a camera. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 1 More or fewer components as shown, or with Figure 1Different configurations are shown.

[0030] It should be noted that the one or more processors and / or other data processing circuits described above may generally be referred to herein as "data processing circuits". The data processing circuits may be embodied in whole or in part as software, hardware, firmware, or any other combination thereof. In addition, the data processing circuit may be a single independent processing module, or may be incorporated in whole or in part into any of the other components in the computer terminal 10. As described in the embodiments of the present application, the data processing circuit acts as a processor control (e.g., selection of a variable resistor terminal path connected to an interface).

[0031] The memory 104 can be used to store software programs and modules of application software, such as program instructions / data storage devices corresponding to the data migration method in the embodiment of the present invention. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, the data migration method of the above-mentioned application program is realized. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the computer terminal 10 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0032] The display may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the computer terminal 10 .

[0033] In the traditional data migration method, the method of converting data into XML format and then importing it into the target database has certain limitations when processing data from large factories. The data involved in large factories usually includes 3D models, basic information of factories and equipment, 2D drawings and other data. Among them, the 3D model includes the 3D model of the factory, the 3D model of the equipment inside the factory, the 3D model of the environment in which the factory is located and other models. If the factory has been put into production, the data that needs to be migrated may also include the factory's production data. It can be seen that because the data volume of large factories is huge and the associations are complex, if all data files are converted into an unchangeable XML format for data migration, it may result in the omission of data that needs to be migrated, and the migration efficiency is also low.

[0034] In order to solve the above problems, an embodiment of the present invention provides a data migration method. Figure 2 is a flow chart of a data migration method according to an embodiment of the present invention. Figure 2 As shown, the method comprises the following steps:

[0035] Step S202, obtaining the data of each of the multiple objects in the factory included in the original database.

[0036] In this step, when performing data migration, all data related to the factory stored in the original database will be migrated to the target database. The factory can be decomposed according to the decomposition rules, and things related to the factory can be decomposed into multiple objects. Objects refer to the smallest unit when dividing data structures. For example, the equipment inside and outside the factory can be divided into different devices according to function or location, and then the devices can be divided into units. Units can also be divided into sub-units according to needs, and finally divided into objects that cannot be further subdivided. When migrating data, objects can be used as the smallest data migration unit for migration.

[0037] Step S204: determining the association relationship between the data of the multiple objects.

[0038] In this step, the association relationship between data refers to the connection, dependence or degree of association between data. When determining the association relationship between the data of multiple objects, the association relationship between the data of the two objects can be determined based on the association relationship between the actual objects represented by the two objects. For example, if the entities represented by the two objects are adjacent, and the entities represented by the two objects are at the same level in the structural division, are units, and belong to the same device, then the association relationship between the data of the two objects can be represented by the association relationship between the two entities.

[0039] Step S206: Generate a data migration index according to the association relationship.

[0040] In this step, after determining the association relationship, a structure including the data of multiple objects can be constructed according to the association relationship, that is, the data migration index. The data migration index is a mapping relationship established according to the association relationship between the data within the factory, which can help determine the order and method of data migration more accurately.

[0041] Step S208: Migrate the data of each of the multiple objects to the target database based on the data migration index.

[0042] In this step, through the data migration index, data can be migrated according to certain rules and logical order to ensure that the association and integrity of the data in the target database are not affected.

[0043] Through the above steps, the purpose of migrating a large amount of data according to the data migration index can be achieved, thereby achieving the technical effect of improving the integrity of the migrated data, and then solving the technical problem of low integrity of the migrated data when migrating the data of large factories in the related technology. This method based on data migration index can effectively improve the accuracy and integrity of large factory data migration, avoid data loss and errors, and ensure the consistency of data in the target database and the original database. At the same time, this method can also improve the efficiency of data migration, reduce unnecessary duplication of work, and improve the overall quality and reliability of data migration. Therefore, for the migration process of large factory data, establishing a data migration index is a very effective solution.

[0044] As an optional embodiment, a data migration index is generated according to an association relationship, including: generating nodes corresponding to multiple objects respectively to obtain multiple nodes; connecting the multiple nodes according to the association relationship to form a tree structure including multiple nodes; and using the tree structure as a data migration index.

[0045] Optionally, in the process of data migration, generating a data migration index is a very important step. According to the data migration index, the data to be migrated can be found more quickly, and the integrity and consistency of the data can be ensured. First, the corresponding nodes can be generated according to the data objects to be migrated. For example, multiple nodes can be generated to represent multiple devices in the factory. Next, these nodes can be connected according to the association relationship between the various data objects. For example, there may be a sequence of operations between multiple devices, and there is also an affiliation relationship between devices, etc., and multiple nodes can be connected according to these relationships. The connected nodes can be organized into a tree structure, and the association relationship between each data object can be represented by the relationship between the parent and child nodes, so that a tree structure including multiple nodes can be formed. Finally, the generated tree structure can be used as a data migration index, and the data to be migrated can be found through this index, and the data migration operation can be performed according to the relationship of the tree structure.

[0046] The data migration index generated through the above steps can provide a clearer understanding of the relationship between various data objects, help to perform data migration operations more efficiently, and ensure data integrity and consistency.

[0047] As an optional embodiment, based on the data migration index, migrating the data of multiple objects to the target database includes: migrating the tree structure to the target database; and migrating the data of multiple objects to the target database according to multiple nodes in the tree structure.

[0048] Optionally, a data migration index is a tool for migrating data from one database to another. The data migration index of the tree structure can be used to migrate the data of multiple objects to the target database. First, the data migration index can be used to migrate each node and its related data one by one. The migration can be carried out step by step from the root node according to the hierarchical relationship of the tree structure, ensuring that the data of all nodes and their child nodes are correctly migrated. The entire tree structure can also be migrated as a whole. In this case, the entire tree structure can be migrated as an object. This can maintain the integrity of the tree structure and ensure that the relationship between all nodes is correctly preserved in the target database.

[0049] In summary, based on the data migration index, the data of multiple objects can be migrated to the target database, including migrating the tree structure to the target database, and the data can be migrated to the target database one by one or as a whole according to multiple nodes in the tree structure. This embodiment can ensure that the integrity and correctness of the data are guaranteed.

[0050] As an optional embodiment, according to multiple nodes in a tree structure, the data of multiple objects are migrated to a target database, including: determining the objects corresponding to the multiple nodes respectively; determining the data of the objects corresponding to the multiple nodes respectively in the original database, wherein the data of the objects corresponding to the multiple nodes respectively include at least: basic data, three-dimensional model data, and two-dimensional drawing data; and migrating the data of the objects corresponding to the multiple nodes respectively to the target database.

[0051] Optionally, after the data migration index is successfully migrated to the target database, the data corresponding to each of the multiple nodes can also be migrated to the target database. First, it is necessary to determine the objects corresponding to the multiple nodes in the tree structure. These objects can be different parts or different functional modules in the factory, and each node represents an independent object. Then, in the original database, the data of the objects corresponding to the multiple nodes are determined. These data include basic data, such as the name and size of the object; they also include three-dimensional model data, which can specifically include the three-dimensional shape, material, color and other information of the object; they also include two-dimensional drawing data, including the plan view, section view, elevation view, etc. of the object. Finally, the data of the objects corresponding to the multiple nodes can be migrated to the target database. This process includes extracting the data from the original database, converting it into the format required by the target database, and importing the data into the target database. In the process of data migration, it is necessary to ensure the integrity and consistency of the data to ensure that the data in the target database is consistent with the data in the original database.

[0052] As an optional embodiment, the data of each of the multiple objects in the factory included in the original database is obtained, including: encoding the physical objects in the factory; splitting the spatial areas in the factory and encoding the split spatial areas; determining multiple objects based on the encoded physical objects and the encoded split spatial areas; and determining the data of each of the multiple objects in the original database.

[0053] Optionally, as an optional embodiment, to obtain the data of each of the multiple objects in the factory included in the original database, first, each physical object in the factory can be encoded so that each object can be uniquely identified. This can be achieved by assigning a unique identifier to each object. Secondly, the spatial area in the factory can be divided, and each divided spatial area can be encoded so that the location and range of each area can be accurately described. Then, both the physical object and the spatial area can be used as an object, multiple objects can be determined, and the respective encodings of the multiple objects can be determined. Finally, based on the determined multiple objects, the data of each object is extracted from the original database, including information such as attributes, status, historical records, etc., for subsequent analysis and processing. Through the above steps, detailed data acquisition and processing can be performed on multiple objects in the factory, providing strong support for factory management and optimization.

[0054] As an optional embodiment, the method further includes: based on multiple objects, verifying the data migrated to the target database to obtain a verification result; when the verification result indicates that the verification has passed, determining that the data migration is completed.

[0055] Optionally, in addition to migrating data from the source database to the target database, a series of verification steps can be performed to ensure the integrity and accuracy of the data. First, the data migrated to the target database can be verified based on multiple objects. That is, not only a single table or data set will be verified, but the relevance between multiple related objects (which may include tables, views, stored procedures, etc.) will be comprehensively considered. In this way, the integrity of the data can be checked more comprehensively, and no key data will be missed during the migration process. If the verification is passed, it means that no problems were found during the data migration process, and the integrity and accuracy of the data are guaranteed. If the verification is not passed, it means that there are some data inconsistencies or errors in the migration process, which need further processing and repair. When the verification result indicates that the verification is passed, it is determined that the data migration is completed, and the data in the target database can be used normally. Through this optional embodiment, it can be ensured that during the data migration process, the integrity and accuracy of the data are effectively guaranteed, and subsequent problems caused by inconsistent or wrong data can be avoided.

[0056] As a specific embodiment, the embodiment of the present invention provides a method for automated standardized data migration between different digital delivery platforms, from executing the handover basis, determining the handover implementation plan, integrating the handover data, verifying the handover quality to the whole process of handover results acceptance. The handover method exports the full data structure and data content from the source digital delivery platform according to the actual construction progress of the project, and can be fully imported into any destination delivery platform under the unified standard. Figure 3 is a schematic diagram of a technical route for data migration provided according to an optional embodiment of the present invention. The technical route is as follows Figure 3 shown.

[0057] First, it involves the standardization of common data structures. Digital delivery construction must be "standardized first". In order to better inherit and apply the data generated during the construction process during the operation and maintenance period of the project, it is necessary to make regulations on the content and form of the data before the construction of the project to reduce data loss and interception. Specifically, it can include the following three contents.

[0058] First, it involves the common data hierarchy structure of standardized deliverables. This method adopts the object data decomposition structure of "factory-device-unit-subunit". Figure 4 is a schematic diagram of a data hierarchical structure provided according to an optional embodiment of the present invention, such as Figure 4 As shown, the drawings, models, documents, etc. in the engineering construction phase are reconstructed and integrated according to different levels to form a common data structure with clear hierarchy, clear logic and reliable data, laying a unified hierarchical standard data source for data sharing and data migration of the digital delivery platform.

[0059] Secondly, it involves the general classification structure and format of standardized deliverables. Digital deliverables adopt the decomposition method of "spatial stratification-management object classification", that is, grid-dividing and coding common areas such as "factory area" and "workshop" spatial areas, classifying and coding physical data such as equipment, pipelines, valves, and building components, screening management objects such as pipelines, equipment, and valves from physical data, and classifying and managing management objects. According to the factory attribute structure and standard information library, the management objects are further accurately decomposed according to the three dimensions of data, model, and association relationship. Figure 5 is a schematic diagram of data classification provided according to an optional embodiment of the present invention, such as Figure 5 shown.

[0060] The data content covers the structured data and files of the whole process of design, procurement, construction and commissioning, including but not limited to the delivery technology route and architecture, factory decomposition structure, engineering object classification principles, PID drawing regulations, 3D modeling scope and depth, software and version, basic requirements for software application, delivery list and quality assurance measures.

[0061] The model part emphasizes the depth of the completed digital model that is consistent with the physical factory, including the factory model completed using 3D modeling design software, covering general layout, piping, automatic control, telecommunications, electrical, equipment, water supply and drainage, fire protection, structure, HVAC and other disciplines. The modeling depth should meet the requirements of relevant specifications.

[0062] The associative relationship ensures the association between the 3D model and the drawing, as well as the logical association between files, data and models. It supports multiple query conditions, intelligent sorting and filtering functions, and multiple view display modes, providing convenience for information retrieval and browsing.

[0063] Secondly, it involves standardized delivery coding rules. Standardized delivery coding rules unify the properties of materials, equipment and other materials used in engineering design, determine their properties and coding rules, and customize them in the coding platform. The principle of material coding in the platform is one item one code, that is, one type of material has its unique material code. Material properties are customized in the coding platform, and the coding platform provides unique codes to various design platforms and software.

[0064] In this way, the data in the original database can be analyzed and organized to obtain a standardized data structure for data migration.

[0065] Secondly, the source digital delivery platform data can be parsed. According to the hierarchical structure and data classification structure of the original digital delivery platform, a delivery tree structure can be formed. The name, number, and association relationship of each type of deliverable can be obtained level by level through standard coding, and a mapping table of deliverable type and association relationship data structure can be established as one of the basis for quality verification after data migration. At the same time, it is converted into a standardized universal data hierarchy structure for deliverables.

[0066] Secondly, the entire data of the original digital delivery platform can be reconstructed. According to the relational database, unstructured document storage path database, and semi-structured data association database corresponding to the data accessed by the administrator of the original digital delivery platform, and based on the progress of the project, the project information and related geographic information of each stage such as planning, design, construction, and completion delivery can be reconstructed, including planning results, design drawings, technical specifications, procurement contracts and related documents, construction drawings, geospatial data, three-dimensional models, etc., to form phased digital results. Finally, a data structure mapping table is formed as one of the basis for quality verification after data migration. Figure 6 is a schematic diagram of a data reconstruction structure provided according to an optional embodiment of the present invention, such as Figure 6 As shown. At the same time, the read data is converted into a standardized common data structure.

[0067] Secondly, an index file can be formed based on the reconstructed data. Based on the source digital delivery platform, the target digital delivery platform reconstructs the mapping table based on the whole process data, defines and adjusts the basic information, associates CAD drawings or text and other electronic documents based on the refinement of the 3D model, structures the spatial information and geometric information of the 3D model through XML files, checks the consistency of data from different sources, and automatically associates the data with the 3D model after confirmation, supports fast query and positioning, associates the 3D model, retrieves the attribute information and documents corresponding to the model, and finally forms the necessary index files for data migration.

[0068] Secondly, data migration can be performed. The index data can be verified, summarized, extracted, associated and integrated to remove incorrect and inaccurate data, eliminate data redundancy, ensure the accuracy and completeness of the data and make it conform to standardization specifications. At the same time, from the perspective of data utilization, the common data with high frequency of use and independent entity data are extracted, and the database is further reversely established according to the data type hierarchical-classification model. The steps of data migration are as follows: migrate to the target address one by one according to the index file; the migrated target data is standardized and automatically establishes the data structure according to the file index on the target digital delivery platform; the target digital delivery platform imports data according to the new data structure to form the final platform.

[0069] Finally, the target delivery platform data quality verification can be performed. In this method, according to the audit requirements of the integrity, accuracy, consistency, and relevance of the transferred data, documents, and three-dimensional models, during the transfer process, the platform can verify the compliance, integrity, and consistency of the transferred data according to the set quality audit regulations, and explain the missing data, and it is recommended to improve the data quality manually. Figure 7 Schematic diagram of a quality control process of data migration according to an optional embodiment of the present invention. Figure 7 shown.

[0070] The formed data mapping table is used to check and accept the delivery basis and deliverables from the following aspects: whether the factory objects are missing and the classification is correct; whether the factory object numbering meets the requirements; whether the factory object attributes are complete and whether the necessary information is missing; whether the attribute measurement unit is correct and the data type of the attribute value is correct; whether there are any missing documents; whether the document naming and numbering meet the requirements; whether the association between the factory objects and the factory decomposition structure, and between the factory objects and the documents is correct; and whether the data, documents and 3D models meet the deliverable requirements.

[0071] Taking the digital delivery of a new factory of a salt chemical enterprise as an example, we can first formulate a general data structure standard, and then formulate a digital delivery strategy and a unified data structure standard based on the enterprise's digital delivery specifications and global data dictionary, combined with the specific characteristics of the project, and coordinate the planning of digital delivery work. The factory object is the core. Through the hierarchical structure of "factory-device-unit-sub-unit", the delivery data structure is standardized according to the information classification method of engineering data, engineering documents and three-dimensional models and their associations. The association between object numbers and two- and three-dimensional drawings, documents, materials and other data is established, breaking the isolation of information and the difficulty of cross-query, ensuring that data remains consistent, accurate and complete between different delivery platforms, and reducing data redundancy and rework.

[0072] Secondly, the data of the source digital delivery platform can be analyzed, and the delivery content of different stages can be decomposed according to the situation of the project and the characteristics of different types of factories, as shown in the following table.

[0073]

[0074] Secondly, the entire data of the original digital delivery platform can be reconstructed. The reconstructed digital factory class library contains factory object classes, attributes, measurement classes, document classes and other information and their associated relationships, including: Reconstruction of factory object data: sort out all types of factory equipment, and accurately describe, define and classify them, and establish a data model of factory objects with tag numbers (TAG) as the only keyword. Factory objects are the most basic units of data center management; Reconstruction of object relationship data: The engineering data center stores the relationship between each object, such as upstream and downstream relationships, inclusion relationships, etc.; There is also a relationship between objects and files. Using this relationship, you can quickly locate related drawings; The relationship between objects and models, use object tags (TAG) to quickly locate in three dimensions; Reconstruction of object attributes: sort out existing equipment attributes, define attribute codes, attribute descriptions, and units corresponding to attributes, to ensure that attributes at different stages are single and consistent, and the definition is consistent.

[0075] Secondly, the data of the source delivery platform can be migrated to the target delivery platform. The migration method can be full extraction. During the migration of structured data, the target data mapping method can be used to control and schedule based on the extraction function to completely migrate the structured data. During the migration of unstructured data, the target data marking method can be used to control and schedule based on the extraction function to completely migrate the unstructured data. According to the pre-set rules (timeliness, accuracy, completeness, standardization, uniqueness), the collected data is filtered and cleaned, and the data that meets the rules flows into the management business library for standby. The data that does not meet the rules can be manually reviewed through the control panel or directly marked as junk data. The migration content supports the migration of local file sources, database sources, third-party cloud platforms, big data sources, and other types to big data systems.

[0076] Finally, verify the data of the target delivery platform. The data verification of the target delivery platform is based on the unified standards of digital delivery. According to the data migration mapping table, the meeting minutes, correspondence, signed documents, quality inspection reports and other documents generated during the project delivery process are used as verification objects. The digital delivery content of the design stage, construction stage, and procurement stage is checked for omissions in accordance with the digital delivery document list of each stage through data verification, on-site comparison, functional verification, etc. The missing documents are supplemented and improved after confirmation and discussion with all parties, and finally meet the acceptance standards. At this point, the data migration process can be completed.

[0077] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0078] Through the description of the above implementation methods, those skilled in the art can clearly understand that the data migration method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0079] According to an embodiment of the present invention, a data migration device for implementing the above data migration method is also provided. Figure 8 is a structural block diagram of a data migration device provided according to an embodiment of the present invention, such as Figure 8 As shown, the data migration device includes: an acquisition module 81, a determination module 82, a generation module 83 and a migration module 84. The data migration device is described below.

[0080] The acquisition module 81 is used to acquire the data of each of the multiple objects in the factory included in the original database.

[0081] The determination module 82 is connected to the acquisition module 81 and is used to determine the association relationship between the data of multiple objects.

[0082] The generating module 83 is connected to the determining module 82 and is used to generate a data migration index according to the association relationship.

[0083] The migration module 84 is connected to the generation module 83 and is used to migrate the data of each of the multiple objects to the target database based on the data migration index.

[0084] It should be noted that the acquisition module 81, the determination module 82, the generation module 83 and the migration module 84 correspond to steps S202 to S208 in the embodiment, and the examples and application scenarios implemented by the multiple modules and the corresponding steps are the same, but are not limited to the contents disclosed in the above embodiment. It should be noted that the above modules, as part of the device, can be run in the computer terminal 10 provided in the embodiment.

[0085] An embodiment of the present invention may provide a computer device. Optionally, in this embodiment, the computer device may be located in at least one network device among multiple network devices of a computer network. The computer device includes a memory and a processor.

[0086] Among them, the memory can be used to store software programs and modules, such as the program instructions / modules corresponding to the data migration method and device in the embodiment of the present invention. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, realizing the above-mentioned data migration method. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0087] The processor can call the information and application programs stored in the memory through the transmission device to execute the following steps: obtain the data of each of the multiple objects in the factory included in the original database; determine the association relationship between the data of each of the multiple objects; generate a data migration index based on the association relationship; and migrate the data of each of the multiple objects to the target database based on the data migration index.

[0088] Optionally, the processor may also execute program code of the following steps: generating a data migration index based on an association relationship, including: generating nodes corresponding to multiple objects respectively to obtain multiple nodes; connecting multiple nodes based on the association relationship to form a tree structure including multiple nodes; and using the tree structure as a data migration index.

[0089] Optionally, the processor may also execute program code of the following steps: based on the data migration index, migrating the data of multiple objects to the target database, including: migrating the tree structure to the target database; migrating the data of multiple objects to the target database according to multiple nodes in the tree structure.

[0090] Optionally, the processor may also execute program code of the following steps: according to the multiple nodes in the tree structure, migrating the data of the multiple objects to the target database, including: determining the objects corresponding to the multiple nodes respectively; determining the data of the objects corresponding to the multiple nodes respectively in the original database, wherein the data of the objects corresponding to the multiple nodes respectively include at least: basic data, three-dimensional model data, and two-dimensional drawing data; migrating the data of the objects corresponding to the multiple nodes respectively to the target database.

[0091] Optionally, the processor may also execute program code for the following steps: obtaining data of respective multiple objects in a factory included in the original database, including: encoding physical objects in the factory; splitting spatial areas in the factory and encoding the split spatial areas; determining multiple objects based on the encoded physical objects and the encoded split spatial areas; and determining data of respective multiple objects in the original database.

[0092] Optionally, the processor may also execute program code of the following steps: the method further includes: based on multiple objects, verifying the data migrated to the target database to obtain a verification result; when the verification result indicates that the verification has passed, determining that the data migration is completed.

[0093] The embodiment of the present invention provides a data migration solution. By constructing a data migration index, the data of multiple objects in the factory included in the original database is obtained; the association relationship between the data of the multiple objects is determined; the data migration index is generated according to the association relationship; based on the data migration index, the data of the multiple objects are migrated to the target database, so as to achieve the purpose of migrating a large amount of data according to the data migration index, thereby achieving the technical effect of improving the integrity of the migrated data, and further solving the technical problem of low integrity of the migrated data when migrating the data of a large factory in the related technology.

[0094] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing the hardware related to the terminal device through a program, and the program can be stored in a non-volatile storage medium, and the storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0095] The embodiment of the present invention further provides a non-volatile storage medium. Optionally, in this embodiment, the non-volatile storage medium can be used to store the program code executed by the data migration method provided in the above embodiment.

[0096] Optionally, in this embodiment, the non-volatile storage medium may be located in any computer terminal in a computer terminal group in a computer network, or in any mobile terminal in a mobile terminal group.

[0097] Optionally, in this embodiment, the non-volatile storage medium is configured to store program code for executing the following steps: obtaining data of respective objects within a factory included in the original database; determining association relationships between the data of respective objects; generating a data migration index based on the association relationships; and migrating the data of respective objects to the target database based on the data migration index.

[0098] Optionally, in this embodiment, the non-volatile storage medium is configured to store program code for executing the following steps: generating a data migration index based on an association relationship, including: generating nodes corresponding to multiple objects respectively to obtain multiple nodes; connecting the multiple nodes according to the association relationship to form a tree structure including multiple nodes; and using the tree structure as a data migration index.

[0099] Optionally, in this embodiment, the non-volatile storage medium is configured to store program code for performing the following steps: based on the data migration index, migrating the data of multiple objects to the target database, including: migrating the tree structure to the target database; migrating the data of multiple objects to the target database according to multiple nodes in the tree structure.

[0100] Optionally, in this embodiment, the non-volatile storage medium is configured to store program code for executing the following steps: according to multiple nodes in the tree structure, migrating the data of multiple objects to the target database, including: determining the objects corresponding to the multiple nodes respectively; in the original database, determining the data of the objects corresponding to the multiple nodes respectively, wherein the data of the objects corresponding to the multiple nodes respectively include at least: basic data, three-dimensional model data, two-dimensional drawing data; migrating the data of the objects corresponding to the multiple nodes respectively to the target database.

[0101] Optionally, in this embodiment, the non-volatile storage medium is configured to store program code for executing the following steps: obtaining data of each of multiple objects in a factory included in the original database, including: encoding the physical objects in the factory; splitting the spatial areas in the factory and encoding the split spatial areas; determining multiple objects based on the encoded physical objects and the encoded split spatial areas; determining the data of each of the multiple objects in the original database.

[0102] Optionally, in this embodiment, the non-volatile storage medium is configured to store program code for executing the following steps: the method also includes: based on multiple objects, verifying the data migrated to the target database to obtain a verification result; when the verification result indicates that the verification is passed, determining that the data migration is completed.

[0103] An embodiment of the present invention further provides a computer program product, including a computer program, which implements the steps of the data migration method in each embodiment of the present application when the computer program is executed by a processor.

[0104] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0105] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0106] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0107] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0108] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0109] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a non-volatile storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0110] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A data migration method, characterized in that: include: Obtaining data of respective objects in the factory included in the original database; Determine the association relationship between the data of the plurality of objects; Generate a data migration index according to the association relationship; Based on the data migration index, the data of each of the multiple objects is migrated to a target database.

2. The method according to claim 1, characterized in that Generating a data migration index according to the association relationship includes: Generate nodes corresponding to the multiple objects respectively, to obtain multiple nodes; According to the association relationship, the multiple nodes are connected to form a tree structure including the multiple nodes; The tree structure is used as the data migration index.

3. The method according to claim 2, characterized in that The step of migrating the data of each of the plurality of objects to a target database based on the data migration index includes: Migrating the tree structure to the target database; According to the multiple nodes in the tree structure, the data of each of the multiple objects is migrated to the target database.

4. The method according to claim 3, characterized in that The step of migrating the data of each of the plurality of objects to the target database according to the plurality of nodes in the tree structure includes: Determine the objects corresponding to the multiple nodes respectively; In the original database, determining the data of the objects respectively corresponding to the plurality of nodes, wherein the data of the objects respectively corresponding to the plurality of nodes at least include: basic data, three-dimensional model data, and two-dimensional drawing data; The data of the objects respectively corresponding to the multiple nodes are migrated to the target database.

5. The method according to claim 1, characterized in that The obtaining of the data of each of the multiple objects in the factory included in the original database includes: Encoding the entity objects in the factory; Splitting the spatial regions in the factory and encoding the split spatial regions; Determine the multiple objects according to the encoded entity object and the encoded split spatial region; In the original database, data of each of the plurality of objects is determined.

6. The method according to any one of claims 1 to 5, characterized in that Also includes: Based on the multiple objects, verify the data migrated to the target database to obtain a verification result; When the verification result indicates that the verification has passed, it is determined that the data migration is completed.

7. A data migration device, characterized in that: include: An acquisition module, used to acquire the data of each of the multiple objects in the factory included in the original database; A determination module, used to determine the association relationship between the data of the plurality of objects; A generating module, used for generating a data migration index according to the association relationship; A migration module is used to migrate the data of each of the multiple objects to a target database based on the data migration index.

8. A non-volatile storage medium, characterized in that: The non-volatile storage medium includes a stored program, wherein when the program is executed, the device where the non-volatile storage medium is located is controlled to execute the data migration method according to any one of claims 1 to 6.

9. A computer device, characterized in that: include: Memory and processor, The memory stores a computer program; The processor is used to execute the computer program stored in the memory, and when the computer program is run, the processor executes the data migration method according to any one of claims 1 to 6.

10. A computer program product comprising computer instructions, characterized in that: The computer instructions are executed by a processor to implement the data migration method described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Data migration method and device, equipment and storage medium

    CN114398346A

  • Data migration method and device, electronic equipment and computer readable medium

    CN116483808A

  • Method and system for migrating data from multi-relational database to non-relational database

    CN118312496A