Master data management method based on oil field heterogeneous system

Abstract

The invention relates to the technical field of oil field information engineering, and discloses a main data management method based on an oil field heterogeneous system, which comprises the following steps of: sorting objects, analyzing various business activities and data of an enterprise, sorting core business objects and key attributes which are uniformly managed in each business process according to a high-value and high-sharing principle, and managing the business activities and the data of the business activities. Determining master data management content; object attribute management: managing object attribute information including contents of names, codes, descriptions, types, manufacturers, dates and sizes; and data set management: managing other business information of the object, including personalized attribute data of different devices. According to the method, the core business objects and the key attributes of the unified management are subjected to object carding, and the main data management content is clarified, so that the problem that cross-system, cross-business and cross-process data cannot be associated and shared can be solved, the data can be managed in a unified manner, and the efficiency of the business process is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of oilfield information engineering, in particular to a master data management method based on an oilfield heterogeneous system. BACKGROUND

[0002] Master data is data in an enterprise data resource system that has a high degree of sharing value, can be repeatedly used across multiple business departments, and has high business value. Master data is the foundation of data integration and the core of eliminating enterprise data silos.

[0003] According to the search, the master data management platform disclosed by China Patent Network with publication number CN203859771U includes a network switch, an application server cluster, a database server cluster, and a database storage. Three independent network segments are established through the network switch. The ports of the client and the user access side ports of the application server cluster are deployed in the first network segment. The data request side ports of the application server cluster and the data response side ports of the database server cluster are deployed in the second network segment. The data forwarding side ports of the database server cluster and the ports of the database storage are deployed in the third network segment. The storage devices and servers in the management platform construct redundant communication links through hierarchical isolation switching devices, form an information exchange grid at different levels, and completely meet the sudden increase in data requests brought about by new business development. The transaction processing software modules of the master data in the entire operation cycle can be optimized and deployed in scale, architecture, and efficiency based on the hardware architecture of the platform.

[0004] In the prior art, in the master data management based on the oilfield heterogeneous system, data cannot be associated if the systems are different or the business and processes are not the same, so data cannot be shared, which leads to the inability to manage uniformly, thus reducing the efficiency of the business process. SUMMARY

[0005] In view of the deficiencies of the prior art, the present application provides a master data management method based on an oilfield heterogeneous system, which solves the problem that data cannot be associated if the systems are different or the business and processes are not the same, leading to the inability to manage uniformly, thus reducing the efficiency of the business process.

[0006] To achieve the above purpose, the present application is implemented by the following technical scheme: a master data management method based on an oilfield heterogeneous system, comprising the following steps: Step one: object analysis, analyze various business activities and their data of the enterprise, according to the principle of high value and high sharing, analyze the core business objects and key attributes in the unified management of each business process, and clarify the master data management content; Step two: object attribute management, manage object attribute information, including name, code, description, type, manufacturer, date, and size. Step three: data set management, managing other business information of objects, including personalized attribute data of different devices, fuel information of heating furnaces, rated power information content, management content including data set name, code, and name, code, type, length, and precision of each attribute index under the data set; Step four: storage object, according to the object-oriented storage design concept, the shared characteristics of various business objects are summarized and abstracted to establish a storage main object, solving the problem of modifying and expanding the data model due to the business process design; Step five: identification and extraction, combined with the current status of unit data, identification and extraction rules are formulated for each main object, and the existing main data is extracted from the source system to the main database for unified management, and at the same time, the alias of each main object in different source systems and the association relationship between objects are recorded, laying a foundation for subsequent data association based on main data; Step six: migration customization, based on WEBETL tool, data migration process customization is realized through drag-and-drop component method; Step seven: data display, establish a supporting main data data sharing module, publish corresponding main data service interface, and facilitate the sharing of unified main data resources in the whole plant.

[0007] Preferably, in step one, when analyzing various business activities and their data of the enterprise, the flow path of data in each business activity is depicted, from data collection, transmission, processing to storage, and the correlation between data used in different business activities is analyzed to determine which main data entities are critical in multiple business activities to ensure that these data remain consistent in the entire system.

[0008] Preferably, when analyzing data in step one, the sensitivity and privacy requirements of data involved in each business activity are evaluated to ensure appropriate security and privacy measures are taken during data flow, in compliance with regulations and standards.

[0009] Preferably, when analyzing data in step one, the value of main data management to business activities is analyzed to determine the impact of main data management on improving business efficiency, reducing costs, and improving decision-making quality.

[0010] Preferably, in step four, the shared characteristics of various business objects are summarized and abstracted, which can identify the commonalities and similarities between these objects. Through such abstraction, a general main object is created, which contains the shared attributes of all business objects, reducing repetitive data model design.

[0011] Preferably, the storage master object helps to reduce the direct dependence of the business process on the underlying data model, and when the business process changes, only the business logic needs to be adjusted without modifying the master data model, thereby improving the stability of the system.

[0012] Preferably, the storage master object in step four can provide greater flexibility for future business demand expansion, and new business objects are associated with existing master objects without modifying the master data model, thereby making the system more easily adapt to new business requirements and improving the extensibility of the data model.

[0013] Preferably, the master data data sharing module in step seven includes a data integration and integration unit, a security and permission control unit, a metadata management unit, a data quality management unit, a data sharing protocol and standard unit, a data governance and management unit, and a monitoring and performance optimization unit.

[0014] Preferably, the data integration and integration unit is used to ensure the consistency and accuracy of the data, the security and permission control unit is used to ensure the security of the data, and the metadata management unit is used to manage the metadata information of the master data.

[0015] Preferably, the data quality management unit is used to implement data quality management strategies and processes, the data sharing protocol and standard unit is used to design and implement data sharing protocols and standards to ensure that data can be correctly shared and exchanged between different systems and applications, the data governance and management unit is used to establish data governance mechanisms to ensure compliance management, supervision and governance of the master data, and the monitoring and performance optimization unit is used to establish monitoring mechanisms to monitor the performance of the master data system and optimize it.

[0016] The present application provides a master data management method based on an oilfield heterogeneous system. It has the following advantages: 1、The present application unifies the core business objects and key attributes through object analysis, clearly defines the master data management content, and can achieve cross-system, cross-business, and cross-process data sharing, thereby realizing data sharing and data management, thereby improving the efficiency of the business process.

[0017] 2、The present application can establish the mapping relationship between the master object and the business application by storing the object and identifying and extracting the data, thereby realizing cross-business, cross-application, and cross-process data interconnection, thereby improving data availability and enhancing business process collaboration. BRIEF DESCRIPTION OF DRAWINGS

[0018] Figure 1 The present application provides an extraction customized flowchart; Figure 2This is a schematic diagram of the specific query field data of the present invention; Figure 3 This is a schematic diagram of the insertion of the EQUIPMENT according to the present invention; Figure 4 This is a schematic diagram of the timed extraction process of the present invention; Figure 5 This is a schematic diagram illustrating the object structure of the present invention; Figure 6 This is a schematic diagram of the main object attribute management of the present invention; Figure 7 This is a schematic diagram illustrating the maintenance of the main object attributes in this invention; Figure 8 This is a schematic diagram illustrating the maintenance of sub-object attributes in this invention; Figure 9 This is a schematic diagram illustrating the maintenance of basic object information in this invention; Figure 10 This is a schematic diagram illustrating the maintenance of object attribute information in this invention; Figure 11 This is a schematic diagram of the storage object of the present invention; Figure 12 This is a schematic diagram illustrating the scheduling strategy configuration of the present invention; Figure 13 This is a schematic diagram of the identification and extraction process of the present invention; Figure 14 This is a schematic diagram illustrating the data presented in this invention. Implementation

[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention. Example

[0020] Please see the appendix Figure 1 - Appendix Figure 14 This invention provides a master data management method based on an oilfield heterogeneous system, comprising the following steps: Step 1: Object organization, such as... Figure 5 As shown, the analysis of various business activities and their data of the enterprise is carried out. In accordance with the principles of high value and high sharing, the core business objects and key attributes of unified management in each business process are sorted out, and the content of master data management is clarified. In step one, when analyzing the various business activities and their data of the enterprise, the flow path of data in each business activity is depicted, from data collection, transmission, processing to storage, and the correlation between the data used in different business activities is analyzed to determine which master data entities are critical in multiple business activities to ensure that these data remain consistent throughout the system; In step one, when analyzing the data, the sensitivity and privacy requirements of the data involved in each business activity are evaluated to ensure that appropriate security and privacy measures are taken during data flow, in compliance with regulations and standards; In step one, when analyzing the data, the value of master data management to business activities is analyzed to determine the impact of master data management on improving business efficiency, reducing costs, and improving decision-making quality.

[0021] Step two: object attribute management, as shown in Figure 6 Object attribute information is managed, including name, code, description, type, manufacturer, date, and size.

[0022] Step three: data set management, as shown in Figure 8 Other business information of the object is managed, including personalized attribute data of different devices, fuel information of the heating furnace, and rated power information content. The management content includes data set name, code, and the name, code, type, length, and precision of each attribute index under the data set.

[0023] According to the sorted device table, the device master object is maintained first, and the attributes of the device are maintained, including device ID, device category ID, device classification, device description, device name, device reference number, device serial number, device type, manufacturer, purchase date, acquisition date, commissioning date, current owner ID, decommissioning date, remarks, source, PODM_GUID, validity flag, effective date, invalid date, row changer, row change date, row creator, row creation date, row validity date, row invalid date, row quality, production date, device asset number, specification, audit status, creation unit identifier, device purpose, service life, device application type, and other information.

[0024] Step four: storage object, as shown in Figure 11 According to the object-oriented storage design concept, various business objects with shared characteristics are abstracted and established as storage master objects. The role of establishing storage master objects is to improve the flexibility, maintainability, and scalability of the system. This design method helps better cope with business changes, reduces the impact on the underlying data model, making the system more maintainable and evolutionary, solving the problem of constantly modifying and expanding the data model due to business process-oriented design, making the master data model stable and adaptable; The step four can identify the common points and similarities between the objects by abstracting the shared features of various business objects, and create a general master object containing the shared attributes of all business objects, thereby reducing repetitive data model design; The step four can help reduce the direct dependence of business processes on the underlying data model, and when the business process changes, the business logic can be adjusted without modifying the master data model, thereby improving the stability of the system. The master data model defines the relationships, attributes and rules between these master data entities, providing a consistent and accurate data view for the organization, which helps to ensure a shared understanding of key business entities throughout the organization and provides consistent and reliable data for different business processes. The step four can provide greater flexibility for future business demand expansion. New business objects are associated with existing master objects without modifying the master data model, thereby making the system more adaptable to new business requirements and improving the extensibility of the data model.

[0025] According to the actual situation of the equipment, sub-objects related to the equipment are established, including single-well equipment pumping unit data, oil system equipment basic information, control system basic data, metering and automatic control instrument basic data, frequency conversion basic information, water treatment equipment information, pump basic information, water injection equipment information, filter tank basic information, heating furnace basic information, imprint protection instrument basic information, oil layer casing record, casing information data and the like.

[0026] Step five: identification and extraction, in combination with the current situation of the unit data, identification and extraction rules are formulated for various master objects, and existing master data is extracted from the source system to the master database for unified management. At the same time, the aliases of various master objects in different source systems and the association relationships between the objects are recorded during the process, laying a foundation for subsequent data association based on master data.

[0027] Step six: migration customization, as shown in Figure 13 Based on the WEBETL tool, the data migration process customization is realized by dragging and dropping components.

[0028] Step seven: data display, as shown in Figure 14 The corresponding master data sharing module is established, and the master data service interface is published to facilitate the sharing of unified master data resources throughout the plant. The master data service interface is an interface for communicating with the master data service, which is usually provided in the form of a network protocol or a Web service. These interfaces allow applications, systems or services to access, query and update master data information; The main data data sharing module in the step seven includes a data integration and integration unit, a security and permission control unit, a metadata management unit, a data quality management unit, a data sharing protocol and standard unit, a data governance and management unit, and a monitoring and performance optimization unit; The data integration and integration unit is used to ensure the consistency and accuracy of data, the security and permission control unit is used to ensure the security of data, and the metadata management unit is used to manage the metadata information of main data; The data quality management unit is used to implement data quality management strategies and processes, the data sharing protocol and standard unit is used to design and implement data sharing protocols and standards to ensure that data can be correctly shared and exchanged between different systems and applications, the data governance and management unit is used to establish data governance mechanisms to ensure compliance management, supervision and governance of main data, and the monitoring and performance optimization unit is used to establish monitoring mechanisms to monitor the performance of main data systems and optimize them to ensure that the systems can meet user needs and be adjusted in time to meet changing needs.

[0029] According to the above completed information, an identification extraction process is established. First, the mapping relationship of the pump basic data is established according to the DMGC_Y_JB of A5, see Figure 1 ; then the extracted data is inserted into EQUIPMENT according to the analyzed data relationship, see Figure 2 , see Figure 3 ; according to the customized process, a scheduling strategy is established, which is executed once a day at 0 o'clock, see Figure 4 .

[0030] Although embodiments of the present application have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made therein without departing from the principles and spirit of the application, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A method for managing master data based on a heterogeneous system of an oilfield, characterized in that, Includes the following steps: Step 1: Object sorting. Analyze the various business activities and data of the enterprise. In accordance with the principles of high value and high sharing, sort out the core business objects and key attributes that are uniformly managed in each business process, and clarify the content of master data management. Step 2: Object attribute management, managing object attribute information, including name, code, description, type, manufacturer, date, and size; Step 3: Dataset management, which manages other business information of the objects, including personalized attribute data of different equipment, fuel information and rated power information of the heating furnace. The management content includes the dataset name, code and the name, code, type, length and precision of each attribute indicator under the dataset; Step 4: Store objects. Following the object-oriented storage design concept, summarize and abstract the shared characteristics of various business objects, establish the main storage object, and solve the problem of constantly modifying and expanding the data model due to business development caused by the business process design. Step 5: Identification and extraction. Based on the current status of the unit's data, identification and extraction rules are formulated for various master objects. The existing master data is extracted from the source system and managed uniformly in the master database. At the same time, during this process, the aliases of various master objects in different source systems and the relationships between objects are recorded, laying a solid foundation for subsequent data association based on master data. Step Six: Migration Customization. Based on the WEBETL tool, the data migration process is customized by dragging and dropping components. Step 7: Data Display. Establish a supporting master data sharing module and publish the corresponding master data service interface to facilitate the sharing of unified master data resources across the entire plant.

2. The main data management method based on the oilfield heterogeneous system according to claim 1, characterized in that, In step one, when analyzing various business activities and their data, the flow path of data in each business activity is depicted, from the entire process of data collection, transmission, processing to storage. The relationships between the data used in different business activities are analyzed to determine which master data entities are critical in multiple business activities, so as to ensure that these data remain consistent throughout the system.

3. The master data management method based on oilfield heterogeneous systems according to claim 1, characterized in that, In step one, when analyzing the data, the sensitivity and privacy requirements of the data involved in each business activity are assessed to ensure that appropriate security and privacy measures are taken during the data flow process, in compliance with regulations and standards.

4. The master data management method based on oilfield heterogeneous systems according to claim 1, characterized in that, In step one, when analyzing the data, the value of master data management to business activities is analyzed, and the impact of master data management on improving business efficiency, reducing costs, and improving decision-making quality is determined.

5. The master data management method based on oilfield heterogeneous systems according to claim 1, characterized in that, In step four, the shared characteristics of various business objects are summarized and abstracted, which can identify the commonalities and similarities between these objects. Through such abstraction, a general master object is created, which contains the shared attributes of all business objects, reducing repetitive data model design.

6. The master data management method based on oilfield heterogeneous systems according to claim 1, characterized in that, Storing the master object in step four helps reduce the direct dependence of business processes on the underlying data model. When business processes change, the business logic can be adjusted without modifying the master data model, thereby improving the stability of the system.

7. The master data management method based on oilfield heterogeneous systems according to claim 1, characterized in that, The storage master object in step four provides greater flexibility for future business expansion. New business objects are linked to the existing master object without modifying the master data model, making the system more adaptable to new business requirements and improving the scalability of the data model.

8. The master data management method based on oilfield heterogeneous systems according to claim 1, characterized in that, The master data sharing module in step seven includes a data integration and consolidation unit, a security and access control unit, a metadata management unit, a data quality management unit, a data sharing protocol and standard unit, a data governance and management unit, and a monitoring and performance optimization unit.

9. The master data management method based on an oilfield heterogeneous system according to claim 8, characterized in that, The data integration and consolidation unit ensures data consistency and accuracy, the security and access control unit ensures data security, and the metadata management unit manages the metadata information of the master data.

10. The master data management method based on oilfield heterogeneous systems according to claim 8, characterized in that, The data quality management unit is used to implement data quality management strategies and processes; the data sharing protocol and standards unit is used to design and implement data sharing protocols and standards to ensure that data can be correctly shared and exchanged between different systems and applications; the data governance and management unit is used to establish a data governance mechanism to ensure compliant management, supervision and governance of master data; and the monitoring and performance optimization unit is used to establish a monitoring mechanism to monitor and optimize the performance of the master data system.

Images