Data conversion method, system and device for Ontobar and medium

Abstract

The invention belongs to the technical field of data processing, and relates to a data conversion method, system and device for an Ontobar and a medium. According to the method, the original data input according to the data receiving template is obtained, and preliminary formatting and standardization of the data are ensured. And integrity verification is carried out on the original data, so that the problem of data missing or errors can be found and corrected in time. And if the original data does not meet the integrity requirement, revising the original data until the integrity verification of the original data is qualified, and obtaining qualified data. And converting the qualified data according to table correspondence, field correspondence, measurement unit conversion correspondence and code conversion correspondence to obtain standard format data meeting the requirements of the Ontobar. According to the invention, the data of the self-built system of each oil field branch company and the data of the ontobar built by the group can be converted, the accuracy, consistency and integrity of the data conversion process are ensured, the workload of engineers is reduced, the working efficiency is improved, and the great waste of human resources is avoided.

Description

Technical Field

[0001] This invention belongs to the field of data processing technology and relates to a data transformation method, system, device and medium for Onetobar. Background Technology

[0002] The OnetoBar data entry system is an advanced platform based on the QSY01128-2020 standard. Primarily used in well logging engineering, it is widely applied across various oilfields and drilling companies. The system aims to achieve standardized management of well logging data at the group company level and build a unified and efficient results database, providing solid data support for oil and gas exploration and development. With its powerful functions and wide applicability, the OnetoBar system has been extensively promoted and applied in drilling sites managed by numerous oil and gas companies.

[0003] However, in the process of promoting their own "digital transformation and intelligent development," each oilfield company has gradually established its own information collection platform. Due to the different information technology construction needs of each oilfield company, there are differences in data collection. To meet the data collection requirements of the group's unified construction and the specific information technology construction needs of each oilfield, field engineers often need to perform repetitive data entry work.

[0004] This phenomenon of repetitive data entry not only increases the workload of engineers and reduces work efficiency, but also causes a huge waste of human resources.

[0005] In summary, when data from the self-built systems of various oilfield branches is uploaded to the Onetobar system built by the group, there is a problem of duplicate data entry, which increases the workload of engineers and reduces work efficiency. Summary of the Invention

[0006] The purpose of this invention is to provide a data conversion method, system, device, and medium for Onetobar, to solve the technical problem of duplicate data entry when data from the self-built systems of various oilfield branches is uploaded to the Onetobar system built by the group. This invention can convert data from the self-built systems of various oilfield branches to the Onetobar system built by the group, ensuring the accuracy, consistency, and completeness of the data conversion process, reducing the workload of engineers, and improving work efficiency.

[0007] To achieve the above objectives, the present invention employs the following technical solution:

[0008] In a first aspect, the present invention provides a data transformation method for Onetobar, comprising the following steps:

[0009] Retrieve the raw data entered based on the data receiving template;

[0010] The original data is checked for integrity. If the original data does not meet the integrity requirements, it is revised until the integrity check of the original data is passed and qualified data is obtained.

[0011] Based on the correspondence between tables, fields, units of measurement, and codes, qualified data is transformed to obtain standard format data that meets Onetobar requirements.

[0012] Secondly, the present invention provides a data transformation system for Onetobar, comprising:

[0013] Data entry module: Used to acquire raw data entered based on the data receiving template;

[0014] Data verification module: Used to verify the integrity of the original data. If the original data does not meet the integrity requirements, the original data is revised until the integrity verification of the original data is passed and qualified data is obtained.

[0015] Data Conversion Module: This module is used to convert qualified data based on table correspondence, field correspondence, unit of measurement conversion, and encoding conversion to obtain standard format data that meets Onetobar requirements.

[0016] Thirdly, the present invention provides an electronic device, comprising: a processor; a memory for storing computer program instructions; and steps for implementing a data conversion method for Onetobar when executing the computer program.

[0017] Fourthly, the present invention provides a storage medium storing computer program instructions, which are loaded and executed by a processor, wherein the processor performs a data conversion method for Onetobar.

[0018] Compared with the prior art, the present invention has the following beneficial effects:

[0019] 1. This invention acquires raw data entered based on a data receiving template, ensuring initial formatting and standardization of the data. Integrity verification of the raw data allows for timely detection and correction of missing or erroneous data. If the raw data does not meet integrity requirements, it is revised until the integrity verification is passed, resulting in qualified data. Based on table correspondence, field correspondence, unit of measurement conversion, and encoding conversion, the qualified data is converted to obtain standard format data conforming to Onetobar requirements. This invention enables the conversion of data from various oilfield branch companies' self-built systems with the group's unified Onetobar data, ensuring the accuracy, consistency, and completeness of the data conversion process, reducing the workload of engineers, improving work efficiency, and avoiding significant waste of human resources.

[0020] 2. The system of this invention includes: a data entry module, a data verification module, and a data conversion module. The data entry module is used to acquire raw data entered according to the data receiving template. The data verification module is used to verify the integrity of the raw data. If the raw data does not meet the integrity requirements, it is revised until the integrity verification of the raw data is passed, resulting in qualified data. The data conversion module is used to convert the qualified data according to table correspondence, field correspondence, unit of measurement conversion correspondence, and code conversion correspondence, to obtain standard format data that meets Onetobar requirements. These modules work together to achieve the conversion of data from the self-built systems of various oilfield branches with the Onetobar data built by the group, ensuring the accuracy, consistency, and integrity of the data conversion process, reducing the workload of engineers, and improving work efficiency.

[0021] 3. The electronic device and storage medium of this invention can also convert data from the self-built systems of various oilfield branches with data from the Onetobar system built by the group, ensuring the accuracy, consistency and integrity of the data conversion process, reducing the workload of engineers and improving work efficiency. Attached Figure Description

[0022] Figure 1 This is a flowchart of the method of the present invention;

[0023] Figure 2 This is a system module diagram of the present invention;

[0024] Figure 3 This is a flowchart illustrating the overall operation of the method according to an embodiment of the present invention. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0027] The present invention will now be described in further detail with reference to the accompanying drawings:

[0028] See Figure 1 This invention discloses a data transformation method for Onetobar, comprising the following steps:

[0029] S1. Obtain the raw data entered based on the data receiving template;

[0030] Preferably, the data receiving templates include: basic data push template, engineering logging data receiving template, geological logging data receiving template, evaluation logging data receiving template, logging shift report data receiving template, processing and interpretation data receiving template, and custom data receiving template.

[0031] Preferably, the data receiving template has a function to limit the range of numerical fields to be filled in. When the filled-in value exceeds the preset correct range, the original data cannot be entered.

[0032] Preferably, during the process of obtaining the original data entered based on the data receiving template, a correct filling example is shown to the on-site user to ensure the accuracy of the data received by OnetoBar.

[0033] S2. Perform integrity verification on the original data. If the original data does not meet the integrity requirements, revise the original data until the integrity verification of the original data is qualified and qualified data is obtained.

[0034] Preferably, the integrity verification of the original data is performed as follows:

[0035] The integrity of the collected raw data range, data correlation, and uniformity is verified by using predetermined specifications.

[0036] Preferably, the predetermined specification is QSY01128-2020 Well Logging Data Acquisition, Processing and Interpretation Specification.

[0037] S3. Based on the table correspondence, field correspondence, unit of measurement conversion correspondence, and code conversion, the qualified data is converted to obtain standard format data that meets Onetobar requirements, as follows:

[0038] Based on the table, the data table in the qualified data should be transformed to obtain the transformed data table;

[0039] Based on the field correspondence, transform the fields in the transformed data table;

[0040] Based on the unit conversion, the unit conversion in the converted fields should be performed accordingly;

[0041] The encoding conversion should be performed on the qualified data.

[0042] Preferably, after obtaining the standard format data that conforms to Onetobar requirements, the following steps are performed:

[0043] Send standard format data to the Onetobar system;

[0044] Accept standard format data packaged from the Onetobar system and forward the packaged standard format data to the group company's logging quality tracking database.

[0045] See Figure 1 In another feasible embodiment of the present invention, the following modifications are made as appropriate.

[0046] Includes the following steps:

[0047] The system retrieves the raw data entered based on the data receiving template, ensuring the initial formatting and standardization of the data.

[0048] Perform integrity checks on the original data. Integrity checks can promptly identify and correct missing or incorrect data. If the original data does not meet integrity requirements, it is revised until the integrity check is passed, resulting in acceptable data. Through repeated checks and revisions, it can be ensured that all data meets integrity requirements.

[0049] Based on table correspondence, field correspondence, unit of measurement conversion, and encoding conversion, qualified data is transformed to obtain standard format data that meets Onetobar requirements. This invention can convert data from the self-built systems of various oilfield branches with data from the group's unified Onetobar, ensuring the accuracy, consistency, and completeness of the data conversion process, reducing the workload of engineers, improving work efficiency, and avoiding a significant waste of human resources.

[0050] Example 1:

[0051] See Figure 1 This embodiment discloses a data transformation method for Onetobar, including the following steps:

[0052] An intermediate database is built, and data entered from the self-built system is transferred to the field intermediate database. After table correspondence, field correspondence, unit of measurement conversion, and encoding conversion, a standard format file required by Onetobar is generated and automatically submitted to the group company to meet the data quality inspection requirements of the group company's logging data quality tracking personnel. Figure 3 As shown.

[0053] The overall functionality of the method of this invention includes two main parts: the backend administrator's usage function and the data collection function used by the on-site logging engineer.

[0054] The features used by backend administrators include:

[0055] 1. Table mapping: Develop a table mapping module to map the 99 data tables in the OnetoBar standard library to the data tables of the self-built data acquisition platform;

[0056] 2. Field mapping: Based on table mapping, the 1108 data items in the Onetobar standard library are mapped to the original data items of the self-built data collection platform.

[0057] 3. Unit of measurement conversion: This feature addresses the conversion between the units of measurement in the self-built system and the units of measurement in Onetobar. Examples include the conversion between inches and centimeters in sleeve dimensions, and the conversion between tons and kilonewtons in hook suspension weight. This feature satisfies the unit of measurement conversion requirements between the self-built system and the unified Onetobar.

[0058] 4. Code Conversion and Correspondence: Different systems have their own code tables. In order to unify their related classification statistics, there is a certain correspondence between the codes. When performing data conversion, it is necessary to convert the relevant codes.

[0059] 5. Data quality verification: Based on the collection standards of the self-built system and Onetobar, source data quality control is required. The collection range, data correlation, and consistency of the relevant raw data are verified to ensure that the data meets the relevant data collection standards.

[0060] 6. Data Conversion Service: Based on the maintained table correspondence, data item correspondence, unit of measurement conversion correspondence, and code conversion correspondence, the system automatically extracts relevant raw data from the intermediate library of the self-built system, performs data conversion, and generates a data package, i.e., a DAT file, in accordance with Onetobar's standard after passing Onetobar's data submission time limit. The data is then automatically pushed to the group database, i.e., the group company's logging quality tracking database.

[0061] Data acquisition functions used daily by logging engineers:

[0062] 1. Data Integrity Verification: Before pushing data, click on Data Integrity Verification to verify the integrity of the data according to the relevant data quality control rules, and pop up a prompt for non-compliant data. For non-compliant data, it is necessary to revise it in the self-built system and then re-extract and verify it.

[0063] 2. Basic Data Push Template: Push basic information about wells to the group;

[0064] 3. Engineering logging data receiving template: Extracts data related to engineering logging from the self-built system and generates a data packet for reporting;

[0065] 4. Geological logging data receiving template: Extracts data related to geological logging from the self-built system and generates a data packet for reporting;

[0066] 5. Evaluation logging data receiving template: Extract data related to evaluation logging from the self-built system and generate a data packet for reporting;

[0067] 6. Logging shift report data receiving template: Retrieves data from the self-built system's logging shift report and generates the data packet for submission;

[0068] 7. Processing and interpreting data receiving templates: Processing and interpreting data from the self-built system and generating data packets for reporting;

[0069] 8. Custom data receiving template: For data not included above, based on business needs, customize a data receiving and generation model that needs to be reported, extract relevant data, and generate reporting data packets.

[0070] In summary, the invention achieves the following results:

[0071] This invention, through adjustments to a self-built system, achieves stable data integration with OnetoBar while ensuring the quality of data received by OnetoBar.

[0072] This invention ensures the uniqueness of OnetoBar received data: by aggregating data from various disciplines in the drilling and repair site database to generate data files or writing them into the OnetoBar local database, and transmitting the data through the well site LAN, the uniqueness of OnetoBar data is guaranteed.

[0073] This invention ensures the timeliness of OnetoBar's data reception: It establishes relevant timeliness regulations, requiring data entry, pushing, and submission before OnetoBar's daily file generation. This ensures the timeliness of OnetoBar's data reception.

[0074] This invention ensures the integrity of OnetoBar received data by developing a data integrity verification function within self-built manual data acquisition software. Before data is pushed, the system automatically verifies whether any data is missing according to the QSY01128-2020 Well Logging Data Acquisition, Processing and Interpretation Specification, ensuring the integrity of the source data. After OnetoBar data is generated, it is automatically verified again according to the QSY01128-2020 Well Logging Data Acquisition, Processing and Interpretation Specification, ensuring the integrity of the generated data.

[0075] This invention ensures the accuracy of data received by OnetoBar: by developing a self-built manual data collection software, a data quality control function is implemented to limit the range of numerical fields to be filled in, and data cannot be entered if it exceeds the correct range. Correct filling examples are shown to on-site users to ensure the accuracy of data received by OnetoBar.

[0076] This invention ensures the standardization of data received by OnetoBar: In the data conversion service, data encoding conversion function and unit of measurement conversion function are developed to ensure that the data push content conforms to the data type and encoding specification definition of the OnetoBar system, and establishes heterogeneous correspondence and data splicing logic to ensure the standardization of the pushed data.

[0077] In this invention, data entered into a self-built system is processed on a field server via a data interface server. Based on the correspondence between data tables and data items, and after master data conversion and encoding conversion, a data format file required by Onetobar is generated and submitted to the group company for quality review by the group's data quality control personnel.

[0078] Example 2:

[0079] See Figure 1 This embodiment discloses a data transformation method for Onetobar, including the following steps:

[0080] This invention has been piloted in an oil field and has achieved good results. The pilot operation consisted of 11 steps, as detailed in the table below:

[0081] Table 1. Pilot Operation Process of the Invention in a Certain Oilfield:

[0082]

[0083] Phase 1: Establishing the Onetobar intermediate library. Specific tasks include: sorting out the data model, establishing the intermediate library, extending Onetobar fields in the self-built system, and establishing the correspondence between the self-built system and Onetobar.

[0084] Phase Two: Developing data push software;

[0085] Phase 3: On-site deployment and testing, which includes testing and modifying the data synchronization software, pushing internal test data to Onetobar, and on-site deployment and testing of Onetobar.

[0086] Phase 4: Automatically upload to the group's logging quality tracking system, coordinate with Onetobar's developer, Scene University, to develop an automatic file upload tool, and conduct tracking tests;

[0087] Phase 5: Testing within the internal logging team, coordinating relevant logging teams, deploying the intermediate library, and continuously testing the automatic upload function;

[0088] Phase 6: Application and Promotion Phase. Internal training on the use of the Onetobar integration tool will be conducted, followed by deployment to the logging site.

[0089] The sixth phase has been completed and has achieved certain results, reducing the data collection workload for on-site users and receiving widespread praise. This invention enables data integration between self-built systems and unified systems.

[0090] This invention enables data interoperability between self-built and unified systems, allowing data to be entered once and satisfied by both systems, thus significantly reducing the workload of on-site logging engineers and saving personnel costs. Secondly, it ensures the uniqueness, standardization, completeness, accuracy, and timeliness of data from the source, improving data quality and providing higher-quality data support for enterprises' digital transformation and intelligent development. This invention effectively avoids duplicate data entry, achieving efficient data collection and sharing.

[0091] Based on the above method, this invention also discloses a data conversion system for Onetobar, see [link to relevant documentation]. Figure 2 ,include:

[0092] Data entry module: Used to acquire raw data entered based on the data receiving template;

[0093] Data verification module: Used to verify the integrity of the original data. If the original data does not meet the integrity requirements, the original data is revised until the integrity verification of the original data is passed and qualified data is obtained.

[0094] Data Conversion Module: This module is used to convert qualified data based on table correspondence, field correspondence, unit of measurement conversion, and encoding conversion to obtain standard format data that meets Onetobar requirements.

[0095] The various modules of the washing system of this invention work together to convert data from the self-built systems of various oilfield branches with data from the Onetobar system built by the group, ensuring the accuracy, consistency and integrity of the data conversion process, reducing the workload of engineers and improving work efficiency.

[0096] An electronic device includes: a processor; a memory for storing computer program instructions; and steps for implementing a data conversion method for Onetobar when executing the computer program.

[0097] A storage medium storing computer program instructions that, when loaded and executed by a processor, perform a data transformation method for Onetobar.

[0098] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0099] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0100] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0101] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0102] The above content is only for illustrating the technical concept of the present invention and should not be construed as limiting the scope of protection of the present invention. Any modifications made to the technical solution based on the technical concept proposed in this invention shall fall within the scope of protection of the claims of this invention.

Claims

1. A data transformation method for Onetobar, characterized in that, Includes the following steps: Retrieve the raw data entered based on the data receiving template; The original data is checked for integrity. If the original data does not meet the integrity requirements, it is revised until the integrity check of the original data is passed and qualified data is obtained. Based on the correspondence between tables, fields, units of measurement, and codes, qualified data is transformed to obtain standard format data that meets Onetobar requirements.

2. The data conversion method for Onetobar according to claim 1, characterized in that, The data receiving templates include: basic data push template, engineering logging data receiving template, geological logging data receiving template, evaluation logging data receiving template, logging shift report data receiving template, processing and interpretation data receiving template, and custom data receiving template.

3. The data conversion method for Onetobar according to claim 1, characterized in that, The data receiving template has a limitation function for the range of numerical fields to be filled in. When the value entered exceeds the preset correct range, the original data cannot be entered.

4. The data conversion method for Onetobar according to claim 1, characterized in that, The process of obtaining the raw data entered based on the data receiving template is as follows: During the process of obtaining the raw data entered based on the data receiving template, a correct filling example is shown to the on-site users.

5. The data conversion method for Onetobar according to claim 1, characterized in that, The integrity verification of the original data is performed as follows: The integrity of the collected raw data range, data correlation, and uniformity is verified by using predetermined specifications.

6. The data conversion method for Onetobar according to claim 1, characterized in that, Based on the correspondence between tables, fields, units of measurement, and codes, qualified data is transformed to obtain standard format data that meets Onetobar requirements, as detailed below: Based on the table, the data table in the qualified data should be transformed to obtain the transformed data table; Based on the field correspondence, transform the fields in the transformed data table; Based on the unit conversion, the unit conversion in the converted fields should be performed accordingly; The encoding conversion should be performed on the qualified data.

7. The data conversion method for Onetobar according to claim 1, characterized in that, To obtain standard format data that conforms to Onetobar requirements, the following steps are performed: Send standard format data to the Onetobar system; It accepts standard data packets generated by the Onetobar system based on standard format data and forwards the standard data packets to the logging quality tracking library.

8. A data transformation system for Onetobar, characterized in that, include: Data entry module: Used to acquire raw data entered based on the data receiving template; Data verification module: Used to verify the integrity of the original data. If the original data does not meet the integrity requirements, the original data is revised until the integrity verification of the original data is passed and qualified data is obtained. Data Conversion Module: This module is used to convert qualified data based on table correspondence, field correspondence, unit of measurement conversion, and encoding conversion to obtain standard format data that meets Onetobar requirements.

9. An electronic device, comprising: A processor; a memory, an electronic device for storing computer program instructions; characterized in that, when executing the computer program, it implements the steps of the data conversion method for Onetobar as described in any one of claims 1-7.

10. A storage medium storing computer program instructions, characterized in that, When the computer program instructions are loaded and run by the processor, the processor performs the data conversion method for Onetobar as described in any one of claims 1-7.

Images