Logging algorithm service method and system based on open source framework

Abstract

The invention discloses a logging algorithm service method and system based on an open source framework. Belongs to the technical field of petroleum and natural gas exploration and development. Logging algorithm source codes are collected and installed in an entity server, and a logging algorithm micro server side and a logging algorithm service station are arranged; a logging algorithm micro-server and a logging algorithm service station are configured behind the containerization logging algorithm micro-server; logging in idle equipment through the user algorithm service platform to dispatch data resource index of the logging algorithm service station and display logging algorithm information; the logging algorithm service platform sends a calculation task request to the logging algorithm micro server according to the user ID and the algorithm ID; and the logging algorithm service platform receives the calculation task result to complete the task. The logging algorithm is transmitted to the server side in a service mode, the lowest computing power requirement of each deployment terminal can be effectively saved through the logging algorithm managed in a centralized mode, meanwhile, optimization of the working process of logging data interpretation is achieved, and the working efficiency is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of oil and gas exploration and development, and particularly relates to a logging algorithm service method and system based on an open-source framework. Background Art

[0002] Logging data processing algorithms are usually calculated and applied in real time by relevant computing devices. With the rapid development of logging technology and intelligent algorithms, the traditional algorithm processing flow has been affected, and the existing local computing performance cannot meet the needs of future logging technology. It is proposed to combine microservices and use an open-source server framework to integrate logging algorithms, centrally consume the computing resources of the server, and improve the computing efficiency of future logging algorithms.

[0003] Currently, data sharing, business interconnection, and collaborative work have become new trends in cost reduction and efficiency improvement in logging operations. Traditional single-machine desktop applications for logging can no longer meet the requirements of resource sharing, information interconnection, high-precision computing, etc. There is an urgent need to develop new logging cloud computing technologies, build a multi-disciplinary and collaborative logging cloud platform, and comprehensively improve the sharing ability and service level of data resources and computing resources. Summary of the Invention

[0004] The purpose of the present invention is to propose a logging algorithm service method and system based on an open-source framework due to the inability of current logging algorithms to meet the needs of logging technology.

[0005] To achieve the above object, the present invention adopts the following technical solutions:

[0006] A logging algorithm service method based on an open-source framework includes the following steps:

[0007] Collect the source code of the logging algorithm and install it in the physical server, and equip the microservice end of the logging algorithm and the logging algorithm service station;

[0008] After containerizing the microservice end of the logging algorithm, configure the microservice end of the logging algorithm and the logging algorithm service station;

[0009] Log in to the idle device dispatch through the user algorithm service platform to index the data resources of the logging algorithm service station and display the logging algorithm information;

[0010] The logging algorithm service platform sends a calculation task request to the microservice end of the logging algorithm according to the user ID and algorithm ID;

[0011] The logging algorithm service platform receives the calculation task result to complete the task.

[0012] Further, the equipping of the microservice end of the logging algorithm and the logging algorithm service station includes:

[0013] Install the open-source framework Treefrog containing the source code of the logging algorithm on the host of the logging algorithm microservice; upload the algorithm writing introduction, parameter information, test cases, and routing APIs of the logging algorithm source code to the logging algorithm service station;

[0014] The containerized logging algorithm microservice includes:

[0015] Containerize the open-source framework Treefrog through Docker, and use K3S to manage the containerized logging algorithm microservice;

[0016] Configuring the logging algorithm microservice and the logging algorithm service station includes:

[0017] The logging algorithm service station exchanges messages with K3S, and the logging algorithm service station sends task information to the algorithm microservice to manage the tasks of the algorithm microservice.

[0018] Furthermore, the user algorithm service platform includes:

[0019] Self-service query the required algorithm information and try to send test cases to the corresponding interface;

[0020] The user login idle device dispatch includes:

[0021] The user logs in to the cluster management platform. The cluster management platform obtains a list of idle devices by polling the status of each cloud desktop terminal device, and randomly assigns an idle device to the user from the list of idle devices;

[0022] The data resource index of the logging algorithm service station includes:

[0023] Query the logging algorithm service station according to the user ID, and obtain data resources in the logging algorithm web page queried by the user;

[0024] The data resources include the logging algorithm information, documents, and call interface records queried by the user;

[0025] The display of logging algorithm information includes:

[0026] Retrieve the introduction, parameter information, call interface, and test cases of the logging algorithm queried by the user from the logging algorithm service station and display them to the user.

[0027] Furthermore, the sending of the calculation task request includes:

[0028] The user tries the test case or independently calls the algorithm interface. The logging algorithm service platform attaches data and sends it to the containerized logging algorithm microservice managed by K3S through an HTTP request, and starts a new container for calculating the logging algorithm.

[0029] Further, the receiving of the calculation task result includes:

[0030] After the container computing logging algorithm is completed, K3S transmits the calculation result to the logging algorithm service station through HTTP, and according to the request method, the calculation result is respectively displayed on the web page or returned from the HTTP protocol.

[0031] Further, after the user completes the learning of the display of logging algorithm information, the user exits the algorithm service platform.

[0032] Further, after the logging algorithm service platform receives the calculation task result and completes the task, it releases the computing container resources, records the logs and transmits the logs to the algorithm service platform for storage.

[0033] A logging algorithm service system based on an open-source framework, including a server preparation module for collecting logging algorithm source codes and installing them into an entity server, and equipping a logging algorithm microservice side and a logging algorithm service station;

[0034] A logging algorithm microservice side preparation module for containerizing the logging algorithm microservice side and then configuring the logging algorithm microservice side and the logging algorithm service station;

[0035] A data indexing module for indexing the data resources of the logging algorithm service station through the user algorithm service platform to log in to the idle device dispatch and display the logging algorithm information;

[0036] A calculation task request module for the logging algorithm service platform to send a calculation task request to the logging algorithm microservice side according to the user ID and the algorithm ID;

[0037] An acceptance calculation result module for the logging algorithm service platform to receive the calculation task result and complete the task.

[0038] An electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the logging algorithm service method based on the open-source framework is implemented.

[0039] A computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the logging algorithm service method based on the open-source framework is implemented.

[0040] Compared with the prior art, the present invention has the following beneficial technical effects:

[0041] A logging algorithm service method based on an open-source framework proposed by the present invention. By passing the logging algorithm into the server in the form of a service, the centrally managed logging algorithms can effectively save the minimum computing power requirements of each deployment terminal, and at the same time provide the possibility of arbitrarily combining multiple logging algorithms for hybrid processing. At the same time, it can optimize the workflow of logging data interpretation, improve work efficiency, and greatly facilitate user use.

[0042] A logging algorithm service method based on an open-source framework proposed by the present invention. Through network communication, the controller receives HTTP requests, curve data, and algorithm parameters, converts them into internal program variables, calls the algorithm for calculation, and returns the curve processing results, thereby achieving the effect of remote and cloud-based processing of the logging curve processing flow.

[0043] The present invention adopts cloud desktop technology to build a cluster management platform. Users can access logging professional application software at any location and at any time. Through data sharing in the data cloud, centralized management and convenient access to user data can be realized. Users can access business data related to work on any cloud desktop node server, achieving the purpose of remotely operating logging data analysis and processing, improving the efficiency of logging data processing. At the same time, it can save costs such as equipment procurement and maintenance, reduce the total cost of logging data processing, and improve the efficiency and level of oilfield development.

[0044] The present invention combines the TreeFrog logging algorithm with oil logging data mining, designs a logging algorithm service system based on the TreeFrog logging algorithm. Based on the logging data denoised by the weighted TreeFrog logging algorithm, the accuracy of oil and gas layer identification in logging data mining can be significantly improved, which has important practical significance in oil logging data mining. Specifically, the logging algorithm service system based on TreeFrog attempts to combine traditional backend frameworks and relatively advanced microservices.

[0045] The use of the present invention will improve the informatization ability of engineering technology services, enhance the market competitiveness of engineering technology products. Due to the in-depth digital transformation, it has important practical significance for the design and development of logging software. The application of new computer technologies can improve the utilization efficiency of computing resources and ensure the stable operation of the entire cloud computing environment to support various logging interpretation work. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The accompanying drawings in the specification are used to provide a further understanding of the present invention and constitute a part of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation to the present invention.

[0047] Figure 1 It is a schematic flow chart of a logging algorithm service method based on an open-source framework of the present invention.

[0048] Figure 2 This is a schematic structural diagram of a logging algorithm service system based on an open-source framework according to the present invention.

[0049] Figure 3 This is a schematic structural diagram of an electronic device for a logging algorithm service method based on an open-source framework according to the present invention.

[0050] Figure 4 This is a schematic processing flow diagram of a logging algorithm service method based on an open-source framework in an embodiment of the present invention.

[0051] Figure 5 This is a schematic internal flow diagram of the open-source framework Treefrog for a logging algorithm service method in an embodiment of the present invention.

[0052] Figure 6 This is a schematic flow diagram of a logging algorithm system model in an embodiment of the present invention.

[0053] Figure 7 This is a schematic flow diagram of the front-end web page jump of a logging algorithm service in an embodiment of the present invention. Detailed implementation manners

[0054] The present invention will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments. It should be noted that, without conflict, the embodiments in the present application and the features in the embodiments may be combined with each other.

[0055] The following detailed descriptions are all exemplary descriptions, aiming to provide further detailed descriptions of the present invention. Unless otherwise specified, all technical terms adopted by the present invention have the same meaning as commonly understood by those of ordinary skill in the technical field to which the present application belongs. The terms used in the present invention are only for describing specific implementation manners and are not intended to limit the exemplary embodiments according to the present invention.

[0056] See Figure 1 , a logging algorithm service method based on an open-source framework, includes the following steps:

[0057] Collect the source code of the logging algorithm and install it in the physical server, and equip the microservice end of the logging algorithm and the logging algorithm service station;

[0058] After containerizing the microservice end of the logging algorithm, configure the microservice end of the logging algorithm and the logging algorithm service station;

[0059] Log in to the idle device dispatch through the user algorithm service platform to index the data resources of the logging algorithm service station and display the logging algorithm information;

[0060] The logging algorithm service platform sends a calculation task request to the microservice end of the logging algorithm according to the user ID and the algorithm ID;

[0061] The logging algorithm service platform receives the calculation task result to complete the task.

[0062] Equipping the logging algorithm microservice side and the logging algorithm service station includes:

[0063] Install the open-source framework Treefrog storing the logging algorithm source code onto the host of the logging algorithm microservice side; upload the algorithm writing brief introduction, parameter information, test cases, and routing APIs of the logging algorithm source code to the logging algorithm service station;

[0064] Containerizing the logging algorithm microservice side includes:

[0065] Containerize the open-source framework Treefrog through Docker, and use K3S to manage the Docker-containerized logging algorithm microservice side;

[0066] Configuring the logging algorithm microservice side and the logging algorithm service station includes:

[0067] The logging algorithm service station exchanges messages with K3S, and the logging algorithm service station sends task information to the algorithm microservice side to manage the tasks of the algorithm microservice side.

[0068] The user algorithm service platform includes:

[0069] Self-service query the required algorithm information and attempt to send test cases to the corresponding interfaces;

[0070] User login and idle device allocation includes:

[0071] The user logs in to the cluster management platform. The cluster management platform obtains the list of idle devices by polling the status of each cloud desktop terminal device, and randomly allocates idle devices to the user from the list of idle devices;

[0072] The data resource index of the logging algorithm service station includes:

[0073] Query the logging algorithm service station according to the user ID, and obtain data resources in the logging algorithm web page queried by the user;

[0074] The data resources include the logging algorithm information, documents, and call interface records queried by the user;

[0075] Displaying the logging algorithm information includes:

[0076] Fetch the introduction, parameter information, call interface, and test cases of the logging algorithm queried by the user from the logging algorithm service station and display them to the user.

[0077] Sending a calculation task request includes:

[0078] The user attempts to test a test case or independently call an algorithm interface. The well logging algorithm service platform attaches data and sends it to the microservice end of the well logging algorithm containerized by K3S through an HTTP request, and a new container is started for calculating the well logging algorithm.

[0079] The received calculation task results include:

[0080] After the well logging algorithm is calculated in the container, K3S transmits the calculation results to the well logging algorithm service station through HTTP, and according to the request method, the calculation results are respectively displayed on the web page or returned from the HTTP protocol.

[0081] After the user completes learning the well logging algorithm information, the user exits the algorithm service platform.

[0082] After the well logging algorithm service platform receives the calculation task results and completes the task, it releases the calculation container resources, records the logs, and transmits the logs to the algorithm service platform for storage.

[0083] See Figure 2 , a well logging algorithm service system based on an open source framework, including a server preparation module for collecting well logging algorithm source code and installing it into a physical server, and equipping a microservice end of the well logging algorithm and a well logging algorithm service station;

[0084] A microservice end preparation module of the well logging algorithm for configuring the microservice end of the well logging algorithm and the well logging algorithm service station after containerizing the microservice end of the well logging algorithm;

[0085] A data indexing module for indexing data resources of the well logging algorithm service station through the user algorithm service platform to log in and dispatch idle devices and display well logging algorithm information;

[0086] A calculation task request module for the well logging algorithm service platform to send a calculation task request to the microservice end of the well logging algorithm according to the user ID and algorithm ID;

[0087] A module for accepting calculation results for the well logging algorithm service platform to receive the calculation task results and complete the task.

[0088] See Figure 3 , an electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a well logging algorithm service method based on an open source framework is implemented.

[0089] A computer-readable storage medium stores a computer program. When the computer program is executed by a processor, a well logging algorithm service method based on an open source framework is implemented.

[0090] The following embodiments in conjunction with [relevant content] further explain the present invention in detail:

[0091] In view of the workflow of logging data processing, the present invention designs a logging algorithm service based on an open-source framework. Different algorithms are classified and uniformly stored inside the framework on the server side. Users can use HTTP requests to transmit data to the server side and select the algorithms to be used. After waiting for the server side to complete the data processing, the final results can be downloaded.

[0092] See Figure 4 , a schematic diagram of the processing flow of a logging algorithm service method based on an open-source framework. The solution adopted by a logging algorithm service method in this embodiment includes the following steps:

[0093] Step 1: Prepare a physical server and collect the source codes of various logging algorithms;

[0094] Step 2: Add the source codes to the logging algorithm service system. For the model flow chart of the logging algorithm service system, see Figure 6 , and install it inside the physical server;

[0095] Step 3: Write introductions, parameter information, test cases, and routing APIs for each algorithm and upload them to the algorithm service station;

[0096] Step 4: The user algorithm service platform queries the required algorithm information by itself and tries to send test cases to the corresponding interfaces.

[0097] Step 5: The platform applies for a computing task from the microservice side according to the user ID and algorithm ID, creates a container, and sends a request with data to the open-source framework Treefrog. For the internal process schematic diagram of the open-source framework Treefrog of a logging algorithm service method, see Figure 5 .

[0098] TreeFrog is a high-speed full-stack Web application development framework based on C++ and Qt, providing an O / R mapping framework, a template system, and an MVC architecture.

[0099] Step 6: Return the calculation results to the platform, and the user can view the calculation results of the test cases on the platform.

[0100] Step 7: After the user finishes learning the usage method of the logging algorithm, exit the algorithm service platform.

[0101] Step 8: The microservice side completes the task and releases the computing container resources; record the logs and transmit them to the algorithm service platform for storage.

[0102] Optionally, a logging algorithm service based on an open-source framework includes the following steps:

[0103] Step 1: Prepare the physical server resources. In this embodiment, we select 1 physical host as the algorithm microservice server, and another 1 physical host as the website server, and deploy the algorithm service platform;

[0104] Step 2: Install the open-source framework Treefrog with logging algorithms on the microservice server host, containerize the framework through Docker, and use K3S to manage the Docker-containerized algorithm services.

[0105] Docker is an open-source application container engine that allows developers to package their applications and dependent packages into a portable image, and then publish it to any machine with a popular Linux or Windows operating system, and virtualization can also be achieved. Containers use a sandbox mechanism completely and there will be no interfaces between them.

[0106] K3S is lightweight Kubernetes. K3S can form multiple servers into a cluster, enabling edge servers to work together to complete data processing and analysis tasks. Through the orchestration function of K3S, administrators can easily manage and maintain the cluster, thereby reducing the operation and maintenance costs of edge computing.

[0107] Step 3: Microservice configuration. Enable the website server to exchange messages with K3S to achieve task management of the microservice and be able to send task information to the microservice server.

[0108] Step 4: User login and idle device assignment. After the user logs in to the cluster management platform, the system obtains the list of idle devices by polling the status of each cloud desktop terminal device, and randomly assigns the idle device A to the user;

[0109] Step 5: Data resource indexing. According to the user ID, query the website server to obtain the user's historical data and favorite algorithm information, including the logging algorithm information, related documents, call interface records, etc. that the user has queried; For the schematic diagram of the front-end web page jump process of the logging algorithm service, see Figure 7 .

[0110] Step 6: Display of logging algorithm information. On the algorithm web page queried by the user, obtain the introduction, parameter information, call interface, and test cases of the corresponding logging algorithm from the website server and display them to the user. For the schematic diagram of the front-end web page jump process of the logging algorithm service, see Figure 7 .

[0111] Step 7: Send a calculation task request. When the user tries the test case or independently calls the algorithm interface, the platform will attach the required data and send it to the K3S microservice management through an HTTP request, and start a new container for calculation.

[0112] Step 8: Receive the calculation task result. After the container computing logging algorithm is completed, K3S transmits the calculation result to the website server via HTTP, and finally, according to the request method, the result is displayed on the web page or returned from the HTTP protocol respectively.

[0113] Those skilled in the art should understand that the embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) containing computer-usable program code.

[0114] The present invention is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each flow and / or block in the flowchart and / or block diagram can be implemented by computer program instructions, and the combination of the flows and / or blocks in the flowchart and / or block diagram can also be implemented. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate a device for implementing the functions specified in Figure 1 one or more of the processes Figure 1 or multiple processes and / or blocks

[0115] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate a manufactured article including an instruction device, and the instruction device implements the functions specified in Figure 1 one or more of the processes Figure 1 or multiple processes and / or blocks

[0116] These computer program instructions can also be loaded onto a computer or other programmable data processing device, so that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in Figure 1 one or more of the processes Figure 1 or multiple processes and / or blocks

[0117] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them. Although the present invention has been described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: modifications or equivalent replacements can still be made to the specific embodiments of the present invention, and any modifications or equivalent replacements that do not depart from the spirit and scope of the present invention should be covered within the protection scope of the claims of the present invention.

Claims

1. A logging algorithm service method based on an open-source framework, characterized in that, it includes the following steps: Collect the source code of the logging algorithm and install it in the physical server, and equip the microservice end of the logging algorithm and the logging algorithm service station; After containerizing the microservice end of the logging algorithm, configure the microservice end of the logging algorithm and the logging algorithm service station; Log in to the idle device dispatch through the user algorithm service platform to index the data resources of the logging algorithm service station and display the logging algorithm information; The logging algorithm service platform sends a calculation task request to the microservice end of the logging algorithm according to the user ID and the algorithm ID; The logging algorithm service platform receives the calculation task result to complete the task.

2. The logging algorithm service method based on an open-source framework according to claim 1, characterized in that, The equipping of the microservice end of the logging algorithm and the logging algorithm service station includes: Install the open-source framework Treefrog storing the source code of the logging algorithm on the host of the microservice end of the logging algorithm; upload the algorithm writing introduction, parameter information, test cases and routing API of the source code of the logging algorithm to the logging algorithm service station; The containerizing of the microservice end of the logging algorithm includes: Containerize the open-source framework Treefrog through Docker, and use K3S to manage the containerized microservice end of the logging algorithm; The configuring of the microservice end of the logging algorithm and the logging algorithm service station includes: The logging algorithm service station exchanges messages with K3S, and the logging algorithm service station sends task information to the microservice end of the algorithm to manage the tasks of the microservice end of the algorithm.

3. The logging algorithm service method based on an open-source framework according to claim 2, characterized in that, The user algorithm service platform includes: Self-service query of the required algorithm information and attempt to send test cases to the corresponding interface; The user's logging in to the idle device dispatch includes: The user logs in to the cluster management platform, and the cluster management platform obtains the list of idle devices by polling the status of each cloud desktop terminal device, and randomly assigns an idle device to the user from the list of idle devices; The data resource indexing of the logging algorithm service station includes: Query the logging algorithm service station according to the user ID, and obtain data resources in the logging algorithm web page queried by the user; The data resources include the logging algorithm information, documents and call interface records queried by the user; The displaying of the logging algorithm information includes: Fetch the introduction, parameter information, call interface and test cases of the logging algorithm queried by the user from the logging algorithm service station and display them to the user.

4. The logging algorithm service method based on an open-source framework according to claim 2, characterized in that, The sending of the calculation task request includes: The user attempts to test the case or independently call the algorithm interface, and the logging algorithm service platform attaches data and sends it to the containerized microservice end of the logging algorithm managed by K3S through an HTTP request, and opens a new container for calculating the logging algorithm.

5. The logging algorithm service method based on an open-source framework according to claim 4, characterized in that, The receiving of the calculation task result includes: After the container computing logging algorithm is completed, K3S transmits the calculation results to the logging algorithm service station via HTTP. According to the request method, the calculation results are respectively displayed on the web page or returned from the HTTP protocol.

6. A logging algorithm service method based on an open-source framework according to claim 1, characterized in that, After the user completes the learning of the logging algorithm information display, the user exits the algorithm service platform.

7. A logging algorithm service method based on an open-source framework according to claim 1, characterized in that, After the logging algorithm service platform receives the calculation task result and completes the task, it releases the computing container resources, records the logs and transmits the logs to the algorithm service platform for storage.

8. A logging algorithm service system based on an open-source framework, characterized in that, It includes a server preparation module for collecting the source code of the logging algorithm and installing it into the physical server, and equipping the microservice side of the logging algorithm and the logging algorithm service station; The microservice side preparation module of the logging algorithm is used to configure the microservice side of the logging algorithm and the logging algorithm service station after containerizing the microservice side of the logging algorithm; The data indexing module is used to index the data resources of the logging algorithm service station through the user algorithm service platform to log in to the idle device dispatch and display the logging algorithm information; The calculation task request module is used for the logging algorithm service platform to send a calculation task request to the microservice side of the logging algorithm according to the user ID and the algorithm ID; The calculation result acceptance module is used for the logging algorithm service platform to receive the calculation task result and complete the task.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the logging algorithm service method based on an open-source framework according to any one of claims 1-7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, wherein the computer program implements the logging algorithm service method based on an open-source framework according to any one of claims 1-7 when executed by a processor.

Images