Apparatus and method for database preprocessing for unconventional oil production plant
The database preprocessing method and apparatus address the challenge of managing large sensor data volumes in unconventional oil production plants by identifying and transmitting abnormal data, ensuring efficient real-time monitoring and stable plant operation.
Patent Information
- Application Number
- JP2024223834
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-21
- Filing Date
- 2024-12-19
- Publication Date
- 2025-07-03
- Estimated Expiration
- 2044-12-19
AI Technical Summary
Existing systems struggle to efficiently store and transmit large amounts of sensor data from numerous sensors in unconventional oil production plants to monitoring devices for real-time monitoring, particularly in oil sand production plants.
A database preprocessing method and apparatus that inputs sensor data, temporarily stores it, compares with previous data, identifies abnormalities, adds key values to abnormal data, and transmits data to monitoring devices, while removing duplicates and handling empty data.
Enables efficient storage and real-time monitoring of sensor data, allowing quick detection of abnormalities and stable plant operation by efficiently managing large volumes of sensor data.
Smart Images

Figure 2025100472000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a database preprocessing apparatus and method for an unconventional oil production plant.
Background Art
[0002] Worldwide, with the increase in international crude oil prices, competition for securing oil resources and developing alternative energy has become active. Canada is the 22nd largest oil-producing country in the world. In recent years, due to the improved profitability of oil sands, more aggressive investment and development have been promoted.
[0003] With the development of ICT technology, many studies aiming at introducing information and communication technologies including smart mines and digital oil fields have been advanced in the resource development field. With the progress of ICT technology, monitoring systems have also developed. Recently, engineers can monitor all the facilities at the site in the office and manage and operate the production plant without directly visiting the site.
[0004] In particular, in recent years, as technologies related to the fourth industrial revolution such as big data and artificial intelligence have attracted attention, the development of related application technologies for improving the efficiency and safety of resource development has been actively promoted. Among such information and communication technologies, digital twin is evaluated as one of the major technologies. Briefly expressed, a digital twin refers to a virtual world replica of a real object. Here, the replication means not only acquiring simple data obtained through on-site surveys, but also acquiring real-time data of the real object, reflecting the variability of the data, and mimicking the changing aspect of the object in a form close to reality. The digital twin realized in this way is utilized to quickly diagnose the current state of the object or predict future situations by reflecting the characteristics and changes of complex real objects.
[0005] Unlike a general oil production plant, in the case of an oil sand production plant, the number of sensors increases rapidly as the processing equipment increases. Therefore, in order to realize a real-time monitoring system for an oil sand production plant, a technology is required to efficiently store a large amount of data in a database and transmit it to a monitoring device.
Prior Art Documents
Patent Documents
[0006]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0007] The present invention provides a database preprocessing apparatus and method for an unconventional oil production plant that efficiently stores a large amount of sensor data obtained from a large number of sensors installed in each facility of the unconventional oil production plant in a database and transmits it to a monitoring device for monitoring the unconventional oil production plant.
Means for Solving the Problems
[0008] According to one aspect of the present invention, a database preprocessing method for an unconventional oil production plant executed by a database preprocessing apparatus is disclosed.
[0009] A database preprocessing method for a non - traditional oil production plant based on an embodiment of the present invention includes the steps of: inputting sensor data from a plurality of sensors installed in the non - traditional oil production plant for monitoring the non - traditional oil production plant; temporarily storing the input sensor data; determining whether previous sensor data exists in the database; when the previous sensor data exists in the database, comparing the temporarily stored sensor data with the previous sensor data; determining whether the temporarily stored sensor data is abnormal data; when it is determined that the temporarily stored sensor data is abnormal data, adding a key value indicating that it is abnormal data to the temporarily stored sensor data; and storing the sensor data with the added key value in the database.
[0010] In the step of determining whether the data is abnormal data, if the difference between the temporarily stored sensor data and the previous sensor data exceeds a preset tolerance value, the temporarily stored sensor data is determined to be abnormal data.
[0011] In the above - mentioned database preprocessing method, when it is determined that the temporarily stored sensor data is not abnormal data, the steps of: determining whether the temporarily stored sensor data matches the previous sensor data; when the temporarily stored sensor data matches the previous sensor data, deleting the temporarily stored sensor data to remove duplicates; and storing the data currently stored in the database as empty data in the database are further included.
[0012] In the above database preprocessing method, in order to transmit the sensor data stored in the database to the monitoring device, there are further steps of reading the sensor data stored in the database, checking whether a key value exists in the read sensor data, when a key value exists in the read sensor data, transmitting an alarm message indicating that the currently transmitted sensor data is abnormal data to the monitoring device, and transmitting the read sensor data to the monitoring device.
[0013] In the above database preprocessing method, when a key value does not exist in the read sensor data, there are further steps of checking whether the read sensor data is empty data, when the read sensor data is empty data, reading the previous sensor data from the database, and transmitting the read previous sensor data to the monitoring device as the current sensor data.
[0014] According to another aspect of the present invention, a database preprocessing device for an unconventional oil production plant is disclosed.
[0015] The database preprocessing device for an unconventional oil production plant according to an embodiment of the present invention includes a memory for storing instructions and a processor for executing the instructions. The instructions include steps of inputting sensor data from a plurality of sensors installed in the unconventional oil production plant for monitoring the unconventional oil production plant, temporarily storing the input sensor data, determining whether previous sensor data exists in the database, when previous sensor data exists in the database, comparing the temporarily stored sensor data with the previous sensor data, determining whether the temporarily stored sensor data is abnormal data, when it is determined that the temporarily stored sensor data is abnormal data, adding a key value indicating that it is abnormal data to the temporarily stored sensor data, and storing the sensor data with the added key value in the database, and executing a database preprocessing method including these steps.
Advantages of the Invention
[0016] The database preprocessing apparatus and method for a non - traditional oil production plant according to an embodiment of the present invention can efficiently store a large amount of sensor data obtained from a large number of sensors installed in each facility of the non - traditional oil production plant into a database for monitoring the non - traditional oil production plant, and transmit it to a monitoring device. By doing so, it enables real - time monitoring of production plant facilities without being restricted by the user environment, allows facility operators to quickly check for abnormal phenomena, and enables stable operation of the production plant.
Brief Description of the Drawings
[0017]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Modes for Carrying Out the Invention
[0018] As used herein, singular expressions shall include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "composed of" or "including" should not be construed as necessarily including all of the multiple components or multiple steps described in the specification. It should be construed that in some cases, some of the components or some of the steps may not be included, or additional components or steps may be further included. Also, terms such as "... part" or "module" described in the specification mean a unit that processes at least one function or operation, which may be realized by hardware or software, or may be realized by a combination of hardware and software.
[0019] Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0020] FIG. 1 is a diagram schematically illustrating the configuration of a monitoring system for a non - traditional oil production plant according to an embodiment of the present invention.
[0021] Referring to FIG. 1, a monitoring system for a non - traditional oil production plant according to an embodiment of the present invention can be configured to include a database pre - processing device (100), a plurality of sensors (200) installed in non - traditional oil production plant facilities (10), a monitoring device (300), and a human - machine interface (HMI) device (400).
[0022] The database pre - processing device (100) executes a function of collecting a large amount of sensor data from a plurality of sensors (200) installed in each facility of the non - traditional oil production plant for monitoring the non - traditional oil production plant facilities (10), efficiently storing the data in the database, and transmitting it to the monitoring device (300).
[0023] A plurality of sensors (200) sense a non - traditional oil production plant facility (10) and generate a large amount of sensor data.
[0024] For example, different from a general oil production plant, in the case of an oil sand production plant, the number of sensors increases rapidly with the increase in processing facilities. Therefore, the database pre - processing device (100) according to an embodiment of the present invention can execute an operation of pre - processing a large amount of sensor data acquired through a plurality of sensors (200) to assist the real - time monitoring of the monitoring device (300) for the non - traditional oil production plant facility (10).
[0025] The monitoring device (300) performs real - time monitoring of the non - traditional oil production plant facility (10) by receiving a large amount of pre - processed sensor data from the database pre - processing device (100) and performing monitoring.
[0026] The human - machine interface device (400) receives the real - time monitoring results regarding the non - traditional oil production plant facility (10) from the monitoring device (300), outputs it, and provides various functions to the user.
[0027] For example, FIG. 2 is a diagram showing an example of a screen output by the human - machine interface device. As shown in FIG. 2, the human - machine interface device (400) can provide one screen for checking the entire production plant and three screens for checking the detailed data of the selected facility.
[0028] That is, the human - machine interface device (400) provides a diagram screen of the non - traditional oil production plant, an in - facility real - time data monitoring screen, a facility specification screen, a data graph visualization screen, a user - to - user message function, and a real - time notification function for abnormal data.
[0029] Here, the diagram screen of the unconventional oil production plant is a monitoring screen configured to enable a quick overview of the main data and production flow of the entire production plant.
[0030] In addition, the in-plant real-time data monitoring screen is a screen that displays detailed data of the selected equipment and also shows previously measured data together with currently measured data so that fluctuations in the data can be checked.
[0031] Furthermore, the equipment specification screen is a screen that displays the 3D model related to the equipment and an image of the on-site equipment, together with the equipment specifications.
[0032] Also, the data graph visualization screen is a screen that visualizes and displays the time-series data of each equipment as a graph.
[0033] Furthermore, the user-to-user message function is a function for sending and receiving messages with various connected users, and in particular provides a message function that enables immediate communication between workers and engineers at the unconventional oil production plant site.
[0034] In addition, the real-time notification function for abnormal data is a function that outputs an error message to the monitoring screen so that users can quickly grasp the abnormal phenomenon of the equipment when abnormal data occurs.
[0035] Figure 3 is a flowchart schematically illustrating a database preprocessing method for an unconventional oil production plant executed by a database preprocessing apparatus according to an embodiment of the present invention.
[0036] In step S310, the database preprocessing apparatus (100) inputs sensor data from a plurality of sensors (200) installed in the unconventional oil production plant equipment (10) for monitoring the unconventional oil production plant equipment (10).
[0037] In the S320 stage, the database preprocessing device (100) temporarily stores the input sensor data.
[0038] In the S330 stage, the database preprocessing device (100) determines whether there is previous sensor data in the database.
[0039] Here, sensor data can be stored in the database in chronological order.
[0040] In the S340 stage, if there is previous sensor data in the database, the database preprocessing device (100) compares the temporarily stored sensor data with the previous sensor data.
[0041] In the S350 stage, based on the result of the comparison, the database preprocessing device (100) determines whether the temporarily stored sensor data is abnormal data.
[0042] That is, if the difference between the temporarily stored sensor data and the previous sensor data exceeds a preset tolerance value, the database preprocessing device (100) can determine the temporarily stored sensor data as abnormal data.
[0043] In the S360 stage, if the database preprocessing device (100) determines that the temporarily stored sensor data is abnormal data as a result of the determination, it adds a key value indicating that it is abnormal data to the temporarily stored sensor data.
[0044] In the S370 stage, the database preprocessing device (100) stores the sensor data with the key value added in the database.
[0045] In the S380 stage, if the database preprocessing device (100) determines that the temporarily stored sensor data is not abnormal data as a result of the determination, it determines whether the temporarily stored sensor data matches the previous sensor data.
[0046] In the S390 stage, if the temporarily stored sensor data matches the previous sensor data as a result of the determination by the database preprocessing device (100), the temporarily stored sensor data is deleted to remove duplicates.
[0047] After that, the database preprocessing device (100) proceeds to the S370 stage and stores the data currently stored in the database as empty data in the database.
[0048] If, as a result of the determination in the S330 stage, there is no previous sensor data in the database, the database preprocessing device (100) stores the temporarily stored sensor data in the database as it is.
[0049] FIG. 4 is a flowchart schematically illustrating a database preprocessing method for a non-conventional oil production plant executed by a database preprocessing device according to another embodiment of the present invention.
[0050] In the S410 stage, the database preprocessing device (100) reads out the sensor data stored in the database in order to transmit the sensor data stored in the database to the monitoring device (300).
[0051] For example, the database preprocessing device (100) can sequentially read out the sensor data stored in the database in chronological order from the initial time point.
[0052] In the S420 stage, the database preprocessing device (100) checks whether there is a key value indicating that the read sensor data is abnormal data.
[0053] In the S430 stage, if there is a key value in the read sensor data, the database preprocessing device (100) transmits an alarm message notifying the monitoring device (300) that the currently transmitted sensor data is abnormal data.
[0054] In the S440 stage, the database preprocessing device (100) transmits the read sensor data to the monitoring device (300).
[0055] Here, the monitoring device (300) can check the key value included in the received sensor data and recognize that the received sensor data is abnormal data.
[0056] In the S450 stage, when there is no key value in the read sensor data, the database preprocessing device (100) checks whether the read sensor data is empty data.
[0057] In the S460 stage, when the read sensor data is empty data, the database preprocessing device (100) reads the previous sensor data from the database.
[0058] After that, the database preprocessing device (100) proceeds to the S440 stage and transmits the read previous sensor data to the monitoring device (300) as the current sensor data.
[0059] As a result of the determination in the S450 stage, when the read sensor data is not empty data, the database preprocessing device (100) transmits the read sensor data to the monitoring device (300) as it is.
[0060] FIG. 5 is a diagram schematically illustrating the configuration of a database preprocessing device for a non - traditional oil production plant according to an embodiment of the present invention.
[0061] Referring to FIG. 5, a database preprocessing device (100) for a non - traditional oil production plant according to an embodiment of the present invention includes a processor (110), a memory (120), a communication unit (130), and an interface unit (140).
[0062] The processor (110) may be a CPU or a semiconductor device that executes processing instructions stored in the memory (120).
[0063] The memory (120) can include various types of volatile or non-volatile storage media. For example, the memory (120) can include ROM and RAM.
[0064] For example, the memory (120) can store instructions for executing a database preprocessing method related to an unconventional oil production plant according to an embodiment of the present invention.
[0065] The communication unit (130) is a means for transmitting and receiving data to and from other devices through a communication network.
[0066] The interface unit (140) can include a network interface and a user interface for connecting to a network.
[0067] On the other hand, the components of the foregoing embodiments can be easily understood from the perspective of a process. That is, each component can be recognized as each process. Also, the processes of the foregoing embodiments can be easily understood from the perspective of the components of the device.
[0068] In addition, the above-described technical content can be realized in the form of program instructions executable through various computer means and can be recorded on a computer-readable medium. The computer-readable medium can include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed and configured for the examples or those well-known and usable by experts in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions such as ROMs, RAMs, and flash memories. Examples of program instructions include machine language codes generated by compilers and high-level language codes executable by a computer using interpreters, etc. The hardware device can be configured to operate as one or more software modules to execute the operations of the examples, and vice versa.
[0069] The above-described embodiments of the present invention are disclosed for illustrative purposes, and those of ordinary skill in the art who have knowledge of the present invention can make various modifications, changes, and additions within the spirit and scope of the present invention. These modifications, changes, and additions should be considered to belong to the following claims.
Explanation of Reference Numerals
[0070] 10: Unconventional oil production plant equipment 100: Database preprocessing device 110: Processor 120: Memory 130: Communication unit 140: Interface unit 200: Multiple sensors 300: Monitoring device 400: Human Machine Interface (HMI) device
Claims
1. In a database preprocessing method for an unconventional oil production plant executed by a database preprocessing device, receiving sensor data input from a plurality of sensors installed in the unconventional oil production plant for monitoring the unconventional oil production plant; temporarily storing the input sensor data; determining whether previous sensor data exists in the database; when previous sensor data exists in the database, comparing the temporarily stored sensor data with the previous sensor data; determining whether the temporarily stored sensor data is abnormal data; when it is determined that the temporarily stored sensor data is abnormal data, adding a key value indicating that it is abnormal data to the temporarily stored sensor data; and A database preprocessing method for an unconventional oil production plant, comprising storing the sensor data with the key value added in the database.
2. The step of determining whether it is the abnormal data is characterized in that when the difference between the temporarily stored sensor data and the previous sensor data exceeds a preset allowable value, the temporarily stored sensor data is determined to be abnormal data. The database preprocessing method for an unconventional oil production plant according to Claim 1.
3. In Claim 1, the database preprocessing method is when it is determined that the temporarily stored sensor data is not abnormal data, determining whether the temporarily stored sensor data matches the previous sensor data; when the temporarily stored sensor data matches the previous sensor data, deleting the temporarily stored sensor data to remove duplicates; and further comprising storing the data stored at the current time as empty data in the database. The database preprocessing method for an unconventional oil production plant according to Claim 1.
4. The database preprocessing method is reading the sensor data stored in the database to transmit the sensor data stored in the database to a monitoring device; checking whether the key value exists in the read sensor data; When a key value exists in the read sensor data, sending an alarm message to the monitoring device to notify that the currently transmitted sensor data is abnormal data; and The method for preprocessing a database related to a non - traditional oil production plant according to claim 1, further comprising the step of sending the read sensor data to the monitoring device.
5. The database preprocessing method is as follows: When no key value exists in the read sensor data, checking whether the read sensor data is empty data; When the read sensor data is empty data, reading previous sensor data from the database; and The method for preprocessing a database related to a non - traditional oil production plant according to claim 4, further comprising the step of sending the read previous sensor data to the monitoring device as the current sensor data.
6. In a database preprocessing device related to a non - traditional oil production plant, A memory for storing instructions; and A processor for executing the instructions, The instructions include: For monitoring the non - traditional oil production plant, inputting sensor data from a plurality of sensors installed in the non - traditional oil production plant; Temporarily storing the input sensor data; Determining whether previous sensor data exists in the database; When the previous sensor data exists in the database, comparing the temporarily stored sensor data with the previous sensor data; Determining whether the temporarily stored sensor data is abnormal data; When it is determined that the temporarily stored sensor data is abnormal data, adding a key value indicating that it is abnormal data to the temporarily stored sensor data; and A database preprocessing device related to a non - traditional oil production plant, characterized by executing a database preprocessing method including storing the sensor data with the added key value in the database.
Citation Information
Patent Citations
Communication equipment
JP2010171791A
Log management device
JP2018156225A
Upper management device, production control system, upper management method and upper management program
JP2022069917A
System and method for optimizing oil sands production process through monitoring of physical properties
KR102594835B1