A parallel operation and maintenance method, device and medium for multi-source data of soil-covered storage tanks

Through Apache Spark, the multi-source data of soil-covered storage tanks is calculated in parallel and analyzed in real time, which solves the problems of slow operation and maintenance results and data association neglect, achieves rapid response and safety improvement, and promptly responds to abnormal tanks.

CN118643457BActive Publication Date: 2024-11-05SHANDONG CHAMBROAD HLDG GRP CO LTD +1
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411132385.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-19
Publication Date
2024-11-05
Estimated Expiration
2044-08-19

AI Technical Summary

Technical Problem

The environment and many types of data are complex in the operation and maintenance of soil-covered storage tanks, which leads to slow operation and maintenance results. The relationship between different types of data may be ignored, resulting in abnormal or dangerous failure to respond in time.

Method used

Apache Spark is used to calculate the storage tank data, soil data and air data separately and parallelly. Through the cross processing of preset time windows, the correlation coefficient is calculated, the data is collected and analyzed in real time, the early warning mechanism is triggered and the operation and maintenance mechanism is activated, including installation pressure and temperature. , moisture sensors and air sensors, monitor storage tank and soil parameters, and promptly respond to combustible gas leakage.

Benefits of technology

Through parallel calculations and real-time analysis, we can reduce data processing delays, quickly locate the source of problems, optimize the storage tank structure and material selection, promptly respond to combustible gas leakage, reduce explosion risks, and improve emergency response speed and operation and maintenance efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118643457B_ABST
    Figure CN118643457B_ABST
Patent Text Reader

Abstract

The present application discloses a parallel operation and maintenance method, equipment and medium for multi-source data of earth-covered storage tanks, and relates to the field of storage tank operation and maintenance technology. The method includes: real-time collection of raw data of earth-covered storage tanks, the raw data including tank data, soil data and air data; using Apache Spark to perform separate parallel calculations on the tank data, soil data and air data to obtain distributed data; cross-processing the distributed data set according to a preset time window to obtain micro-batch data and correlation coefficients; in the event that an abnormal value is found in any of the raw data, distributed data and micro-batch data, triggering an early warning mechanism and starting the corresponding operation and maintenance mechanism. The present application realizes parallel calculation of multi-source data of earth-covered storage tanks through the above method, reduces processing delays and errors caused by large amounts of data, and understanding the linear relationship between variables can enhance the ability to predict tank performance and quickly locate the source of the problem.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of storage tank operation and maintenance, and in particular to a parallel operation and maintenance method, equipment and medium for multi-source data of an earth-covered storage tank. Background Art

[0002] With the continuous development of technologies such as the Internet of Things and big data, the operation and maintenance of earth-covered storage tanks will become more and more intelligent and remotely monitored. By installing sensors and monitoring equipment, the status of the storage tanks can be monitored in real time, potential problems can be discovered and warned in a timely manner, and the efficiency and safety of operation and maintenance can be improved.

[0003] Since covered storage tanks are buried underground, their operating environment is relatively complex and many parameters need to be monitored. For example, environmental factors such as humidity and temperature may interfere with the monitoring equipment and affect the accuracy of the monitoring results. In addition, each parameter may generate a large number of data points, resulting in a significant increase in data dimensions. The correlation and mutual influence between multi-source data make data processing complicated, and there is no time for on-site response.

[0004] Through the above analysis, the problems and defects of the prior art are as follows:

[0005] The operation and maintenance environment of earth-covered storage tanks in the prior art is complex and involves many types of data, which results in slow results and the possibility of ignoring the association between different types of data, resulting in a failure to respond in a timely manner to abnormalities or dangers. Summary of the invention

[0006] The embodiments of the present application provide a parallel operation and maintenance method, device and medium for multi-source data of an earth-covered storage tank, which can solve the problems in the prior art of earth-covered storage tank operation and maintenance, such as complex environment and multiple data types, which lead to slow operation and maintenance results, possible ignoring of the association between different data types, and failure to respond to anomalies or dangers in a timely manner.

[0007] In a first aspect, an embodiment of the present application provides a parallel operation and maintenance method for multi-source data of an earth-covered storage tank, the method comprising: real-time collection of raw data of the earth-covered storage tank, the raw data comprising tank data, soil data and air data; performing separate parallel calculations on the tank data, soil data and air data through Apache Spark to obtain distributed data, the tank data comprising the temperature, pressure and liquid level of the earth-covered storage tank; cross-processing the distributed data set according to a preset time window to obtain micro-batch data and correlation coefficients; when an abnormal value is found in any of the raw data, distributed data and micro-batch data, triggering an early warning mechanism and starting a corresponding operation and maintenance mechanism.

[0008] In one implementation of the present application, Apache Spark is used to perform separate parallel calculations on tank data, soil data, air data, and meteorological data to obtain distributed data, specifically including: calculating the tank data and aligning the tank data with a timestamp to obtain the maximum and minimum values ​​of the tank data, as well as the changing trend of the tank data; calculating the soil data and aligning the soil data with a timestamp to obtain the maximum and minimum values ​​of the soil data, as well as the changing trend of the soil data, the soil data including soil temperature and soil humidity; calculating the air data to obtain the proportions of nitrogen, oxygen, inert gas, and nitrogen dioxide, and judging whether there is combustible gas.

[0009] In one implementation of the present application, distributed data sets are cross-processed according to a preset time window to obtain micro-batch data and correlation coefficients, specifically including: aligning distributed data to a preset time window according to a timestamp, and calibrating the sensor acquisition frequency; performing correlation statistics on the distributed data to obtain the overall change trend of multi-source data of the soil-covered storage tank; based on the fact that the tank pressure includes the tank top pressure, the tank wall pressure and the tank bottom pressure, and the tank temperature includes the internal temperature and the external temperature, any two variables are extracted from the tank pressure and the tank temperature, as well as the soil temperature and the soil moisture, and the correlation coefficient of the two variables is calculated.

[0010] In one implementation of the present application, the method also includes: comparing relevant correlation coefficients to determine whether the correlation coefficient is lower than a preset threshold; if it is lower than the preset threshold, obtaining a sub-component variable; and setting a collection period for the sub-component variable to reduce computing resources.

[0011] In one implementation of the present application, before collecting the raw data of the earth-covered storage tank in real time, the method also includes: installing a pressure sensor on the top, wall and bottom of the earth-covered storage tank, and installing a temperature sensor on the wall; burying a moisture sensor, a temperature sensor, and a pH sensor within a preset distance of the earth-covered storage tank; and installing an air sensor on the soil surface and a preset high point of the earth-covered storage tank.

[0012] In one implementation of the present application, when an abnormal value is found in any of the original data, distributed data, and micro-batch data, an early warning mechanism is triggered and a corresponding operation and maintenance mechanism is started, specifically including: when combustible gas is found, the flame arrester is opened, the inert gas is released, the alarm is activated on site, and the operation and maintenance personnel are notified; when an abnormal value is found in any of the original data, distributed data, and micro-batch data, an early warning mechanism is triggered and the operation and maintenance personnel are notified.

[0013] In one implementation of the present application, the method also includes: introducing meteorological data within a preset time period, the meteorological data including precipitation and temperature; making predictions based on the meteorological data, micro-batch data and correlation coefficients to obtain storage tank data, soil data, and air data for the next preset window.

[0014] In one implementation of the present application, after calculating the air data, the method further includes: partitioning and storing the distributed data, and encrypting the distributed data; after the encryption is completed, configuring permissions and IDs for the distributed data for viewing by corresponding staff.

[0015] In a second aspect, an embodiment of the present application further provides a parallel operation and maintenance device for multi-source data of an earth-covered storage tank, the device comprising at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can: collect raw data of the earth-covered storage tank in real time, the raw data comprising tank data, soil data and air data; perform separate parallel calculations on the tank data, soil data and air data through Apache Spark to obtain distributed data, the tank data comprising the temperature, pressure and liquid level of the earth-covered storage tank; perform cross-processing on the distributed data sets according to a preset time window to obtain micro-batch data and correlation coefficients; and when an abnormal value is found in any of the raw data, distributed data and micro-batch data, trigger an early warning mechanism and start a corresponding operation and maintenance mechanism.

[0016] In a third aspect, an embodiment of the present application further provides a non-volatile computer storage medium for parallel operation and maintenance of multi-source data of an earth-covered storage tank, storing computer executable instructions, wherein the computer executable instructions are configured to: collect raw data of the earth-covered storage tank in real time, wherein the raw data includes tank data, soil data, and air data; perform separate parallel calculations on the tank data, soil data, and air data through Apache Spark to obtain distributed data, wherein the tank data includes the temperature, pressure, and liquid level of the earth-covered storage tank; perform cross-processing on the distributed data sets according to a preset time window to obtain micro-batch data and correlation coefficients; and trigger an early warning mechanism and start a corresponding operation and maintenance mechanism when an abnormal value is found in any of the raw data, distributed data, and micro-batch data.

[0017] The embodiments of the present application provide a parallel operation and maintenance method, device and medium for multi-source data of earth-covered storage tanks. Apache Spark is used to perform parallel calculations on multi-source data of earth-covered storage tanks, monitor and analyze various parameters of earth-covered storage tanks in real time, and reduce processing delays and errors caused by large amounts of data. The correlation coefficient not only quantifies the strength of the relationship, but also understands the linear relationship between variables, which can enhance the ability to predict the performance of the storage tank and quickly locate the source of the problem. Understanding the linear relationship between different variables can optimize the structure and material selection of the storage tank. In the operation and maintenance mechanism, it can respond to combustible gas leaks immediately. When combustible gas is found, the flame arrester is immediately opened and the inert gas is released, which can effectively suppress the fire source and reduce the risk of explosion, protect the safety of personnel and property, and improve the speed of emergency response. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0019] Figure 1 A flowchart of a parallel operation and maintenance method for multi-source data of an earth-covered storage tank provided in an embodiment of the present application;

[0020] Figure 2 A schematic diagram of the internal structure of a parallel operation and maintenance device for multi-source data of an earth-covered storage tank provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0022] The embodiments of the present application provide a parallel operation and maintenance method, equipment and medium for multi-source data of an earth-covered storage tank, which solves the problems in the prior art of earth-covered storage tank operation and maintenance, such as complex environment and multiple data types, which lead to slow operation and maintenance results, possible neglect of the association between different data types, and failure to respond in time to abnormalities or dangers.

[0023] The technical solution proposed in the embodiments of the present application is described in detail below with reference to the accompanying drawings.

[0024] Figure 1 A flow chart of a parallel operation and maintenance method for multi-source data of a soil-covered storage tank provided in an embodiment of the present application. Figure 1As shown, a parallel operation and maintenance method for multi-source data of an earth-covered storage tank provided in an embodiment of the present application specifically includes the following steps:

[0025] First of all, it can be understood that the operation and maintenance process of a storage tank is a complex and meticulous process aimed at ensuring the safe and efficient operation of the storage tank. For example, it is necessary to regularly check the tank top, tank wall, tank bottom, etc. to check for deformation, leakage, perforation, etc. In the embodiment of the present application, deformation, etc. is detected through a pressure sensor, and leakage, etc. is detected through the liquid level height.

[0026] It is understandable that, before collecting the raw data of the soil-covered storage tank in real time, the method may further include:

[0027] Step 01: Install the pressure sensor on the top, wall and bottom of the earth-covered storage tank, and install the temperature sensor on the tank wall.

[0028] In this step, the pressure sensor is used to monitor the pressure changes at different positions of the tank, so as to understand the stability of the tank and the storage status of the internal materials (such as liquid or gas); the temperature sensor monitors the storage conditions of the materials to prevent overheating or freezing.

[0029] Step 02: Bury the moisture sensor, temperature sensor, and pH sensor within the preset distance of the soil-covered storage tank.

[0030] In this step, the preset distance is determined based on factors such as the size of the tank, the type of soil and the groundwater level, and the pH value of the soil is monitored to monitor the chemical properties of the soil and its possible corrosive effects on the tank material.

[0031] Step 03: Install the air sensors on the soil surface and pre-set high points of the covered tank.

[0032] In this step, the preset high point can monitor the changes in air quality in a larger range, especially under the influence of wind direction. It is crucial to monitor the concentration of harmful gases (such as volatile organic compounds (VOCs)) in the air around the storage tank to determine the sealing of the storage tank and prevent the leakage of harmful gases from causing harm to the environment and personnel; or to prevent other flammable gases from being brought in.

[0033] Step 10: Collect the raw data of the soil-covered storage tank in real time, including the storage tank data, soil data and air data.

[0034] In the embodiments of the present application, the real-time collection of the top pressure, wall pressure and bottom pressure of the earth-covered storage tank, the tank temperature, the temperature and humidity of the soil, and the surrounding air composition is taken as an example to specifically illustrate the scheme of the present application. The data collected during the specific implementation shall be based on the actual situation.

[0035] Step 20: Use Apache Spark to perform separate parallel calculations on the tank data, soil data, and air data to obtain distributed data. The tank data includes the temperature, pressure, and liquid level of the soil-covered tank.

[0036] In this step, due to the large amount of data from multiple data sources, the Apache Spark distributed computing framework is used to decompose the complex computing tasks into multiple subtasks and execute them in parallel. In the next step, the data is merged. In the specific implementation, the Spark DataFrame API is used to read the tank data, soil data, and air data; the data is cleaned, converted, and formatted to ensure the consistency and accuracy of the data.

[0037] As an optional embodiment, Apache Spark is used to perform separate parallel calculations on the storage tank data, soil data, air data, and meteorological data to obtain distributed data, which may specifically include:

[0038] Step 201: Calculate the tank data and align the tank data with the timestamp to obtain the maximum and minimum values ​​of the tank data and the change trend of the tank data.

[0039] In this step, the collected top pressure, wall pressure, bottom pressure, and tank temperature of the covered tank are aligned with the timestamps, and the tank data are sorted in the order of the timestamps to obtain a change trend chart, and the current maximum and minimum values ​​of each variable are saved separately and continuously updated.

[0040] Step 202: Calculate the soil data and align the soil data with the timestamp to obtain the maximum and minimum values ​​of the soil data and the change trend of the soil data. The soil data includes soil temperature and soil moisture.

[0041] In this step, the collected soil temperature and soil moisture are aligned with the timestamps, and the soil data are sorted in the order of the timestamps to obtain a change trend chart, and the current maximum and minimum values ​​of each variable are saved separately and continuously updated.

[0042] Step 203: Calculate the air data to obtain the percentages of nitrogen, oxygen, inert gas and nitrogen dioxide, and determine whether there is combustible gas.

[0043] In this step, the air composition is obtained in order to promptly detect whether there is leakage in the storage tank; and the presence of flammable gas around the storage tank is fatal, so it is necessary to check and eliminate the danger in a timely manner.

[0044] Step 30: Perform cross processing on the distributed data set according to the preset time window to obtain micro-batch data and correlation coefficients.

[0045] In this step, a batch processing time window is set in Spark Streaming, such as processing data every 5 seconds or 1 minute, and the variables are counted and the correlation coefficients between the variables are calculated to obtain the time series and correlation of the variables.

[0046] As another optional embodiment, cross-processing the distributed data set according to a preset time window to obtain micro-batch data and correlation coefficients may specifically include:

[0047] Step 301: Align the distributed data to a preset time window according to the timestamp, and calibrate the acquisition frequency of the sensor.

[0048] In this step, since the sensor may drift or age over time, it is necessary to recalibrate regularly to ensure frequency consistency.

[0049] Step 302: Perform correlation statistics on the distributed data to obtain the overall change trend of the multi-source data of the earth-covered storage tank.

[0050] In this step, time series analysis can be used to identify the overall change trend of multi-source data of earth-covered storage tanks, which can be presented in the form of charts.

[0051] Step 303: Based on the fact that the tank pressure includes the tank top pressure, the tank wall pressure and the tank bottom pressure, and the tank temperature includes the internal temperature and the external temperature, any two variables are extracted from the tank pressure and the tank temperature, and the soil temperature and the soil moisture, and the correlation coefficient of the two variables is calculated.

[0052] In this step, the correlation coefficients between different data sources are calculated to evaluate the linear relationship between them to obtain the performance or status that may jointly affect the tank.

[0053] Furthermore, the method may also include: step 304: comparing relevant correlation coefficients to determine whether the correlation coefficients are lower than a preset threshold; step 305: obtaining sub-component variables when they are lower than the preset threshold; step 306: setting a collection period for the sub-component variables to reduce computing resources.

[0054] In this step, for example, a waterproof layer will be laid on the surface of the tank to prevent moisture in the soil from penetrating into the interior of the tank, so changes in variables such as soil and air will not affect the storage tank. At the beginning of operation and maintenance, it is not clear what data to collect in order to measure abnormalities such as leakage and deformation of the storage tank. Therefore, we first adopt the form of "casting a wide net", and then calculate the correlation coefficient between the variables, and eliminate the secondary components with low correlation coefficients to reduce the amount of calculation and make the calculation results tend to be real-time. Furthermore, understanding the linear relationship between different variables can help us optimize the structure and material selection of the storage tank.

[0055] Step 40: When an abnormal value is found in any of the original data, distributed data, and micro-batch data, an early warning mechanism is triggered and a corresponding operation and maintenance mechanism is started.

[0056] As another optional embodiment, when an abnormal value is found in any of the original data, distributed data, and micro-batch data, an early warning mechanism is triggered and a corresponding operation and maintenance mechanism is started, which may specifically include:

[0057] Step 401: When combustible gas is detected, the flame arrester is opened to release the inert gas, the alarm is turned on at the site, and the operation and maintenance personnel are notified.

[0058] In this step, the on-site alarm can be an audible or visual alarm. In specific implementation, different types of fire extinguishing agents can be configured, such as inert gas, dry powder or special foam fire extinguishing agents. The specific selection depends on the properties of the combustible gas and on-site conditions. Furthermore, the fire extinguishing agent can be quickly transported to the leakage point through the pipeline system to form an effective fire extinguishing barrier.

[0059] Step 402: When an abnormal value is found in any of the original data, distributed data, and micro-batch data, an early warning mechanism is triggered and the operation and maintenance personnel are notified.

[0060] In this step, the early warning mechanism can automatically record the timestamp, abnormal type, abnormal value and related equipment information of the abnormal data, and generate an abnormal report for subsequent analysis; automatically adjust the tank operating parameters and start the backup equipment to ensure the safe and stable operation of the tank.

[0061] As another optional embodiment, after calculating the air data, the method may also include: partitioning and storing the distributed data, and encrypting the distributed data; when the encryption is completed, configuring permissions and IDs for the distributed data for viewing by corresponding staff.

[0062] In this step, ensure that only authorized users can access the data they are concerned about.

[0063] As another optional embodiment, the method may further include: introducing meteorological data within a preset time period, the meteorological data including precipitation and temperature; making predictions based on the meteorological data, micro-batch data and correlation coefficients to obtain storage tank data, soil data and air data for the next preset window.

[0064] In this step, machine learning algorithms can be used to predict the next stage and specify response strategies for potential safety hazards. Furthermore, historical data can be trained to continuously optimize the accuracy and response speed of the early warning model and improve operation and maintenance efficiency.

[0065] The above is an embodiment of the method proposed in this application. Based on the same inventive concept, this embodiment of the application also provides a parallel operation and maintenance device for multi-source data of a covered storage tank, and its structure is as follows: Figure 2 shown.

[0066] Figure 2 This is a schematic diagram of the internal structure of a parallel operation and maintenance device for multi-source data of a soil-covered storage tank provided in an embodiment of the present application. Figure 2 As shown, the device includes:

[0067] at least one processor 201;

[0068] and, a memory 202 communicatively connected to the at least one processor;

[0069] The memory 202 stores instructions executable by at least one processor, and the instructions are executed by at least one processor 201, so that the at least one processor 201 can: collect raw data of the earth-covered storage tank in real time, the raw data including tank data, soil data and air data; perform separate parallel calculations on the tank data, soil data and air data through Apache Spark to obtain distributed data, the tank data including the temperature, pressure and liquid level of the earth-covered storage tank; perform cross-processing on the distributed data set according to a preset time window to obtain micro-batch data and correlation coefficients; when an abnormal value is found in any of the raw data, distributed data and micro-batch data, trigger an early warning mechanism and start the corresponding operation and maintenance mechanism.

[0070] Some embodiments of the present application provide corresponding Figure 1 A non-volatile computer storage medium for parallel operation and maintenance of multi-source data of an earth-covered storage tank stores computer executable instructions, wherein the computer executable instructions are configured to: collect raw data of an earth-covered storage tank in real time, wherein the raw data includes tank data, soil data and air data; perform separate parallel calculations on the tank data, soil data and air data through Apache Spark to obtain distributed data, wherein the tank data includes the temperature, pressure and liquid level of the earth-covered storage tank; perform cross-processing on the distributed data set according to a preset time window to obtain micro-batch data and correlation coefficients; and trigger an early warning mechanism and start a corresponding operation and maintenance mechanism when an abnormal value is found in any of the raw data, distributed data and micro-batch data.

[0071] Each embodiment in this application is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the IoT device and medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0072] The system and medium provided in the embodiments of the present application correspond one-to-one to the method. Therefore, the system and medium also have similar beneficial technical effects to the corresponding methods. Since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the system and medium will not be repeated here.

[0073] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0074] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0075] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0076] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0077] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0078] Memory may include non-permanent storage in a computer-readable medium, in the form of random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0079] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0080] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0081] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A parallel operation and maintenance method for multi-source data of earth-covered storage tanks, characterized in that: The method comprises: The pressure sensor is installed on the tank top, tank wall and tank bottom of the earth-covered storage tank, and the temperature sensor is installed on the tank wall; The moisture sensor, temperature sensor, and pH sensor are buried within a preset distance of the soil-covered storage tank; Install air sensors on the soil surface and pre-set high points of the covered tank; Collecting raw data of the soil-covered storage tank in real time, wherein the raw data includes storage tank data, soil data and air data; Using Apache Spark, the storage tank data, soil data, and air data are separately and parallelly calculated to obtain distributed data, wherein the storage tank data includes the temperature, pressure, and liquid level of the soil-covered storage tank; The storage tank data, soil data, air data and meteorological data are separately calculated in parallel by Apache Spark to obtain distributed data, including: Calculating the tank data, and aligning the tank data with a timestamp, obtaining a maximum value and a minimum value of the tank data, and obtaining a change trend of the tank data; Calculating the soil data and aligning the soil data with a timestamp to obtain a maximum value and a minimum value of the soil data, as well as a change trend of the soil data, wherein the soil data includes soil temperature and soil moisture; Calculating the air data to obtain the proportions of nitrogen, oxygen, inert gas and nitrogen dioxide, and determining whether there is combustible gas; Cross-processing the distributed data set according to a preset time window to obtain micro-batch data and correlation coefficients; When an abnormal value is found in any of the original data, distributed data and micro-batch data, an early warning mechanism is triggered and a corresponding operation and maintenance mechanism is started; When an abnormal value is found in any of the original data, distributed data and micro-batch data, an early warning mechanism is triggered and a corresponding operation and maintenance mechanism is started, including: If flammable gas is found, open the flame arrester, release the inert gas, activate the alarm on site, and notify the operation and maintenance personnel; When an abnormal value is found in any of the raw data, distributed data, and micro-batch data, an early warning mechanism is triggered and the operation and maintenance personnel are notified; Introducing meteorological data within a preset time period, the meteorological data including precipitation and temperature; According to the meteorological data, micro-batch data and correlation coefficients, the historical data is trained and predicted using a machine learning algorithm to obtain the storage tank data, soil data and air data of the next preset window.

2. The parallel operation and maintenance method of multi-source data of earth-covered storage tanks according to claim 1 is characterized in that: The distributed data set is cross-processed according to a preset time window to obtain micro-batch data and correlation coefficients, specifically including: According to the timestamp, the distributed data is aligned to a preset time window, and the acquisition frequency of the sensor is calibrated; Performing correlation statistics on the distributed data to obtain the overall change trend of multi-source data of the earth-covered storage tank; Based on the fact that the tank pressure includes the tank top pressure, the tank wall pressure and the tank bottom pressure, and the tank temperature includes the internal temperature and the external temperature, any two variables are extracted from the tank pressure and the tank temperature, and the soil temperature and the soil moisture, and the correlation coefficient of the two variables is calculated.

3. The parallel operation and maintenance method of multi-source data of earth-covered storage tanks according to claim 2 is characterized in that: The method further comprises: Comparing the correlation coefficients to determine whether the correlation coefficients are lower than a preset threshold; When it is lower than the preset threshold, the sub-component variable is obtained; A collection period is set for the sub-component variables to reduce computing resources.

4. The parallel operation and maintenance method of multi-source data of earth-covered storage tanks according to claim 1 is characterized in that: After calculating the air data, the method further includes: Partitioning and storing the distributed data, and encrypting the distributed data; When the encryption is completed, permissions and IDs are configured for the distributed data for viewing by corresponding staff.

5. A parallel operation and maintenance device for multi-source data of earth-covered storage tanks, characterized in that: The device comprises: at least one processor; and, a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to: Execute any process of the parallel operation and maintenance method of multi-source data of an earth-covered storage tank as described in claims 1-4.

6. A non-volatile computer storage medium for parallel operation and maintenance of multi-source data of earth-covered storage tanks, storing computer executable instructions, characterized in that: The computer executable instructions are configured to: Execute any process of the parallel operation and maintenance method of multi-source data of an earth-covered storage tank as described in claims 1-4.

Citation Information

Cited By

  • An intelligent monitoring and operation platform and method for a covering tank based on digital twinning

    CN120524772B