Plant management method, plant management apparatus, and plant management program

Abstract

To provide a plant management method, a plant management device and a plant management program for improving the accuracy of simulation while suppressing the increase of costs.SOLUTION: The plant management method includes a three dimensional model generation step of generating a three dimensional model of a plant facility in a virtual space on a computer based on design information regarding the plant facility in a real space, a situation image acquisition step of acquiring information regarding a situation of the plant facility as image information, and a storage step of storing the information regarding the situation of the plant facility acquired as the image information in association with a corresponding portion of the three dimensional model.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a plant management method, a plant management device, and a plant management program. [Background technology]

[0002] For example, Patent Document 1 discloses a water quality abnormality detection device for a power plant that can detect water quality abnormalities or signs of abnormalities. This water quality abnormality detection device is provided corresponding to the equipment that constitutes the power plant and includes: a plant model that is capable of calculating water quality information related to the quality of feedwater based on operating data of the power plant and internal parameters that indicate the internal state of the equipment; an acquisition unit that acquires operating data from the power plant; a calculation unit that calculates internal parameters that correspond to the current internal state of the equipment based on the operating data and the water quality information calculated from the plant model to calculate operating internal parameters; and a determination unit that determines whether there is a water quality abnormality or signs of abnormality based on reference internal parameters that serve as references in a normal operating state and the operating internal parameters.

[0003] A technology called digital twin is becoming more widespread. It uses design data for equipment and facilities to generate 3D models in a virtual space, obtains information in real time about the operating status and environmental information of the actual equipment and facilities in the real world, and feeds that information back into the 3D model in the virtual space to perform simulations, enabling design improvements, operational instructions according to the environment, and failure prediction.

[0004] For example, Patent Document 2 describes a technology that faithfully simulates an actual power system by generating a simulation model of the power system, including a model that reproduces each subsystem, based on data on electrical quantities stored in a data collection server, and updating the model based on changes in the electrical quantities. This technology can quantitatively indicate the stability of the current power system, such as how robust the current power system is against disturbances such as system faults. This makes it possible to present the minimum necessary measures more economically when upgrading the system or power equipment. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2019-144751 [Patent Document 2] Japanese Patent Application Publication No. 2019-154201 Summary of the Invention [Problem to be solved by the invention]

[0006] However, when using digital twin technology for plant management, for example, when capturing the vibration and temperature states of equipment using vibration and temperature sensors, only information at the measurement points can be obtained. If more data is to be acquired, it is necessary to deploy many sensors, which makes this difficult to achieve due to factors such as increased costs. On the other hand, when there are fewer sensors, the information obtained is limited, making it difficult to improve the accuracy of the simulation.

[0007] An object of the present invention is to provide a plant management method, a plant management device, and a plant management program that can increase the accuracy of simulations while suppressing increases in costs. [Means for solving the problem]

[0008] In order to achieve the above object, the plant management method of the present invention comprises: a 3D model generation step of generating a 3D model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space; a situation image acquisition step of acquiring information about the situation of the plant equipment as image information; a storage step of storing information about the status of the plant equipment acquired as the image information in association with a corresponding portion of the three-dimensional model; a superimposition display step of generating an image of a corresponding portion of the 3D model, which is stored in association with information about the status of the plant equipment, based on the 3D model of the plant equipment, and displaying the information about the status of the plant equipment superimposed on the corresponding portion; a map display step of displaying a map of the plant facility including the corresponding location; Equipped with.

[0009] The plant management device according to the present invention comprises: a generation unit that generates a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in a real space; an acquisition unit that acquires information about the status of the plant equipment as image information; a storage unit that stores information about the status of the plant equipment acquired as the image information in association with a corresponding location of the three-dimensional model; a display unit that displays an image of a corresponding portion of the three-dimensional model of the plant equipment, the image being generated based on the three-dimensional model of the plant equipment, the image being stored in association with information about the status of the plant equipment, with the information about the status of the plant equipment superimposed on the corresponding portion, and also displays a map of the plant equipment including the corresponding portion; Equipped with.

[0010] The plant management program according to the present invention comprises: A process of generating a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space; A process of acquiring information about the status of the plant equipment as image information; a process of storing information about the status of the plant equipment acquired as the image information in association with a corresponding location of the three-dimensional model; generating an image of a corresponding portion of the 3D model, which is stored in association with information about the status of the plant equipment, based on the 3D model of the plant equipment, and displaying the information about the status of the plant equipment by superimposing it on the corresponding portion; a process of displaying a map of the plant facility including the corresponding location; to be executed by the computer. [Effects of the Invention]

[0011] According to the present invention, it is possible to improve the accuracy of the simulation while suppressing an increase in cost. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a diagram illustrating a schematic configuration of a plant management device according to an embodiment of the present invention. [Figure 2] FIG. 10 is a diagram showing an example of a situation image displayed superimposed on an image of a three-dimensional model. [Figure 3] FIG. 10 is a diagram illustrating an example of situation information stored in association with position coordinates of a three-dimensional model. [Figure 4] FIG. 10 is a diagram showing an example of displaying information contained in each pixel of a situation image superimposed on a corresponding position on a plant image. [Figure 5] 1 is a flowchart illustrating an example of a plant management method according to an embodiment of the present invention. [Figure 6] 10 is a flowchart illustrating another example of a plant management method according to an embodiment of the present invention. [Figure 7] 10 is a diagram showing an example of situation information displayed superimposed on a plant image from a viewpoint. [Figure 8] FIG. 2 is a diagram schematically showing the configuration of a plant management device according to a first modified example of the present embodiment. [Figure 9] FIG. 10 is a diagram schematically showing the configuration of a plant management device according to a second modification of the present embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of maintenance information stored in association with a three-dimensional model. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a schematic configuration of a plant management device 1 according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of a situation image displayed superimposed on an image of a three-dimensional model. In the following description, information relating to the situation of plant equipment P may be referred to as "situation information." Furthermore, image information within the situation information may be referred to as "situation image." Furthermore, a situation image captured by an imaging device may be referred to as "captured image."

[0014] As shown in FIG. 1, the plant management device 1 includes an input unit 12, an infrared camera 14 (imaging device), a control unit 20, a storage unit 30, and a display unit 40.

[0015] The input unit 12 inputs various data (for example, design information and measurement information related to the plant equipment P).

[0016] The infrared camera 14 captures infrared light emitted from the plant equipment P and its background. The infrared camera 14 may be installed at a predetermined location within the plant equipment P (fixed type), may be arranged so that it can be transported (portable type), may be mounted on a small unmanned aerial vehicle (drone type), or may be mounted on a robot that automatically patrols the plant equipment P (patrol photography robot type).

[0017] The infrared camera 14 periodically transmits the infrared images of the plant equipment P that it has captured to the control unit 20. The storage unit 30 stores the infrared images and accompanying information about the location and direction of the infrared camera 14 that accompanies the infrared images.

[0018] The visible light camera 16 captures visible light reflected from the plant equipment P. The acquisition unit 24 acquires the imaging location and imaging direction of the visible light camera 16. The visible light camera 16 may be installed at a predetermined location within the plant equipment P (fixed type), may be arranged so that it can be transported (portable type), may be mounted on a small unmanned aerial vehicle (drone type), or may be mounted on a robot that automatically patrols the plant equipment P (patrol imaging robot type).

[0019] The visible light camera 16 periodically transmits the captured visible light images of the plant equipment P to the control unit 20. The storage unit 30 stores the visible images and accompanying information relating to the location and direction of the image captured by the visible light camera 16. It is preferable that the visible light camera 16 captures images from the same location and in the same direction as the infrared camera 14. The visible light camera 16 and the infrared camera 14 may be configured as an integrated unit.

[0020] The control unit 20 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The CPU reads a program corresponding to the processing content from the ROM, loads it into the RAM, and works with the loaded program to centrally control the operation of each block of the plant management device 1. At this time, various data stored in the storage unit 30 is referenced. The storage unit 30 is configured, for example, with a non-volatile semiconductor memory (so-called flash memory) or a hard disk drive.

[0021] The control unit 20 transmits and receives various data to and from devices (e.g., the infrared camera 14 and the visible light camera 16) connected to a communication network such as a LAN (Local Area Network) or a WAN (Wide Area Network) via the communication unit. The control unit 20 realizes the functions of the generation unit 22, the acquisition unit 24, the alignment unit 26, and the image generation unit 28, for example, based on various data transmitted from external devices.

[0022] The generation unit 22 generates a three-dimensional model in a virtual space on a computer based on various data input by the input unit 12. Here, the various data include the layout of the plant facility P as a whole (including position coordinates), the positions and shapes of the components that make up the plant facility P, information on refined products in the plant facility P (for example, in the case of gas, the type, flow rate in the piping, pressure, temperature, etc.), design information for the plant facility P, and measurement data for the plant facility P (environmental data such as temperature, humidity, sunlight conditions, wind speed, and air pressure).

[0023] The acquisition unit 24 acquires information (situation information) related to the status of the plant equipment P as a situation image. For example, if the information related to the status of the plant equipment P is temperature information or fluid leakage information, the acquisition unit 24 acquires an infrared image (situation image) of the plant equipment P captured by the infrared camera 14. The acquisition unit 24 also acquires the imaging point and imaging direction of the infrared camera 14. The acquisition unit 24 also acquires a visible light image (situation image) of the plant equipment P captured by the visible light camera 16. The acquisition unit 24 also acquires the imaging point and imaging direction of the visible light camera 16.

[0024] The image processing and analysis unit 25 extracts an image of the gas leakage area (extracted image) and a temperature image by processing the infrared image captured by the infrared camera 14. The image processing and analysis unit 25 also extracts an image of a rust area (extracted image) showing the occurrence of rust on the plant equipment P, an image of a deformed area (extracted image) showing the deformation of the external shape of the plant equipment P, or an image of a vibration area (extracted image) showing the vibration of the plant equipment P by processing and analyzing the visible light image captured by the visible light camera 16. In the following description, the situation image includes an image of the gas leakage area (extracted image) and a temperature image extracted from the infrared image (original image) by image processing. The situation image also includes an image of the rust area (extracted image), an image of a deformed area (extracted image), or a vibration image of the plant equipment P (extracted image) extracted from the visible light image (original image).

[0025] Furthermore, the image processing and analysis unit 25 obtains spatial coordinate information of the gas cloud spreading in space and information on the gas leakage position (situation information) from the image of the gas leakage area. The leakage position can be estimated by a known method, such as the method described in Japanese Patent No. 6620878.

[0026] The image processing and analysis unit 25 converts the value of each pixel of the captured infrared image (situation image) based on a predetermined formula, thereby obtaining temperature information (situation information) of the component parts.

[0027] The image processing and analysis unit 25 analyzes the captured visible light image (situation image) to obtain information (amplitude and frequency) about vibrations of components such as pipes that make up the plant equipment. A method for obtaining vibration information is described in, for example, International Publication WO2018207528.

[0028] The image processing and analysis unit 25 analyzes the captured visible light image (situation image) to obtain rust information (situation information) on the appearance of components such as pipes that make up the plant equipment. The occurrence of rust can be recognized, for example, by using color information in the image.

[0029] The image processing and analysis unit 25 analyzes the captured visible light image (situation image) to obtain deformation information (situation information) regarding the appearance of components such as pipes that make up the plant equipment. The occurrence of deformation can be obtained, for example, by comparing the captured image with design information of the plant equipment P. Alternatively, it can be obtained by using a camera that can obtain three-dimensional information of the object being photographed and comparing the obtained three-dimensional shape of the object being photographed with the design information of the plant equipment P. The three-dimensional information can be obtained, for example, using a distance measurement method based on triangulation or a distance measurement method that utilizes the speed of light.

[0030] The positioning unit 26 associates the position of each pixel of multiple types of situation images (images of gas leak areas, images of rust areas, etc.) with a position in the coordinates of the 3D model. In the following description, associating a situation image with a 3D model means associating the position of each pixel of the situation image with a position in the coordinates of the 3D model.

[0031] The storage unit 30 stores information (status information) relating to the status of the plant equipment P in association with a corresponding location in the three-dimensional model. Specifically, the storage unit 30 stores an infrared image of the plant equipment P taken by the infrared camera 14 in association with the three-dimensional model. The storage unit 30 also stores a visible light image of the plant equipment P taken by the visible light camera 16 in association with the three-dimensional model.

[0032] FIG. 3 is a diagram illustrating an example of situation information stored in association with the position coordinates of a three-dimensional model. As shown in FIG. 3, the storage unit 30 stores the photographing date and time as additional information. The storage unit 30 also stores the surface temperature (°C), the presence or absence of gas leakage, and the presence or absence of rust as situation information. As shown in FIG. 3, "20," "40," and "25" in the surface temperature column indicate the surface temperature (°C), while "0" in the gas leakage column indicates no gas leakage and "1" indicates the presence of gas leakage. The three-dimensional spatial extent (spatial coordinates) of the gas cloud is also stored (not shown) in association with the gas leakage position. The spatial coordinates of the gas cloud can be calculated from infrared images captured from multiple positions. If only infrared images from one direction are available, the calculation may be performed assuming that the depth extent is the same as the left-right extent. Alternatively, the captured infrared image (including video) or an image of the gas cloud extracted by image processing may be stored in association with the gas leakage position. A "0" in the rust column indicates no rust, and a "1" indicates rust. The rust state may be stored in multiple stages.

[0033] The image generating unit 28 generates an image of the plant equipment P from a predetermined viewpoint (hereinafter referred to as a plant image) based on the three-dimensional model.

[0034] The display unit 40 displays information contained in each pixel of the situation image by superimposing it at the corresponding position on the plant image.

[0035] FIG. 4 illustrates an example in which information contained in each pixel of a situation image is superimposed on a corresponding position on a plant image. In the example illustrated in FIG. 4, the plant image is an image of a gas tank. The situation image is an image showing the state of a gas leak (here, a gas cloud). The gas cloud is a computer graphics (CG) image generated based on the spatial coordinates of the gas cloud stored in the storage unit 30. A map of the plant equipment P (a 3D model plan view) is displayed at the bottom of the display screen. The viewpoint position of the infrared camera 14 is indicated by a black circle in the 3D model plan view. A height bar specifying the viewpoint height is displayed to the right of the 3D model plan view. The plant image's field of view range from the viewpoint (black circle) is indicated by a dashed line in the plan view. A diagram of a combination of ellipses indicating the viewpoint direction is displayed at the bottom right of the display screen. The viewpoint direction and the display field of view can be changed by operating the mouse on the plant image. Alternatively, they may be changed by moving the black circle and the height bar in the plan view. The display field of view may also be changed using the + and - buttons.

[0036] The components of the control unit 20 may be connected via a network, and for example, the three-dimensional model may be stored on the cloud. The control unit 20 may also be located on the cloud. The control unit 20 may be made up of multiple CPUs, which may be connected via a network to operate as a single unit. The storage unit 30 may also be configured as multiple distributed units. The display unit 40 may also be located within the plant equipment P. The display unit 40 may also be located in a central monitoring room at the head office, etc., to centrally manage the plant equipment P in various locations.

[0037] Next, an example of a plant management method according to an embodiment of the present invention will be described. Fig. 5 is a flowchart showing an example of a plant management method according to an embodiment of the present invention. This flow starts when the CPU loads a plant management program into the RAM. Note that the description will be given assuming that the control unit 20 executes each function of the generation unit 22, acquisition unit 24, image processing / analysis unit 25, alignment unit 26, etc.

[0038] First, as an example of a plant management method, steps from the start of this flow to storing situation information will be described with reference to Fig. 5. Here, an image of a gas leakage area (situation image) will be used as an example of situation information.

[0039] In step S100, the control unit 20 generates a three-dimensional model of the plant equipment P in a virtual space on the computer based on at least one of design information and measurement information related to the plant equipment P. The design information includes three-dimensional shape and position information of the plant equipment P. The measurement information includes three-dimensional shape and position information of the plant equipment P measured by a three-dimensional measuring device using a laser or the like.

[0040] Next, in step S110, the control unit 20 acquires an infrared image.

[0041] Next, in step S120, the control unit 20 extracts an image of the gas leakage area (extracted image) from the infrared image by image processing, and also estimates the leakage position from the image of the gas leakage area.

[0042] Next, in step S130, the control unit 20 associates the image of the gas leakage area and the leakage position with the three-dimensional model.

[0043] As a method for associating the image of the gas leak area with the 3D model, for example, the photographing location of the infrared camera 14 is acquired using a GPS (Global Positioning System), an altitude sensor, etc. The photographing direction of the infrared camera 14 is acquired using an acceleration sensor, a gyro sensor (angular velocity sensor), a geomagnetic sensor, etc. The acquired photographing location and photographing direction are applied to the 3D model of the plant equipment P, and the camera's field of view range is cropped from the plant image generated from the 3D model based on the camera's field of view information (information on the focal length and image sensor size), thereby obtaining a plant image with the same viewpoint and field of view as the photographed image. Alternatively, the equipment in the photographed image may be recognized, for example, by pattern recognition based on information on the photographing location and shape information of the plant equipment P. This makes it possible to associate each pixel of the situation image (photographed image) with the 3D model of the plant equipment P. Furthermore, information for each pixel extracted from the situation image (information possessed by the pixel in the situation image) can be incorporated into the 3D model as information on the situation of the plant equipment P at the position corresponding to the pixel.

[0044] Next, in step S140, the storage unit 30 stores the image of the gas leak area and the leak position in association with the corresponding location in the three-dimensional model, after which the flow shown in FIG.

[0045] Next, the steps up to displaying status information (here, information on gas leakage areas) on a plant image will be described with reference to FIG. 6. FIG. 6 is a flowchart showing another example of a plant management method according to an embodiment of the present invention. This flow starts when the CPU loads a plant management program into RAM. Note that the description will be given assuming that the control unit 20 executes the functions of the image generation unit 28, etc.

[0046] In step S200, the control unit 20 determines whether or not a viewpoint for creating a three-dimensional model has been designated.

[0047] In step S210, the control unit 20 reads out the data of the three-dimensional model from the storage unit 30, generates a plant image from the specified viewpoint, and causes the display unit 40 to display it.

[0048] In step 220, the control unit 20 determines whether any of the status information (surface temperature, gas leakage, presence or absence of rust, vibration, etc.) to be displayed superimposed on the plant image has been designated.

[0049] In step S230, the control unit 20 flashes the leak position (red target mark) at the corresponding position on the plant image based on the specified status information (here, gas leak), and displays a gas cloud in CG at the corresponding position on the plant image. Then, the flow shown in FIG. 6 ends. After that, the process may return to step S200.

[0050] FIG. 7 illustrates another example of status information superimposed on a corresponding position on the plant image P (plant image) from a viewpoint. As shown in FIG. 7, the plant image from the viewpoint is displayed, and status information (here, temperature distribution) is superimposed on the corresponding position on the plant image. In FIG. 7, different temperatures are represented by different hatching patterns. The amount of stored liquid can be recognized from the temperature information (shown by black areas in FIG. 7). The display screen also displays buttons for displaying temperature, vibration, rust, and gas leak information. By specifying the information to be displayed, the information can be superimposed on the plant image. When "temperature" is selected, the measured temperature is displayed in multiple colors, ranging from low (purple) to high (red). When "vibration" is selected, for example, areas where vibration exceeds a predetermined value are displayed with a flashing display. The amplitude of the vibration may also be displayed in multiple colors. When "rust" is selected, for example, rusted areas are displayed with a flashing red display. The degree of rust may also be displayed with multiple colors. When "gas leak" is selected, the leak location is displayed, for example, with a flashing red target mark. A plurality of pieces of information may be displayed on the plant image. By specifying a plurality of switching buttons, the specified pieces of information are displayed simultaneously.

[0051] The plant management method in this embodiment includes a three-dimensional model generation step of generating a three-dimensional model of plant equipment in a virtual space on a computer based on design information related to the plant equipment in real space, a situation image acquisition step of acquiring information related to the status of the plant equipment as image information, and a storage step of storing the information related to the status of the plant equipment acquired as image information in association with a corresponding location in the three-dimensional model.

[0052] With the above configuration, information (status information) about the status of the plant equipment P is acquired as status images, so that many status images can be acquired at low cost compared to the case where many sensors are arranged to detect information about the status of the plant equipment P. This makes it possible to suppress increases in costs. In addition, it becomes possible to incorporate a large amount of status information as data into a 3D model of the plant at once, which improves the accuracy of various simulations such as operation simulations and deterioration simulations of the plant equipment P.

[0053] Furthermore, the plant management method of this embodiment acquires infrared images of the plant equipment P from multiple viewpoints by photographing the plant equipment P using multiple infrared cameras 14 arranged at different positions, a patrol photography robot, or a drone. Because infrared images are obtained from multiple viewpoints, information about the plant equipment P can be obtained from various directions. Therefore, all information about the plant equipment P can be acquired. Furthermore, when a gas leak is photographed, the position of the gas leak and the spread of the gas cloud in three-dimensional space can be calculated from the images from multiple viewpoints, making it possible to capture the gas leak area of ​​the plant equipment P in three dimensions.

[0054] Furthermore, the plant management method of this embodiment allows information obtained from many infrared images (for example, temperature information, gas leak information) and information from visible images (rust and vibration information) to be input into a 3D model and used to simulate the plant status, making it possible to easily improve the accuracy of the simulation.

[0055] (Variation 1) Next, a modified example of this embodiment will be described. In the description of the modified example, differences from the above embodiment will be mainly described, and the same components will be assigned the same reference numerals and descriptions thereof will be omitted.

[0056] First, a first modification of the present embodiment will be described with reference to Fig. 8. Fig. 8 is a diagram schematically illustrating the configuration of a plant management device 1 according to the first modification of the present embodiment. As shown in Fig. 8, the plant management device 1 according to the first modification includes a transparent eyeglass-type terminal 50 (hereinafter referred to as smart glasses) that transmits a view of the plant facility. The smart glasses 50 transmit and receive data to and from a control unit 20 via a communication line such as a LAN (Local Area Network) or an Internet line. Note that Fig. 8 omits the transmission and reception units provided in the control unit 20 and the smart glasses 50.

[0057] The smart glasses 50 include an area specifying unit 52 and a projection unit 54. The smart glasses 50 have a lens unit that transmits the view of the plant equipment P.

[0058] The area identification unit 52 identifies the position and line of sight direction (i.e., field of view) of the worker based on the position coordinates and inclination of the smart glasses 50 (lens unit) worn by the worker relative to the coordinate axes.

[0059] The control unit 20 receives information about the position coordinates and inclination of the smart glasses 50 (lens unit) relative to the coordinate axes from the smart glasses 50. The acquisition unit 24 acquires information about the status of the plant equipment within the field of view of the worker as a status image (for example, an infrared image captured by the infrared camera 14).

[0060] The image processing and analysis unit 25 extracts a gas cloud image showing the gas leakage area from the infrared image.

[0061] The control unit 20 associates the gas cloud image with the three-dimensional data of the plant equipment P and stores it.

[0062] The alignment unit 26 generates an image (plant image) of the plant equipment P seen through the smart glasses 50 based on the position coordinates and inclination of the smart glasses 50 (lens unit) relative to the coordinate axes, and associates the plant image with the scene seen through the smart glasses.

[0063] The control unit 20 reads out the gas cloud data associated with the three-dimensional data of the plant equipment P from the storage unit 30, and controls the projection unit 54 so that a gas cloud image is projected onto the lens unit in association with the scene seen through the smart glasses 50. Note that the control unit 20 may also control the projection unit 54 so that an image indicating the gas leak location, gas flow rate, and gas flow direction is projected onto the lens unit instead of the gas cloud image.

[0064] The plant management device 1 according to the first modification includes smart glasses 50 that project a gas cloud image onto a lens that transmits the view of the plant equipment P. This allows, for example, hydrocarbon gases that transmit visible light and cannot be seen by the naked eye to be visualized through the smart glasses 50, making it possible to instantly and accurately visually identify gases that pose a risk of explosion.

[0065] In the plant management device 1 according to the first modification, the smart glasses 50 may have each function of the control unit 20.

[0066] (Variation 2) Next, a plant management device 1 according to Modification 2 will be described with reference to Fig. 9. Fig. 9 is a diagram schematically showing the configuration of a plant management device according to Modification 1 of the present embodiment. In the description of Modification 2, configurations different from those of the above-described embodiment will be mainly described, and the same configurations will be assigned the same reference numerals and descriptions thereof will be omitted.

[0067] The plant management device 1 according to the second modification includes a simulation execution unit 66 and a maintenance information creation unit 68 in addition to the configuration of the above-described embodiment.

[0068] The simulation execution unit 66 simulates the deterioration of the plant equipment P based on the 3D model and the history of situation images and situation information continuously stored in the storage unit 30. Here, the deterioration of the plant equipment P refers to the deterioration of the plant equipment P and each of the components of the plant equipment P, and includes, for example, metal fatigue, scratches, rust, the spread of deformation, and the risk of failure.

[0069] Based on the results of the simulation, the maintenance information creation unit 68 creates maintenance information regarding the location, timing, and content of maintenance required for the plant equipment P. The storage unit 30 stores the maintenance information in association with the three-dimensional model.

[0070] FIG. 10 is a diagram showing an example of maintenance information stored in association with a three-dimensional model. As shown in FIG. 10, the storage unit 30 stores a maintenance history for a specific component (e.g., pipe 1), such as the time when maintenance was performed and the details of the maintenance. Also, a maintenance schedule, such as the next maintenance time and details based on a simulation or the like, is stored. As shown in FIG. 10, pipe 1 was replaced on March 5, 2018 and March 10, 2019, and a replacement schedule for April 2020 is stored.

[0071] The display unit 40 displays the maintenance information superimposed on the image of the three-dimensional model. Specifically, as shown in Fig. 2, the display unit 40 displays the maintenance information for "inspection date 20xx year xx month" superimposed on the image of the three-dimensional model.

[0072] The plant management device 1 according to the second modification includes a simulation execution unit 66 that simulates the deterioration of the plant equipment P based on a 3D model and continuously stored status images and status information history. The simulation execution unit 66 simulates, for example, the degree of metal fatigue based on the temperature information, vibration information, rust information, deformation information, and historical information on changes therein stored in the storage unit 30, as well as measurement information from various sensors installed in the plant equipment P, and predicts future conditions based on the changes. For example, with temperature information, the degree of deterioration is determined by taking into account the location of abnormal temperatures, the number of times abnormal temperatures have occurred, and the amplitude and number of temperature change cycles. For example, with vibration information, the abnormal state and degree of deterioration are determined by the location of vibration occurrence, vibration amplitude, and vibration frequency. Furthermore, the degree of deterioration is determined based on the rust and deformation of pipes, for example. In addition to the appearance information, the simulation execution unit 66 can estimate the progression of pipe deterioration by taking into account design information and measurement information, such as the flow rate and pressure of the fluid flowing through the pipe, and the pipe's material and thickness. The surface condition of the plant equipment P is obtained based on a situation image, and the deterioration of the plant equipment is simulated using the information contained in the situation image, so it is possible to obtain precise simulation results at low cost compared to simulations based on the detection results of multiple sensors.

[0073] Furthermore, the plant management device 1 according to the second modification includes a maintenance information creation unit 68 that creates maintenance information related to the plant equipment based on the results of the simulation. As a result, the maintenance information displayed superimposed on the image of the 3D model can be used as an effective reference for planning maintenance. Furthermore, as shown in FIG. 2, by displaying the maintenance information superimposed on the image of the 3D model, it is possible to easily identify locations with a low risk of failure.

[0074] The plant management device 1 according to the second modification may include the smart glasses 50 according to the first modification (see FIG. 8). In the second modification, by including the smart glasses 50, it is possible to display temperature information, vibration information, and the like as information relating to the status of the plant equipment P on the smart glasses 50 (lens unit).

[0075] In the above embodiment, the deterioration prediction of the plant equipment P is performed based on the results of a simulation, but the present invention is not limited to this, and the prediction may be performed using artificial intelligence (AI).

[0076] Furthermore, in the above embodiment, the information superimposed on the 3D model includes deterioration prediction and maintenance information for the plant equipment P. However, as an application example of the present invention, information on potential hazardous locations related to deterioration prediction may also be used. For example, if a location in a pipe that is not normally hot becomes hot, or if deformation such as rust or dents occurs, it may be determined that there is a risk of damage, and this information may be superimposed on the 3D model. Furthermore, various information such as the temperature distribution, vibration distribution, leak location, rust location, and deformation location and amount of equipment (e.g., pipes) of the plant equipment P may be used to rank the risk of deterioration or abnormality, and the risk may be superimposed on the 3D model.

[0077] Furthermore, the above-described embodiments are merely examples of specific embodiments for carrying out the present invention, and the technical scope of the present invention should not be construed as being limited by these embodiments. In other words, the present invention can be carried out in various forms without departing from the gist or main features thereof.

[0078] The entire disclosures of the specification, drawings and abstract contained in Japanese Patent Application No. 2020-122165, filed on July 16, 2020, are incorporated herein by reference. [Explanation of symbols]

[0079] 1 Plant management equipment 12 Input section 14 Infrared Camera 16 Visible light camera 20 Control Unit 22 Generation part 24 Acquisition Department 25 Image Processing and Analysis Department 26 Alignment section 28 Image generation unit 30 Storage section 40 Display section 50 Smart Glasses 52 Area Identification Department 54 Projection part 62 Visible light image analysis section 64 Infrared image analysis unit 66 Simulation Execution Unit 68 Maintenance Information Creation Department

Claims

1. a three-dimensional model generation step of generating a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space; a situation image acquisition step of acquiring information about the situation of the plant equipment as image information; a storage step of storing information about the status of the plant equipment acquired as the image information in association with a corresponding portion of the three-dimensional model; a superimposition display step of generating an image of a corresponding portion of the three-dimensional model, to which information regarding the status of the plant equipment is associated and stored, based on the three-dimensional model of the plant equipment, and displaying the information regarding the status of the plant equipment superimposed on the corresponding portion; a map display step of displaying a map of the plant facility including the corresponding location; A plant management method comprising:

2. The information regarding the status of the plant equipment includes at least one of temperature information, vibration information, and fluid leakage information of the plant equipment, and information regarding the appearance of the plant equipment. The plant management method according to claim 1 .

3. 3. The plant management method according to claim 1, wherein in the situation image acquisition step, information about the situation of the plant equipment is acquired using an imaging device.

4. In the storing step, using information about the photographing location and photographing direction of the imaging device, to associate a position on the image acquired by the imaging device with a position of the three-dimensional model; 4. The plant management method according to claim 3, further comprising storing information relating to the status of the plant equipment at each position in association with each position of the three-dimensional model.

5. The imaging device is at least one of an infrared camera and a visible light camera. The plant management method according to claim 3 .

6. further comprising a step of simulating deterioration of the plant equipment based on the three-dimensional model and information on the status of the plant equipment. The plant management method according to claim 1 .

7. creating maintenance information regarding the location, timing, and content of maintenance required for the plant equipment based on the results of the simulation; storing the created maintenance information in association with the three-dimensional model; and displaying the maintenance information at a corresponding location on the three-dimensional model. The plant management method according to claim 6.

8. creating information about the risk level of the plant equipment based on the three-dimensional model and information about the status of the plant equipment; storing the created information on the risk level in association with the three-dimensional model; and displaying the information on the risk level at a corresponding location on the three-dimensional model. The plant management method according to claim 1 .

9. Further comprising a projection step of projecting information about the status of the plant equipment onto a lens portion of a transparent glasses-type terminal that transmits the view of the plant equipment. The plant management method according to claim 1 .

10. a generation unit that generates a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in a real space; an acquisition unit that acquires information about the status of the plant equipment as image information; a storage unit that stores information about the status of the plant equipment acquired as the image information in association with a corresponding location of the three-dimensional model; a display unit that displays an image of a corresponding portion of the three-dimensional model of the plant equipment, the image being generated based on the three-dimensional model of the plant equipment, the image being stored in association with information about the status of the plant equipment, with the information about the status of the plant equipment superimposed on the corresponding portion, and also displays a map of the plant equipment including the corresponding portion; A plant management device comprising:

11. A process of generating a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space; A process of acquiring information about the status of the plant equipment as image information; a process of storing information about the status of the plant equipment acquired as the image information in association with a corresponding location of the three-dimensional model; generating an image of a corresponding portion of the three-dimensional model, to which information on the status of the plant equipment is associated and stored, based on the three-dimensional model of the plant equipment, and displaying the information on the status of the plant equipment by superimposing it on the corresponding portion; a process of displaying a map of the plant facility including the corresponding location; A plant management program that causes a computer to execute the above.

Images