Ground abnormality detection device, ground abnormality detection system, and ground abnormality detection method

Abstract

To efficiently detect an abnormality of a ground in a power facility.SOLUTION: A ground abnormality detection device 1 comprises: a processor and a memory; an image acquisition unit which acquires a photographed image including an image of a plurality of instruments 10 of a power facility 1; and an abnormality detection unit which outputs information about an abnormality of a displacement of the ground on which the instruments 10 included in the acquired photographed image are installed by inputting the acquired photographed image to a learned model that receives an input of the image including the plurality of instruments 10 of the power facility 1 and outputs information indicating the abnormality of the displacement of the ground on which the instruments 10 are installed.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a ground abnormality detection device and a ground abnormality detection method. [Background technology]

[0002] Substations are often subject to site development or the addition of electrical equipment for their improvement and expansion. As a result, the site of a substation is generally large and numerous pieces of equipment are installed there. As a result, it is important to monitor the ground to detect any subsidence or tilt that may occur due to site development work or the installation of new electrical equipment.

[0003] Currently, the method of checking for ground abnormalities involves maintenance personnel visiting the site to visually inspect the ground and, if necessary, measuring the tilt of equipment at various locations to determine whether there are any abnormal changes in the ground. However, because substations occupy vast premises, such a procedure of patrolling the entire substation to check for abnormalities is extremely time-consuming and requires specialized knowledge and experience. Therefore, methods are being sought that make this process more efficient by utilizing IT (Information Technology) and other technologies.

[0004] As an example of a method for detecting abnormalities using IT technology, Patent Document 1 discloses an on-site abnormality detection system for detecting abnormal signs within a plant, which includes a first detection system that is installed in a target process within the plant and detects the state inside the process, a second detection system that detects the state outside the target process within the plant, and a complementary and integrated processing unit that uses information collected from the first detection system and information collected from the second detection system to detect abnormal signs in the target process within the plant as integrated information in accordance with causal relationship laws and empirical rules. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2019-204192 Summary of the Invention [Problem to be solved by the invention]

[0006] However, there has been insufficient development of anomaly detection technology that targets a wide range of anomalies, such as ground subsidence at substations, rather than just the equipment itself. The present invention has been made in view of the above background, and its object is to provide a ground abnormality detection device and a ground abnormality detection method for efficiently detecting ground abnormalities in electric power facilities. [Means for solving the problem]

[0007] One aspect of the present invention for achieving the above-mentioned object is a ground abnormality detection device that includes an image acquisition unit having a processor and memory, and that acquires photographed images including images of multiple pieces of equipment at an electric power facility, and an abnormality detection unit that outputs information regarding abnormal displacement of the ground on which the equipment included in the acquired photographed images is installed by inputting the acquired photographed images into a trained model that receives input of images including multiple pieces of equipment at an electric power facility and outputs information indicating abnormal displacement of the ground on which the equipment is installed.

[0008] As in the present invention, a trained model that outputs information indicating abnormal ground displacement at a power facility inputs a photographed image containing images of multiple pieces of equipment at the power facility and outputs information regarding abnormal ground displacement on which the equipment contained in the photographed image is installed. This allows maintenance personnel at the power facility to learn about abnormal ground conditions (subsidence or tilt) at the power facility using only images (photographs, etc.) of the on-site equipment, without having to visit the power facility to inspect or survey the facility. This also reduces the cost of surveying. Furthermore, by detecting abnormalities using the entire image containing multiple pieces of equipment rather than using images of individual pieces of equipment, the risk of missing a ground abnormality can be reduced.

[0009] Another aspect of the present invention for achieving the above-mentioned object is the ground abnormality detection device, wherein the abnormality detection unit inputs an image including multiple pieces of equipment at the power facility and inputs the acquired captured image into a trained model that outputs information on whether or not the ground on which the equipment is installed has been surveyed at the time the image was taken, thereby outputting information on whether or not the ground on which the equipment included in the captured image is installed needs to be surveyed.

[0010] As in the present invention, by using a trained model that outputs information on whether or not the ground on which the equipment is installed has been surveyed at the time the image was taken, and outputting information on whether or not the ground on which the equipment is installed contained in the captured image needs to be surveyed, maintenance personnel and others can know whether or not the ground related to the captured image currently needs to be surveyed and take practical action.

[0011] Another aspect of the present invention for achieving the above-mentioned object is the ground abnormality detection device, wherein the abnormality detection unit inputs an image including multiple pieces of equipment at the power facility and inputs the acquired captured image into a trained model that outputs information on whether or not the ground on which the equipment is installed has been surveyed at the time the image was taken and information on the measuring instrument used for the survey, thereby outputting information on whether or not the ground on which the equipment included in the captured image is installed needs to be surveyed and information on the measuring instrument to be used for the survey.

[0012] As in the present invention, by using a trained model that outputs information on whether or not the ground on which the equipment is installed has been surveyed at the time the image was taken, as well as information on the measuring instrument used for the survey, maintenance personnel and others can know what measuring instrument to use when a survey is necessary, and can take appropriate action in response to ground abnormalities even if they do not have specialized knowledge about surveying.

[0013] Another aspect of the present invention for achieving the above-mentioned object is the ground abnormality detection device, wherein the abnormality detection unit inputs an image including multiple pieces of equipment of the power facility into a trained model that outputs the amount of displacement of the ground on which the multiple pieces of equipment are installed at the time the image was taken, relative to the position of the ground on which the multiple pieces of equipment are installed at a specified reference time, thereby outputting information on the amount of displacement of the ground on which the equipment included in the photographed image is installed, relative to its position at the specified reference time, at the time the image was taken.

[0014] By using a trained model that outputs the amount of displacement of the ground on which the equipment is installed at the time the image was taken relative to the position of the ground on which the equipment is installed at a predetermined reference time, as in the present invention, maintenance personnel and others can obtain information on the current amount of displacement of the ground on which the equipment is installed (for example, the amount of subsidence and inclination of the ground from the time the site was developed to the present). This allows maintenance personnel and others to take necessary and sufficient measures against abnormalities in the ground.

[0015] Another aspect of the present invention for achieving the above-mentioned object is the ground abnormality detection device, wherein the abnormality detection unit inputs the acquired photographed image into a trained model that receives an image including multiple pieces of equipment at the power facility and outputs information indicating the amount of displacement of the ground on which the multiple pieces of equipment are installed a predetermined time after the image was taken, thereby outputting information indicating the amount of displacement of the ground on which the multiple pieces of equipment included in the photographed image are installed a predetermined time after the image was taken.

[0016] By using a trained model that outputs information indicating the amount of displacement of the ground on which multiple pieces of equipment are installed a predetermined time after the image was taken, as in the present invention, maintenance personnel can know the amount of future displacement after the image was taken, which allows them to take appropriate preemptive measures against ground abnormalities that may occur in the future.

[0017] Another aspect of the present invention for achieving the above-mentioned object is the ground abnormality detection device, wherein the image acquisition unit acquires photographed images including images of equipment installed on the ground of the power facility formed by embankment, the photographed images being taken by a photographing device installed on the ground of the power facility formed by cutting, and the abnormality detection unit inputs the acquired photographed images into the trained model, thereby outputting information regarding whether or not a survey of the embankment on which the equipment included in the photographed images is installed is required.

[0018] As in the present invention, by using a camera installed on the ground in the cut earth portion of a power facility to capture images of equipment on the ground in the embankment portion of the power facility and using these captured images in a trained model, maintenance personnel can accurately identify abnormalities in the ground in the embankment portion of the power facility, which is prone to subsidence, by using a camera installed on the cut earth portion where the ground is relatively solid. For example, various accidents caused by ground movement due to construction or expansion work on a power facility and equipment tilting can be prevented.

[0019] Another aspect of the present invention for achieving the aforementioned object is the ground abnormality detection device, which is provided with a screen display unit that displays information regarding abnormal displacement of the ground on which the equipment is installed, contained in the acquired photographic image, on a specified screen.

[0020] In this way, by displaying information about abnormal ground displacement on the screen, maintenance personnel can take appropriate measures against subsidence, tilt, etc.

[0021] Another aspect of the present invention for achieving the above-mentioned object is a ground abnormality detection method in which an information processing device executes an image acquisition process for acquiring a photographed image including images of multiple pieces of equipment at an electric power facility, and an abnormality detection process for outputting information regarding abnormal displacement of the ground on which the equipment included in the acquired photographed image is installed by inputting the acquired photographed image into a trained model that receives an image including multiple pieces of equipment at an electric power facility and outputs information indicating abnormal displacement of the ground on which the equipment is installed. [Effects of the Invention]

[0022] According to the present invention, ground abnormalities in electric power facilities can be detected efficiently. [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a diagram showing an example of the configuration of an electrical facility in which a ground abnormality detection device according to an embodiment of the present invention is installed. [Figure 2] FIG. 2 is a diagram illustrating an example of functions provided in the ground abnormality detection device. [Figure 3] FIG. 10 is a diagram illustrating an example of a captured image. [Figure 4] FIG. 10 is a diagram showing another example of a captured image. [Figure 5] FIG. 2 is a diagram illustrating an example of hardware of a ground abnormality detection device. [Figure 6] FIG. 10 is a flow diagram illustrating an example of an abnormality detection support process. [Figure 7] FIG. 10 is a flow diagram illustrating an example of a model creation process. [Figure 8] FIG. 10 is a diagram illustrating an example of a teacher data DB. [Figure 9] FIG. 10 is a flow diagram illustrating an example of an abnormality detection process. [Figure 10] FIG. 10 is a diagram showing an example of a ground information screen. DETAILED DESCRIPTION OF THE INVENTION

[0024] A ground abnormality detection device according to one embodiment of the present invention will be described with reference to the drawings. --System Configuration-- 1 is a diagram showing an example of the configuration of an electric facility in which a ground abnormality detection device according to this embodiment is installed. This electric power facility is, for example, a substation, a power plant, or the like, in which a plurality of devices are installed on a site (ground) of a predetermined size. In this embodiment, this electric power facility is assumed to be a substation.

[0025] The substation 1 according to this embodiment has a site extending from a cutting section 3 (for example, on the land side) to an embankment section 5 (for example, on the sea side). That is, the substation 1 includes the cutting section 3, which is a relatively solid area formed by cutting a slope on the land side, and the embankment section 5, which is an area on the sea side formed by embankment. The substation 1 is equipped with a large number of devices 10, such as disconnectors, circuit breakers, and transformers, which are connected to each other by predetermined electric wires 12 (such as bus bars).

[0026] The substation 1 is provided with a camera 20 that takes comprehensive photographs of equipment 10 in a certain section installed on an embankment 5 and acquires the images as needed. The camera 20 is fixed at a position on the embankment 5 at a predetermined distance from the equipment 10 to be photographed, and is adjusted to an angle that allows it to photograph the entire equipment 10 to be photographed. The camera 20 is, for example, an ITV (Industrial Television) or a camera. Note that although only one camera 20 is shown in the figure, multiple camera devices 20 may be used to photograph the equipment 10 from multiple different directions.

[0027] Furthermore, the substation 1 is provided with a ground abnormality detection device 30, which is an information processing device communicatively connected to the photographing devices 20. The ground abnormality detection device 30 and each photographing device 20 are communicatively connected to each other via a wired or wireless communication network 7 such as the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), or a dedicated line.

[0028] The ground abnormality detection device 30 creates an abnormality detection model that can detect abnormal displacements (e.g., subsidence or tilt of the embankment 5) of the ground on which the equipment 10 of the substation 1 is installed from images (hereinafter referred to as teacher images) of the equipment 10 previously photographed by the photographing device 20.

[0029] The anomaly detection model is a trained model generated by machine learning. In this embodiment, the anomaly detection model is constructed by machine learning the features of a teacher image using deep learning. That is, the anomaly detection model of this embodiment is a neural network having an input layer to which pixel information of the image is input, one or more intermediate layers (hidden layers) that extract image features from the pixel information, and an output layer that outputs information (hereinafter referred to as ground information) regarding abnormal displacement of each device 10 and the ground on which each device 10 is installed based on the image features. Note that the anomaly detection model of this embodiment outputs multiple types of output values, but a separate trained model may be created for each type of output value.

[0030] As the neural network, for example, a convolution neural network (CNN), a support vector machine (SVM), a Bayesian network, or a regression tree can be applied, but in this embodiment, CNN, which is a method suitable for image recognition, is used as a premise.

[0031] Thereafter, the ground abnormality detection device 30 inputs a new image captured by the photographing device 20 (for example, an image of the equipment 10 at the current substation 1) into the abnormality detection model, thereby detecting abnormalities in the displacement of the ground on which the equipment 10 contained in the image (hereinafter referred to as the judgment image) is installed, and displays information about the abnormality (ground information, etc.) on a specified screen. Next, the ground abnormality detection device 30 will be described in detail.

[0032] --Ground abnormality detection device-- 2 is a diagram showing an example of functions of the ground abnormality detection device 30. The ground abnormality detection device 30 includes an image acquisition unit 31, a model creation unit 33, an abnormality detection unit 35, and a screen display unit 37.

[0033] The image acquisition unit 31 acquires a captured image including images of a plurality of devices 10 in the substation 1. In this embodiment, the captured image is a teacher image or a judgment image captured by the imaging device 20, but it may also be an image captured by a maintenance worker or the like from the same position and direction as the imaging device 20.

[0034] 3 is a diagram showing an example of a photographed image. This photographed image 100 is an image photographed by the photographing device 20 from the cutting section 3 toward the banking section 5, and shows a plurality of rack facilities 101 installed at predetermined intervals on the ground surface of the banking section 5 toward the sea side (the banking section 5 side), and a bus bar 103 bridged by these rack facilities 101.

[0035] 4 is a diagram showing another example of a photographed image 120. This photographed image 120 is an image taken from the side of a plurality of potential transformers 121 (here, PDs (Potential Devices)) placed at various locations from the cutting section 3 toward the banking section 5, and a busbar 123 bridged by the potential transformers 121.

[0036] 2, the model creation unit 33 receives an image including a plurality of devices 10 in the substation 1 based on the teacher image and creates a trained model (anomaly detection model) that outputs information indicating an abnormality in the displacement of the ground on which the devices 10 are installed. The teacher data including the teacher image is stored in a teacher data DB 50, which is a database described later.

[0037] The abnormality detection unit 35 inputs the photographed image (determination image) acquired by the image acquisition unit 31 into the abnormality detection model, and outputs information regarding abnormal displacement of the ground on which the equipment 10 is installed, which is included in the photographed image.

[0038] Specifically, the anomaly detection unit 35 inputs the photographed image acquired by the image acquisition unit 31 into the anomaly detection model, and outputs information on whether or not the ground on which the equipment 10 is installed, which is included in the photographed image, needs to be surveyed, and information on the measuring instrument to be used for the survey.

[0039] Furthermore, the anomaly detection unit 35 estimates the current amount of subsidence of the installation ground of the equipment 10 included in the determination image using the anomaly detection model. That is, the anomaly detection unit 35 inputs the photographed image acquired by the image acquisition unit 31 into the anomaly detection model, and outputs information on the amount of displacement of the installation ground of the equipment included in the photographed image at the time the photographed image was taken, relative to its position at a predetermined reference time.

[0040] Furthermore, the anomaly detection unit 35 uses the anomaly detection model to predict the future amount of subsidence of the ground on which the equipment 10 included in the determination image is installed. That is, the anomaly detection unit 35 inputs the photographed image acquired by the image acquisition unit 31 into the anomaly detection model, and outputs information indicating the amount of displacement of the ground on which the multiple equipment 10 included in the photographed image are installed after a predetermined time has passed since the photographed image was taken.

[0041] Next, the screen display unit 37 displays information about abnormal displacement of the ground on which the device 10 is installed, which information is included in the photographed image acquired by the image acquisition unit 31, on a predetermined screen.

[0042] 5 is a diagram showing an example of hardware of the ground abnormality detection device 30. The ground abnormality detection device 30 includes a processor 21, a main memory device 22, an auxiliary memory device 23, an input device 24, an output device 25, and a communication device 26.

[0043] The processor 21 is configured using, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), an AI (Artificial Intelligence) chip, etc.

[0044] The main memory device 22 is a device that stores programs and data, and is, for example, a read-only memory (ROM), a random access memory (RAM), or a non-volatile memory (NVRAM (Non-Volatile RAM)).

[0045] The auxiliary storage device 23 is, for example, an SSD (Solid State Drive), a hard disk drive, an optical storage device (CD (Compact Disc), DVD (Digital Versatile Disc), etc.), a storage system, a read / write device for a recording medium such as an IC card, an SD card, or an optical recording medium, a storage area of ​​a cloud server, etc. Programs and data can be read into the auxiliary storage device 23 via a recording medium reader or a communication device 26. The programs and data stored (memorized) in the auxiliary storage device 23 are read into the main storage device 22 as needed.

[0046] The input device 24 is an interface that accepts input from the outside, and is, for example, a keyboard, a mouse, a touch panel, a card reader, a pen-input tablet, a voice input device, or the like.

[0047] The output device 25 is an interface that outputs various information such as the progress of processing and the results of processing. The output device 25 is, for example, a display device (liquid crystal monitor, LCD (Liquid Crystal Display), graphic card, etc.) that visualizes the various information described above, a device that converts the various information described above into audio (audio output device (speaker, etc.)), or a device that converts the various information described above into text (printer, etc.). Note that, for example, the ground abnormality detection device 30 may be configured to input and output information to and from other devices via the communication device 26.

[0048] The input device 24 and the output device 25 constitute a user interface for receiving information from the user and presenting information.

[0049] The communication device 26 is a device that realizes communication with the imaging device 20. The communication device 26 is a wired or wireless communication interface that realizes communication with other devices via a communication network such as the Internet, and is, for example, a NIC (Network Interface Card), a wireless communication module, a USB module, or the like.

[0050] All or part of the ground abnormality detection device 30 may be realized using virtual information processing resources provided using virtualization technology, process space separation technology, or the like, such as a virtual server provided by a cloud system. All or part of the functions provided by the ground abnormality detection device 30 may be realized by a service provided by the cloud system via an API (Application Programming Interface), for example. The ground abnormality detection device 30 may also be configured as a system including multiple information processing devices connected to each other so that they can communicate with each other.

[0051] The above-mentioned functions of the ground abnormality detection device 30 are realized by the processor 21 of the ground abnormality detection device 30 reading and executing a program stored in the main memory device 22, or by hardware (FPGA, ASIC, AI chip, etc.) constituting the ground abnormality detection device 30. The ground abnormality detection device 30 stores the above-mentioned various information (data), for example, as a database table or a file managed by a file system. Next, the processing performed by the ground abnormality detection device 30 will be described.

[0052] --process-- FIG. 6 is a flow diagram illustrating an example of a ground abnormality detection process that is a process performed by the ground abnormality detection device 30.

[0053] First, the model creation unit 33 of the ground abnormality detection device 30 executes a model creation process to create an abnormality detection model based on each image (teacher image) including the equipment 10 of the substation 1 taken at each past timing (s1).

[0054] Then, the anomaly detection unit 35 inputs an image (judgment image) of the current equipment 10 taken from the same position and direction as the teacher image into the created anomaly detection model, and performs an anomaly detection process in which information (ground information) indicating whether or not an abnormality such as subsidence or ground tilt has occurred in the ground on which these equipments 10 are installed is output from the anomaly detection model and the content of this information is displayed on the screen (s3).

[0055] Thereafter, maintenance personnel at the substation 1 refer to the displayed screen and take appropriate measures, such as surveying the ground, improving the ground of the embankment 5 of the substation 1, or changing the installation location of the equipment 10, as necessary. The model creation process and the abnormality detection process will be described in detail below.

[0056] -Model creation process- 7 is a flow diagram illustrating an example of the model creation process. The model creation process is started, for example, when a predetermined input is made to the ground abnormality detection device 30 by a maintenance worker or the like, or at a predetermined timing (a predetermined time or a predetermined time interval).

[0057] First, the model creating unit 33 acquires a teacher image (s11). For example, the model creating unit 33 acquires an image captured by the image capturing device 20 in the past.

[0058] Then, the model creating unit 33 sets label data (correct labels) for each acquired teaching image, thereby creating a teaching data DB 50 in which teaching data, which is a set of teaching images and label data, is recorded (s13).

[0059] (Teacher data DB) 8 is a diagram showing an example of the teacher data DB 50. The teacher data DB 50 is created by data input by a maintenance worker or the like.

[0060] The teacher data DB 50 contains the following information: shooting point 51, which is information indicating the installation location of the camera 20 that captured each teacher image; shooting date 53 of each teacher image; image data 55, which is a data file recording each teacher image; and label data 57 related to each teacher image.

[0061] The label data 57 includes: abnormal equipment 61, which is area information of each device 10 (or multiple devices) in the teacher image that has an abnormal displacement of the installation ground; survey presence / absence 63, which is information indicating whether a survey was conducted on each device 10 in the teacher image to confirm an abnormality as of the photographing date 53; measuring instrument 65, which is information on the measuring instrument used for the survey; current subsidence 67, which is the amount of displacement of the installation ground on each device 10 in the teacher image as of the photographing date 53 (for example, the amount of displacement relative to the position of the substation 1 at the time of design); and subsidence after 3 years 69, which is the amount of displacement of the installation ground on each device 10 included in the teacher image a predetermined time later (3 years in this embodiment) from the photographing date 53 as the reference time. Note that survey presence / absence 63 is set to, for example, "yes" if a survey has been conducted, or "no" if a survey has not been conducted, which respectively correspond to whether or not a survey is necessary in the output value of the anomaly detection model.

[0062] The types of label data 57 are not limited to those shown here, and any information related to abnormal displacement of the installation ground may be used. Also, the label data 57 may be only a part of the types shown here. The label data 57 is set, for example, by a maintenance worker or the like.

[0063] Here, the model creation unit 33 may create an image corresponding to the teacher image, in a state where there is no displacement of the ground on which each device 10 is installed (for example, when the substation 1 is designed), and add this as one of the teacher data. For example, the model creation unit 33 creates three-dimensional structural data (for example, three-dimensional CAD data) of the substation 1 including each device 10 based on data representing the dimensions of each device 10 installed in the substation 1 (for example, two-dimensional design drawings such as a plan view and a side view, and data on the height of the ground surface). Then, the model creation unit 33 creates an image corresponding to the teacher image by performing perspective transformation on the created three-dimensional structural data using a predetermined algorithm such as central projection. Note that, for example, data on the viewpoint and vanishing point (calculated based on, for example, the position, focal length, field of view, etc. of the image capture device 20) are used as parameters for the perspective transformation.

[0064] 7, the model creation unit 33 inputs each training image registered in the training data DB 50 into the anomaly detection model to obtain each output value or intermediate value corresponding to the training image. When this process is executed for the first time, initial values ​​are set in advance for the hyperparameters (described next) of the anomaly detection model.

[0065] The model creation unit 33 optimizes the hyperparameters in the anomaly detection model so that each of the acquired output values ​​or intermediate values ​​approaches each of the correct data (label data 57) registered in the training data DB 50 (s17). For example, the model creation unit 33 adjusts hyperparameters such as weights between units (neurons) or coefficients in activation functions using a learning method such as backpropagation. This completes the model creation process.

[0066] The model creation unit 33 may configure the anomaly detection model from two or more trained models. As an example, first, the model creation unit 33 receives an actual image as input and generates a first trained model that outputs area information of the abnormal device in the actual image. Next, the model creation unit 33 receives area information of the abnormal device as input and generates a second trained model that outputs whether or not a survey was conducted, the measuring device, the current subsidence amount, and the subsidence amount in three years. In this way, by configuring the anomaly detection model from two or more trained models, it is possible to accurately recognize the area of ​​the abnormal device and output more accurate results.

[0067] -Anomaly detection processing- 9 is a flow diagram illustrating an example of the abnormality detection process. The abnormality detection process is started after the model creation process is executed, for example, when a predetermined input is received from a maintenance technician, or at a predetermined timing (a predetermined time, a predetermined time interval).

[0068] First, the abnormality detection unit 35 acquires an image (determination image) of a plurality of devices 10 in the substation 1 (s31). For example, the abnormality detection unit 35 acquires an image of the current device 10 captured by the imaging device 20 via the communication network 7.

[0069] The abnormality detection unit 35 inputs the acquired judgment image into the abnormality detection model to acquire an output value (ground information) (s33). For example, the abnormality detection unit 35 acquires information on the abnormal equipment in the judgment image and whether or not surveying is required for the ground on which the equipment 10 included in the judgment image is installed (information corresponding to the abnormal equipment 61, surveying presence / absence 63, measuring device 65, current amount of subsidence 67, and amount of subsidence in three years 69).

[0070] Then, the screen display unit 37 displays the acquired ground information on the screen (s35).

[0071] 10 is a diagram showing an example of a ground information screen 300 that displays ground information. The ground information screen 300 displays a photographing point 301 of the determination image, a determination image 303 showing the abnormal device, and information 307 about the installation ground of the abnormal device. Information 307 on the ground where the abnormal equipment is installed displays information on whether surveying is required, as well as information 309 identifying the abnormal equipment (such as the name and management number of the equipment 10), a measuring instrument 311 to be used to survey the equipment 10 or the ground where it is installed, the current estimated amount of subsidence 313 of the ground where the equipment 10 is installed, and the predicted amount of subsidence 315 of the ground where the equipment 10 is installed three years from now.

[0072] In the example shown in the figure, the determination image 303 highlights a stand facility 305 on the ground that has been determined to have an abnormal displacement (ground subsidence), and a bus bar 306 that is attached to the stand facility 305 and has a positional abnormality (sagging, etc.) similar to that of the stand facility 305. In this case, a maintenance worker or the like may take action such as inserting an adapter or the like to raise the bus bar 306.

[0073] As described above, the ground abnormality detection device 30 of this embodiment inputs a determination image including multiple devices 10 of the substation 1 into an abnormality detection model that outputs information indicating abnormal displacement of the ground on which the devices 10 are installed, and outputs information regarding abnormal displacement of the ground on which the devices 10 included in the determination image are installed. Therefore, substation maintenance personnel and the like can learn information about abnormalities in the ground (subsidence or tilt) of the substation 1 using only images (photographs, etc.) of the on-site devices without having to visit the substation to check or survey the site. This also reduces the cost required for surveying. Furthermore, by detecting abnormalities using the entire image including multiple devices rather than using images of individual devices 10, the risk of missing a ground abnormality can be reduced.

[0074] Furthermore, the ground abnormality detection device 30 of this embodiment uses an abnormality detection model that outputs information on whether or not the ground on which the equipment is installed has been surveyed at the time the image was taken, and outputs information on whether or not the ground on which the equipment is installed, which is included in the photographed image, needs to be surveyed. This allows maintenance personnel, etc. to know whether or not the ground related to the photographed image currently needs to be surveyed, and to take practical measures against ground abnormalities.

[0075] Furthermore, the ground abnormality detection device 30 of this embodiment uses a trained model that outputs information on whether or not the ground on which the equipment is installed has been surveyed at the time the image was taken, as well as information on the measuring instrument used for the survey. This allows maintenance personnel and others to know what measuring instrument to use when a survey is necessary, and allows them to take appropriate action in response to ground abnormalities even if they do not have specialized knowledge about surveying.

[0076] Furthermore, the ground abnormality detection device 30 of this embodiment uses a trained model that outputs the amount of displacement of the ground on which the equipment is installed at the time the image is taken, relative to the position of the ground on which the equipment is installed at a predetermined reference time, allowing maintenance personnel and others to know information about the current amount of displacement of the ground on which the equipment is installed (for example, the amount of subsidence and inclination of the ground from the time the site was developed to the present). This allows maintenance personnel and others to take necessary and sufficient measures against ground abnormalities.

[0077] Furthermore, the ground abnormality detection device 30 of this embodiment uses a trained model that outputs information indicating the amount of displacement of the ground on which multiple devices are installed a predetermined time after the image was taken, allowing maintenance personnel to know the amount of future displacement after the image was taken. This allows maintenance personnel to take appropriate preemptive measures against ground abnormalities that may occur in the future.

[0078] Furthermore, the ground abnormality detection device 30 of this embodiment uses a camera installed on the ground in the cut earth portion of the substation to capture images of the equipment on the ground in the embankment portion of the substation, and by using these captured images in the trained model, maintenance personnel can accurately determine ground abnormalities in the embankment portion of the substation, where subsidence is likely to occur, by using a camera point in the cut earth portion, where the ground is relatively solid. For example, various accidents caused by ground movement due to construction or expansion work of the substation and tilting of the equipment 10 can be prevented.

[0079] Furthermore, the ground abnormality detection device 30 of this embodiment displays information relating to abnormal ground displacement on a screen, allowing maintenance personnel and the like to take appropriate measures against ground subsidence, tilt, and the like.

[0080] The above description of the embodiments is intended to facilitate understanding of the present invention, and is not intended to limit the present invention. The present invention may be modified or improved without departing from the spirit thereof, and the present invention includes equivalents thereof.

[0081] For example, in this embodiment, the ground abnormality detection device 30 is installed in a substation, but it can also be applied to other types of power facilities equipped with various devices, such as power plants.

[0082] In addition, in this embodiment, the photographing device 20 is installed in the cutting section 3 and is installed in a direction to photograph the equipment 10 in the embankment section 5, but the installation position and photographing direction of the photographing device 20 are not particularly limited. Furthermore, the equipment 10 may be installed in the cutting section 3.

[0083] Furthermore, in this embodiment, the ground abnormality detection device 30 is installed within the premises of the substation 1, but it may also be installed outside the premises of the substation 1.

[0084] Although the anomaly detection model in this embodiment is configured as one model (neural network), it may be configured as a model consisting of multiple models. For example, the anomaly detection model may be configured as a first model that outputs the area of ​​each device 10 on the image, and a second model that outputs information on abnormal displacement of the installation ground from the output value of the first model.

[0085] Furthermore, the anomaly detection model of this embodiment is premised on outputting a specific value as each output value, but it may also output candidates for the output value together with their accuracy.

[0086] Furthermore, in this embodiment, the ground abnormality detection device 30 creates the abnormality detection model, but it is also possible for another information processing device to create the abnormality detection model, and for the ground abnormality detection device 30 to acquire it.

[0087] Furthermore, in this embodiment, the ground abnormality detection device 30 displays the ground information screen, but the ground information screen may be displayed on a mobile terminal or the like carried by a maintenance worker or the like.

[0088] Furthermore, in this embodiment, the anomaly detection model outputs whether or not a survey is required based on the survey availability 63 learned from the teacher data DB 50, but other methods may be used. For example, if the current estimated subsidence amount output by the anomaly detection model is equal to or greater than a predetermined threshold, it may be determined that a survey is required for the corresponding equipment 10.

[0089] In this embodiment, the anomaly detection model predicts ground displacement three years from now, but it may also predict ground displacement at multiple future time points. In this case, measurement data of ground displacement at multiple time points after the teacher image was captured is set in the teacher data DB 50, for example. Furthermore, by using the data at multiple time points, a regression equation relating to the amount of ground displacement at any future time point may be obtained, and the ground displacement at any future time point may be obtained and displayed on the screen.

[0090] Furthermore, when creating an anomaly detection model, equipment (e.g., high-voltage pylons) fixed on the premises outside the substation 1 may be included in the teacher image and the judgment image without fail. Then, before inputting the teacher image and the judgment image into the anomaly detection model, a correction process (projective transformation, etc.) may be performed to make the positions of the areas on the images of the equipment in the teacher image and the judgment image the same. This makes it possible to suppress a decrease in the accuracy of detecting abnormal ground displacement, for example, even if the position or angle of the imaging device 20 changes for some reason. [Explanation of symbols]

[0091] 1 substation, 3 cutting section, 5 embankment section, 10 equipment, 12 power line, 20 photographing device, 30 ground abnormality detection device, 7 communication network, 31 image acquisition unit, 33 model creation unit, 35 abnormality detection unit, 37 screen display unit, 100 photographed image, 101 mounting equipment, 103 bus bar, 120 photographed image, 121 instrument transformer, 123 bus bar, 21 processor, 22 main memory device, 23 auxiliary memory device, 24 input device, 25 output device, 26 communication device, 50 training data DB, 51 photographed point, 53 photographed date, 55 image data, 57 label data, 61 abnormal equipment, 63 surveying presence / absence, 65 measuring device, 67 current settlement, 69 settlement in three years, 300 ground information screen, 301 photographed point, 303 Judgment image, 305 Mounting equipment, 306 Bus bar, 307 Information on the ground where the abnormal equipment is installed, 309 Information to identify the abnormal equipment, 311 Measuring equipment to be used, 313 Current estimated settlement, 315 Predicted settlement three years from now

Claims

1. a processor and a memory; an image acquisition unit that acquires a photographed image including an image of a plurality of devices of the power facility and an image of the ground on which the plurality of devices are installed; an abnormality detection unit that inputs an image including a plurality of devices of a power facility and the ground on which the plurality of devices are installed, and outputs information indicating abnormal displacement of the ground on which the plurality of devices are installed, information on whether or not a survey of the ground on which the plurality of devices are installed at the time the image is taken, and information on a measuring instrument used for the survey, and outputs information regarding abnormal displacement of the ground on which the devices included in the acquired photographed image are installed, information on whether or not a survey of the ground on which the devices included in the photographed image are installed is necessary, and information on a measuring instrument to be used for the survey; A ground abnormality detection device comprising:

2. The anomaly detection unit receives an image including a plurality of devices of the power facility and the ground on which the plurality of devices are installed, and outputs information about the amount of displacement of the ground on which the plurality of devices are installed at the time the image was taken, relative to the position of the ground on which the plurality of devices are installed at a predetermined reference time, by inputting the acquired photographed image into a trained model that outputs information about the amount of displacement of the ground on which the devices are installed, included in the photographed image, relative to the position at the predetermined reference time, The ground abnormality detection device according to claim 1.

3. The anomaly detection unit inputs an image including a plurality of devices of the power facility and the ground on which the plurality of devices are installed, and outputs information indicating the amount of displacement of the ground on which the plurality of devices are installed after a predetermined time from the time the image is taken, by inputting the acquired photographed image into a trained model that outputs information indicating the amount of displacement of the ground on which the plurality of devices are installed after a predetermined time from the time the image is taken. The ground abnormality detection device according to claim 1.

4. A ground abnormality detection device according to claim 1, an imaging device installed on the ground of the power facility formed by cutting earth; and a plurality of devices installed on the ground of the power facility formed by embankment, an image acquisition unit of the ground abnormality detection device acquires a photographed image including the plurality of devices and the ground on which the plurality of devices are installed, the photographed image being captured by the photographing device; The anomaly detection unit of the ground anomaly detection device inputs the acquired photographed image into the trained model, and outputs information regarding whether or not a survey of the embankment on which the equipment is installed, which is included in the photographed image, is necessary, and information regarding the measuring instrument to be used for the survey. Ground anomaly detection system.

5. a screen display unit that displays information about abnormal displacement of the ground on which the equipment is installed, included in the acquired photographed image, on a predetermined screen; The ground abnormality detection device according to claim 1.

6. The information processing device an image acquisition process for acquiring a photographed image including an image of a plurality of devices of the power facility and an image of the ground on which the plurality of devices are installed; an abnormality detection process in which an image including a plurality of pieces of equipment at a power facility and the ground on which the plurality of pieces of equipment are installed is input, and the acquired photographed image is input to a trained model that outputs information indicating abnormal displacement of the ground on which the plurality of pieces of equipment are installed, information on whether or not a survey of the ground on which the plurality of pieces of equipment are installed at the time the image was taken, and information on the measuring instrument used for the survey, and the acquired photographed image is input to the trained model that outputs information regarding abnormal displacement of the ground on which the equipment included in the acquired photographed image is installed, information on whether or not a survey of the ground on which the equipment included in the photographed image is installed is necessary, and information on the measuring instrument to be used for the survey; A ground anomaly detection method is performed.

Images