Defect detection device, defect detection method, and program

Abstract

To accurately determine the parts used in the equipment to be inspected. [Solution] The defect detection device comprises an image acquisition unit that acquires an image of equipment to be inspected; an equipment identification unit that identifies the equipment depicted in the acquired image; a part information acquisition unit that acquires part information related to the parts used in the equipment by searching for correspondence information that associates the equipment's identification information with information related to the parts used in the equipment based on the identification information identified by the equipment identification unit; and a defect detection unit that detects whether the parts used in the equipment depicted in the image are defective based on the acquired image and the acquired part information.

Description

[Technical Field]

[0001] The present invention relates to a defect detection device, a defect detection method, and a program. [Background technology]

[0002] Conventionally, structures such as steel towers have been inspected, and their condition has been determined based on image information captured using an imaging device. It is not easy to capture images of every corner of a huge structure such as a steel tower, so in recent years, imaging has been performed using aircraft such as drones. For example, Patent Document 1 describes the use of drones to inspect structures such as steel towers. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-196980 Summary of the Invention [Problem to be solved by the invention]

[0004] The technology described in Patent Document 1 makes it possible to determine whether parts such as bolts and nuts used in steel towers have defects, such as cracks or looseness, based on images captured using a drone. However, depending on the parts used in the steel tower, it is expected that an erroneous determination will be made depending on the defective state. For example, if double nuts are used and one of the nuts is cracked and defective, the remaining nut will be determined to be a single nut (not defective) through image determination. In other words, when using conventional technology, there was a problem in that it was not possible to accurately determine the parts used in the equipment being inspected.

[0005] The present invention has been made in consideration of the above circumstances, and its purpose is to provide a defect detection device, a defect detection method, and a program that are capable of accurately determining the parts used in the equipment to be inspected. [Means for solving the problem]

[0006] (1) One aspect of the present invention includes an image acquisition unit that acquires an image of equipment to be inspected, an equipment identification unit that identifies the equipment depicted in the acquired image, a part information acquisition unit that acquires part information related to the parts used in the equipment depicted in the image by searching for correspondence information stored in a predetermined storage unit in which equipment identification information and information related to parts used in the equipment are associated based on the identification information identified by the equipment identification unit, and a defect detection unit that detects whether the parts used in the equipment depicted in the image are defective based on the acquired image and the acquired part information. The parts used in the equipment have different colors depending on the type of part, and the part information includes information corresponding to the type of part and its color. The defect detection unit detects whether the part is defective based on the color of the part used in the equipment captured in the acquired image and the part information. It is a defect detection device. (2) Furthermore, one aspect of the present invention is a defect detection device as described above in (1), wherein the defect detection unit includes an estimation unit that estimates the condition of a part used in the equipment depicted in the acquired image, and a determination unit that determines whether or not the part used in the equipment is defective based on the condition of the part estimated by the estimation unit and the part information acquired by the part information acquisition unit. (3) Furthermore, one aspect of the present invention is a defect detection device as described above in (1), wherein the defect detection unit includes an estimation unit that estimates the condition of a part used in the equipment based on the image acquired by the image acquisition unit and the part information acquired by the part information acquisition unit, and a determination unit that determines whether the part used in the equipment is defective based on the part condition estimated by the estimation unit. (4) Furthermore, one aspect of the present invention is that in the defect detection device of any of (1) to (3) above, the equipment identification unit identifies the equipment based on the results of image processing of the acquired image. ( 5) Furthermore, one aspect of the present invention is the above-mentioned (1) to ( 4 ), the defect detection unit detects that a part used in the equipment shown in the acquired image is defective if the part is not present in the acquired part information. ( 6 ) Also, one aspect of the present invention is the above-mentioned ( 5 ) In the defect detection device, the parts used in the equipment that are captured in the acquired image are parts that are identified by being estimated based on the results of image processing of the image. ( 7 ) Also, one aspect of the present invention is the above-mentioned ( 5 ) The defect detection device further comprises an output unit that outputs information regarding the correct part if the part used in the equipment shown in the acquired image does not exist in the acquired part information. ( 8 ) Furthermore, one aspect of the present invention is the above-mentioned (1) to ( 7 ) In any of the defect detection devices, the defect detection unit detects whether or not a part used in the equipment shown in the image is defective based on a predetermined judgment criterion. ( 9 ) Also, one aspect of the present invention is the above-mentioned ( 8 In the defect detection device of the above, the criteria for detecting whether or not the parts used in the equipment shown in the image are defective differ for each piece of equipment. ( 10 ) Also, one aspect of the present invention is the above-mentioned ( 8 In the defect detection device of the above, the criteria for detecting whether the parts used in the equipment shown in the image are defective differ depending on the management company that manages the equipment. ( 11 ) Also, one aspect of the present invention is the above-mentioned ( 8 In the defect detection device of the above, the criteria for detecting whether the parts used in the equipment shown in the image are defective vary depending on the environment in which the equipment is located. ( 12 ) Also, one aspect of the present invention is the above-mentioned ( 8 In the defect detection device of the present invention, the criteria for detecting whether a part used in the equipment shown in the image is defective vary depending on the period since the last inspection of the equipment using the part. ( 13 ) Also, one aspect of the present invention is an image acquisition process for acquiring an image of a facility to be inspected; an equipment identification step of identifying the equipment shown in the acquired image; a parts information acquisition step of acquiring parts information on the parts used in the equipment shown in the image by searching for correspondence information stored in a predetermined storage unit in which the equipment identification information is associated with information on the parts used in the equipment based on the identification information identified in the equipment identification step; and a defect detection step of detecting whether or not the parts used in the equipment shown in the image are defective based on the acquired image and the acquired part information. The parts used in the equipment have different colors depending on the type of part, and the part information includes information corresponding to the type of part and its color. The defect detection step detects whether the part is defective based on the color of the part used in the equipment captured in the acquired image and the part information. This is a defect detection method. ( 14 ) Also, one aspect of the present invention is a method for causing a computer to execute an image acquisition step of acquiring an image of equipment to be inspected, an equipment identification step of identifying the equipment shown in the acquired image, a part information acquisition step of acquiring part information related to parts used in the equipment shown in the image by searching for correspondence information stored in a predetermined storage unit in which equipment identification information is associated with information related to parts used in the equipment based on the identification information identified in the equipment identification step, and a defect detection step of detecting whether or not a part used in the equipment shown in the image is defective based on the acquired image and the acquired part information. The parts used in the equipment have different colors depending on the type of part, and the part information includes information corresponding to the type of part and its color. The defect detection step detects whether the part is defective based on the color of the part used in the equipment captured in the acquired image and the part information. It is a program. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a defect detection device, a defect detection method, and a program that are capable of accurately determining parts used in equipment to be inspected. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an overview of a system according to an embodiment. [Figure 2] FIG. 2 is a functional configuration diagram showing the functional configuration of the system according to the present embodiment. [Figure 3] FIG. 2 is a functional configuration diagram showing the functional configuration of the defect detection device according to the present embodiment. [Figure 4] FIG. 2 is a diagram illustrating a first example of the functional configuration of a defect detection unit according to the present embodiment. [Figure 5] FIG. 10 is a diagram illustrating a second example of the functional configuration of the defect detection unit according to the present embodiment. [Figure 6] FIG. 2 is a functional configuration diagram showing a first modified example of the functional configuration of the system according to the present embodiment. [Figure 7] FIG. 10 is a functional configuration diagram showing a second modified example of the functional configuration of the system according to the present embodiment. [Figure 8] 1 is a flowchart showing a series of steps in a defect detection method according to the present embodiment. [Figure 9] 1 is a block diagram showing an example of the internal configuration of a defect detection device according to an embodiment of the present invention; DETAILED DESCRIPTION OF THE INVENTION

[0009] [Embodiment] A defect detection device, a defect detection method, and a program according to preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to these embodiments and includes various modifications and improvements. In other words, the components described below include those that would be easily conceivable to a person skilled in the art or that are substantially identical, and the components described below can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the present invention. Furthermore, in the drawings, the scale and number of components may differ from the scale and number of the actual structures to make each configuration easier to understand.

[0010] [System Configuration] First, a system 1 according to this embodiment will be described with reference to FIGS.

[0011] FIG. 1 is a diagram illustrating an overview of a system according to one embodiment. The system 1 includes a drone 10 and an administrator device 30, and inspects equipment 50. While the diagram illustrates one equipment 50 for ease of explanation, the system 1 may inspect multiple pieces of equipment 50. Although the diagram illustrates one drone 10 for ease of explanation, multiple drones 10 may be provided. In this case, the multiple drones 10 may each communicate wirelessly with a common administrator device 30, or each may communicate wirelessly with an independent administrator device 30. In other words, the relationship between the administrator device 30 and the drones 10 may be 1:N (N is a natural number greater than or equal to 1) or N:N.

[0012] The facility 50 is a facility to be inspected by the system 1. The facility 50 may be a communication tower (which may also be called a base station) used for wireless communication or a power transmission tower used for overhead power transmission lines. The parts of the facility 50 to be inspected include various parts such as bolts and nuts. Each of the multiple facilities 50 may be assigned identification information. It is preferable that information on the parts used in each facility 50 be managed centrally.

[0013] The administrator device 30 manages the inspection according to this embodiment. Specifically, the administrator device 30 outputs an inspection instruction to the drone 10. The administrator device 30 also acquires the results of the inspection performed by the drone 10 in accordance with the output inspection instruction. Specifically, acquiring the results of the inspection performed by the drone 10 may be acquiring image information captured by the drone 10. The administrator device 30 judges the parts (for example, judges whether there is an abnormality) based on the acquired image information. Note that the judgment function may be provided in the drone 10 or in the administrator device 30.

[0014] The drone 10 inspects the facility 50 based on instructions from the administrator device 30. Specifically, the drone 10 flies around the facility 50 based on instructions from the administrator device 30 and photographs the exterior of the facility 50 at a predetermined position. The predetermined position at which the drone 10 photographs may be preprogrammed, or the drone 10 may determine whether or not to photograph based on the exterior of the facility 50. Note that some of the images photographed by the drone 10 show parts used in the facility 50. It is preferable that at least one part is photographed in one image, but multiple parts may also be photographed.

[0015] FIG. 2 is a functional configuration diagram showing the functional configuration of a system according to this embodiment. An example of the functional configuration of the system 1 will be described with reference to the diagram. The example shown in the diagram is an example of a case where defect detection is performed by a drone 10. In this case, the drone 10 is equipped with at least an imaging device 40 and a defect detection device 20. Note that, although a description of the flight function and communication function, etc., of the drone 10 will be omitted, it is preferable that the drone 10 be equipped with the functions that a general drone has.

[0016] The imaging device 40 captures an image. Specifically, the imaging device 40 captures an image of the exterior of the equipment 50. The imaging device 40 may capture an image of the entire equipment 50, or may capture an image of a part of the equipment 50 (for example, a part of a bolt, nut, or the like that constitutes the equipment 50). The imaging device 40 outputs the captured image to the defect detection device 20.

[0017] The defect detection device 20 detects the presence or absence of defects based on the image captured by the imaging device 40. The detailed functional configuration of the defect detection device 20 will be described later with reference to FIG. 3. The defect detection device 20 outputs the determination result to the administrator device 30. The determination result by the defect detection device 20 may be information regarding the presence or absence of a defect, or information regarding the degree of the defect. The information regarding the presence or absence of a defect may be information regarding the presence or absence of loosening between the bolt and nut, information regarding the presence or absence of a split pin, or information regarding missing nuts. The information regarding the degree of the defect may be information regarding the degree of looseness.

[0018] [Fault detection device] 3 is a functional configuration diagram showing the functional configuration of the defect detection device according to this embodiment. An example of the functional configuration of the defect detection device 20 will be described with reference to the same diagram. The defect detection device 20 includes an image acquisition unit 21, an equipment identification unit 22, a component information acquisition unit 23, a defect detection unit 24, an output unit 25, and a component information storage unit 29. Note that the defect detection device 20 does not necessarily have to include the component information storage unit 29, and may, for example, be configured to include the component information storage unit 29 in a space on a server or the cloud. In the illustrated example, for simplicity of explanation, the defect detection device 20 will be described as including the component information storage unit 29.

[0019] The image acquiring unit 21 acquires an image of the equipment 50 to be inspected. Specifically, the image acquiring unit 21 acquires the image from the imaging device 40.

[0020] The equipment identification unit 22 identifies the equipment 50 shown in the acquired image. Identifying the equipment 50 may involve specifying a unique identification number assigned in advance to each equipment 50, or may involve identifying the type or model number of the equipment 50. Specifically, the equipment identification unit 22 may identify the equipment 50 by performing object recognition processing (object detection processing) on ​​the acquired image. Existing technology such as a convolutional neural network (CNN) can be used for the object recognition processing. The equipment identification unit 22 can also be said to identify the equipment based on the results of image processing of the acquired image. The information identified by the equipment identification unit 22 can also be called an equipment ID.

[0021] The part information acquisition unit 23 acquires part information about parts used in the equipment 50 based on the identification information identified by the equipment identification unit 22. Specifically, the part information acquisition unit 23 may acquire the part information by searching the part information storage unit 29. Here, the part information storage unit 29 stores correspondence information in which the identification information of the equipment 50 identified by the equipment identification unit 22 is associated with information about the parts used in the equipment 50. The part information acquisition unit 23 identifies the part information by searching for the correspondence information using the equipment ID as a key.

[0022] Here, the part information associated with the equipment 50 as the correspondence information may include, for example, the type and number of parts used. More specifically, the part information may include the type and number of bolts and nuts. The bolts and nuts are parts used in the equipment 50 shown in the image acquired by the image acquisition unit 21, and are parts identified by estimation based on the results of image processing of the image. In other words, the part information acquisition unit 23 can also be said to acquire information on correct data for parts used in the equipment 50 that is the inspection target.

[0023] The defect detection unit 24 detects whether a part used in the equipment 50 shown in the image is defective, based on the image acquired by the image acquisition unit 21 and the part information acquired by the part information acquisition unit 23. In other words, the defect detection unit 24 compares the part identified based on the image acquired by the image acquisition unit 21 with the part acquired by the part information acquisition unit 23, and detects a defect. Specifically, the defect detection unit 24 may detect that a part used in the equipment 50 shown in the acquired image is defective if it does not exist in the acquired part information. Note that the present embodiment is not limited to this example, and the defect detection unit 24 may detect the presence or absence of a defect, or the degree of the defect.

[0024] Depending on the component used in the equipment 50, a missing part may cause the component to be identified as a different component. Missing parts may refer to damage to a component, such as a drop. For example, a missing nut in a double nut may cause the component to be identified as a single nut. In such cases, it is preferable for the components used in the equipment 50 to have different colors depending on the component type. Specifically, by coloring the two nuts in the double nut red and the single nut yellow, even if a nut in the double nut is missing, only the red nut remains, making it distinguishable from the yellow single nut. In this case, the component information may include information corresponding to the component type and color. By adopting such a configuration, the defect detection unit 24 can detect whether a component is defective based on the color of the component used in the equipment 50 captured in the acquired image and the color associated with the component information. In other words, performing defect determination based on such color information facilitates determination. Furthermore, such a configuration can also prevent detection errors.

[0025] The output unit 25 outputs the result determined by the defect detection unit 24 to the manager device 30. Note that, if a part used in the equipment 50 shown in the image acquired by the image acquisition unit 21 does not exist in the part information acquired by the part information acquisition unit 23, the output unit 25 may output information about the correct part.

[0026] The defect detection unit 24 may detect whether a part used in the equipment 50 shown in the image is defective based on predetermined criteria. In this case, it is preferable that the criteria differ for each equipment 50. For example, if the equipment 50 requires stricter criteria, the requirement can be met by applying the criteria defined for each equipment 50. The criteria for each equipment 50 may be associated with the correspondence information and stored in the part information storage unit 29.

[0027] The criteria may be different for each management company that manages the facility 50. In practice, different criteria are used for each management company that manages communication towers, etc., and applying different criteria for each management company makes it possible for multiple management companies to use the system 1.

[0028] Furthermore, the criteria for detecting whether a part is defective may differ depending on the environment in which the equipment is located. For example, for equipment located on the seashore, criteria may be applied that take into account the fact that salt corrosion occurs early. Furthermore, the criteria may differ depending on the altitude at which the equipment is installed. Furthermore, the criteria may differ depending on two-dimensional information (latitude and longitude information) of the location at which the equipment is installed. Furthermore, even in the case of bolts and nuts, the criteria may differ depending on whether they are used in important locations.

[0029] Furthermore, the criteria may vary depending on how much time has passed since the previous inspection when the current inspection is performed. In other words, the criteria may vary depending on how much time has passed since the last inspection of the equipment 50 that uses the part.

[0030] [Fault detection section] Next, an example of the detailed functional configuration of the fault detection unit 24 will be described. The fault detection unit 24 includes an estimation unit 241 and a determination unit 242. Two types of functional configurations can be exemplified depending on the functions that the estimation unit 241 and the determination unit 242 each have (depending on how the functions are assigned). Each case will be described below with reference to Figs. 4 and 5.

[0031] 4 is a diagram showing a first example of the functional configuration of the defect detection unit according to this embodiment. The example shown in the figure shows a case where a tentative defect estimation is made in a state where the correct answer as to what kind of parts are used is not known, and then a final judgment is made taking the correct answer into consideration. In this case, the estimation unit 241 will be referred to as estimation unit 241A, and the judgment unit 242 will be referred to as judgment unit 242A.

[0032] The estimation unit 241A estimates the state of the parts used in the equipment depicted in the image acquired by the image acquisition unit 21. In other words, the estimation unit 241A makes a tentative (provisional) estimation of the part state in a state where the correct answer as to what parts are used in the equipment 50 to be inspected is not known.

[0033] The determination unit 242A determines whether or not the parts used in the equipment 50 are defective, based on the part states estimated by the estimation unit 241A and the part information acquired by the part information acquisition unit 23. In other words, the determination unit 242A can be said to make a final determination taking into consideration the correct answer information of the parts used in the equipment 50. The determination unit 242A outputs the determination result to the output unit 25.

[0034] 5 is a diagram showing a second example of the functional configuration of the defect detection unit according to this embodiment. The example shown in the figure is an example of a case where a defect is estimated after taking into consideration the correct answer as to what kind of parts are used, and then a final judgment is made. In this case, the estimation unit 241 will be referred to as estimation unit 241B, and the judgment unit 242 will be referred to as judgment unit 242B.

[0035] The estimation unit 241B estimates the state of the parts used in the equipment based on the images acquired by the image acquisition unit 21 and the part information acquired by the part information acquisition unit 23. In other words, the estimation unit 241B can be said to estimate the state of the parts in consideration of the correct answer information of the parts used in the equipment 50.

[0036] The determining unit 242B determines whether or not the parts used in the equipment are defective based on the part states estimated by the estimating unit 241 B. That is, the determining unit 242B makes a final determination.

[0037] [First Modification] 6 is a functional configuration diagram showing a first modified example of the functional configuration of a system according to this embodiment. With reference to the same figure, an example of the functional configuration of system 1A will be described. System 1A is a modified example of system 1. In the description of system 1A, the same reference numerals may be used to denote parts that have already been described with reference to system 1, and the description may be omitted.

[0038] System 1A differs from System 1 in that defect detection is performed by defect detection device 20A, which is a separate and independent configuration from drone 10. In this case, defect detection device 20A acquires an image of equipment 50, which is the object of inspection, from at least one of imaging device 40A, drone 10A, or storage device 60. Based on the acquired image, defect detection device 20A performs the same processing as the above-described defect detection device 20, and makes a judgment about the object of inspection shown in the acquired image.

[0039] The defect detection device 20A transmits the result of the defect detection to the administrator device 30. The defect detection device 20A may be located near the equipment 50, for example, and may determine whether or not a defect has been detected on an image captured around the equipment 50, and transmit the determination result to the administrator device 30 via a network line.

[0040] The imaging device 40A may be held by, for example, an inspector of the equipment 50, and the inspector may take images of the equipment 50. An example of the functional configuration of the imaging device 40A is a commonly used camera. The imaging device 40A provides the captured images to the defect detection device 20A via a predetermined wireless network, an information storage medium, or the like.

[0041] The drone 10A is an aircraft having an imaging function. It can also be said that the drone 10A does not have the function of the defect detection device 20, among the functions of the drone 10 described above. The drone 10A provides the captured images to the defect detection device 20A via a predetermined wireless network, an information storage medium, or the like.

[0042] The storage device 60 includes a hard disk drive (HDD), a solid state drive (SSD), a flash memory, a read only memory (ROM), etc. Images captured in advance by the imaging device 40A or the drone 10A are stored in the storage device 60. The storage device 60 may store multiple images. By using the storage device 60, defect detection processing can be performed on multiple images at the same time.

[0043] [Second Modification] 7 is a functional configuration diagram showing a second modified example of the functional configuration of the system according to this embodiment. With reference to the same figure, an example of the functional configuration of system 1B will be described. System 1B is a modified example of system 1. In the description of system 1B, the same reference numerals may be used to denote parts that have already been described with reference to system 1, and the description may be omitted.

[0044] System 1B differs from System 1 in that system 1B cooperates with a server 70, and defect detection at multiple sites is performed collectively by the server 70. In this case, the defect detection device 20B is provided in the server 70. The defect detection device 20B acquires images from various objects via a predetermined communication network NW. As an example of the various objects, the same figure illustrates multiple drones 10B. Specifically, the same figure illustrates multiple drones 10B-1 and multiple drones 10B-2 as the multiple drones 10B. The drone 10B may have a configuration similar to the drone 10A described above. As other examples of the various objects, the above-described imaging device 40A and storage device 60 may be used.

[0045] The defect detection device 20B performs the same processing as the defect detection device 20 described above based on the acquired image, and makes a judgment on the inspection object captured in the acquired image. The defect detection device 20B may transmit the defect detection result to the sender of the image (drone 10B), an administrator device 30 (not shown), or the like.

[0046] [Defect detection method] 8 is a flowchart showing a series of steps in the defect detection method according to this embodiment. A series of steps in the process performed using the defect detection device 20, the defect detection device 20A, or the defect detection device 20B will be described with reference to the same figure. When there is no need to distinguish between the defect detection device 20, the defect detection device 20A, and the defect detection device 20B, they may be simply referred to as the defect detection device 20.

[0047] (Step S11) First, the defect detection device 20 acquires an image of the equipment to be inspected. For example, the defect detection device 20 acquires an image captured by the drone 10. This process may be referred to as an image acquisition process or an image acquisition step.

[0048] (Step S12) Next, the defect detection device 20 identifies the equipment 50 shown in the acquired image based on the image. Specifically, the identification of the equipment 50 may be performed by object recognition processing using CNN or the like. This process may be referred to as an equipment identification process or an equipment identification step.

[0049] (Step S13) Next, the defect detection device 20 acquires information about parts used in the identified equipment 50. Specifically, the defect detection device 20 may acquire part information about the parts used in the equipment by searching for correspondence information that associates the equipment identification information with information about the parts used in the equipment, based on the identification information identified in the equipment identification process. This process may be referred to as a part information acquisition process or a part information acquisition step.

[0050] (Step S14) Finally, the defect detection device 20 judges the parts shown in the image. Specifically, the defect detection device 20 detects whether the parts shown in the image and used in the equipment 50 are defective, based on the acquired image and the acquired part information. This process may be referred to as a defect detection process or a defect detection step.

[0051] [Internal configuration] FIG. 9 is a block diagram showing an example of the internal configuration of a defect detection device according to this embodiment. The computer shown in FIG. 9 illustrates an example of a specific hardware configuration for realizing the defect detection device 20. The computer includes a central processing unit (processor) 901, a RAM 902, an input / output port 903, input / output devices 904 and 905, and a bus 906. The computer itself can be realized using existing technology. The central processing unit 901 executes instructions contained in a program read from the RAM 902 or the like. In accordance with each instruction, the central processing unit 901 writes data to the RAM 902, reads data from the RAM 902, and performs arithmetic and logical operations. The RAM 902 stores data and programs. Each element included in the RAM 902 has an address and can be accessed using the address. RAM is an abbreviation for "random access memory." The input / output port 903 is a port through which the central processing unit 901 exchanges data with external input / output devices. The input / output devices 904 and 905 are input / output devices. Input / output devices 904 and 905 exchange data with the central processing unit 901 via an input / output port 903. A bus 906 is a common communication path used within the computer. For example, the central processing unit 901 reads and writes data from and to a RAM 902 via the bus 906. Also, for example, the central processing unit 901 accesses an input / output port via the bus 906. All or part of the fault detection device 20 may be realized using hardware such as an ASIC, a PLD, or an FPGA. All or part of each functional unit may be realized by a combination of software and hardware.

[0052] [Summary of the embodiment] According to the embodiment described above, the defect detection device 20 includes an image acquisition unit 21, an equipment identification unit 22, a component information acquisition unit 23, a defect detection unit 24, and an output unit 25. The image acquisition unit 21 acquires an image of the equipment 50 to be inspected. The equipment identification unit 22 identifies the equipment 50 shown in the acquired image. The component information acquisition unit 23 acquires component information related to the components used in the equipment 50 by searching for correspondence information prepared in advance, based on the identification information identified by the equipment identification unit 22. Note that the correspondence information associates the identification information of the equipment 50 with information related to the components used in the equipment 50. The defect detection unit 24 detects whether the components used in the equipment 50 shown in the image are defective, based on the image acquired by the image acquisition unit 21 and the component information acquired by the component information acquisition unit 23.

[0053] By adopting such a configuration, the defect detection device 20 determines whether the parts used in the equipment 50 are non-defective, taking into account information about the parts originally used in the equipment 50. Examples of defects that the defect detection device 20 detects include the occurrence of defects such as cracks or looseness in parts such as bolts and nuts used in the equipment 50, the extent of the defects, and whether the wrong parts are used. According to this embodiment, even if, for example, one nut is missing due to a crack or the like in a location where a double nut should be used, resulting in a single nut, it can be detected as defective. Therefore, according to this embodiment, it is possible to accurately determine the parts used in the equipment 50 to be inspected.

[0054] The above-described embodiment makes it possible to "accurately determine the components used in the equipment to be inspected." The inspection target according to this embodiment is, for example, equipment used in wireless communication networks or transmission towers used in overhead power transmission lines. Therefore, this embodiment can contribute to Goal 9 of the United Nations-led Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote sustainable industrialization, and foster innovation."

[0055] Although an embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment, and design changes and the like are also included within the scope that does not deviate from the gist of the present invention.

[0056] In addition, a computer program for realizing the functions of each of the above-described devices may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read and executed by a computer system. Note that the "computer system" here may also include hardware such as an OS and peripheral devices. In addition, "computer-readable recording medium" refers to writable non-volatile memory such as a flexible disk, optical magnetic disk, ROM, or flash memory, portable media such as a DVD (Digital Versatile Disc), or a storage device such as a hard disk built into a computer system.

[0057] Furthermore, the term "computer-readable recording medium" also includes a storage medium that stores a program for a certain period of time, such as a volatile memory (e.g., DRAM (Dynamic Random Access Memory)) within a computer system that serves as a server or client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line. The program may also be transmitted from a computer system that stores the program in a storage device or the like to another computer system via a transmission medium or by transmission waves within the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may also be a program that realizes part of the aforementioned functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the aforementioned functions in combination with a program already stored in the computer system. [Explanation of symbols]

[0058] 1...system, 10...drone, 20...defect detection device, 30...administrator device, 40...imaging device, 50...equipment, 60...storage device, 70...server, 21...image acquisition unit, 22...equipment identification unit, 23...component information acquisition unit, 24...defect detection unit, 25...output unit, 29...component information storage unit

Claims

1. an image acquisition unit that acquires an image of the equipment to be inspected; an equipment identification unit that identifies the equipment captured in the acquired image; a parts information acquisition unit that acquires parts information related to the parts used in the equipment captured in the image by searching for correspondence information stored in a predetermined storage unit in which the identification information of the equipment is associated with information related to the parts used in the equipment, based on the identification information identified by the equipment identification unit; a defect detection unit that detects whether a part used in the equipment shown in the image is defective based on the acquired image and the acquired part information; Equipped with The parts used in the equipment vary in color depending on the type of part, the part information includes correspondence information between the type and color of the part, the defect detection unit detects whether the part used in the equipment is defective based on the color of the part captured in the acquired image and the part information. Defect detection device.

2. The defect detection unit an estimation unit that estimates the state of a part used in the equipment that is captured in the acquired image; a determination unit that determines whether or not a part used in the equipment is defective based on the part state estimated by the estimation unit and the part information acquired by the part information acquisition unit; The defect detection device according to claim 1 , comprising:

3. The defect detection unit an estimation unit that estimates a state of a part used in the equipment based on the image acquired by the image acquisition unit and the part information acquired by the part information acquisition unit; a determination unit that determines whether or not a part used in the equipment is defective based on the part condition estimated by the estimation unit; The defect detection device according to claim 1 , comprising:

4. The equipment identification unit identifies the equipment based on a result of image processing of the acquired image. The defect detection device according to any one of claims 1 to 3.

5. the defect detection unit detects that a part used in the equipment shown in the acquired image is defective when the part is not included in the acquired part information. The defect detection device according to any one of claims 1 to 3.

6. The parts used in the equipment shown in the acquired images are parts that are identified by estimation based on the results of image processing of the images.

6. The defect detection device according to claim 5.

7. an output unit that outputs information about a correct part when a part used in the equipment shown in the acquired image does not exist in the acquired part information; 6. The defect detection device according to claim 5.

8. the defect detection unit detects whether or not a part used in the equipment shown in the image is defective based on a predetermined judgment criterion. The defect detection device according to any one of claims 1 to 3.

9. The criteria for detecting whether or not the parts used in the equipment shown in the image are defective differ for each piece of equipment. The defect detection device according to claim 8 .

10. The criteria for detecting whether or not the parts used in the equipment shown in the image are defective differ depending on the management company that manages the equipment. The defect detection device according to claim 8 .

11. The criteria for detecting whether or not the parts used in the equipment shown in the image are defective vary depending on the environment in which the equipment is located. The defect detection device according to claim 8 .

12. The criteria for detecting whether or not the part used in the equipment shown in the image is defective vary depending on the period since the last inspection of the equipment using the part. The defect detection device according to claim 8 .

13. an image acquisition step of acquiring an image of the equipment to be inspected; an equipment identification step of identifying the equipment shown in the acquired image; a parts information acquisition step of acquiring parts information related to the parts used in the equipment captured in the image by searching for correspondence information stored in a predetermined storage unit in which the identification information of the equipment is associated with information related to the parts used in the equipment, based on the identification information identified in the equipment identification step; a defect detection step of detecting whether or not a part used in the equipment shown in the image is defective based on the acquired image and the acquired part information; and The parts used in the equipment vary in color depending on the type of part, the part information includes correspondence information between the type and color of the part, the defect detection step detects whether or not a part used in the equipment is defective based on the color of the part captured in the acquired image and the part information; Defect detection methods.

14. On the computer, an image acquisition step of acquiring an image of the equipment to be inspected; an equipment identification step of identifying the equipment captured in the acquired image; a parts information acquisition step of acquiring parts information on the parts used in the equipment captured in the image by searching for correspondence information stored in a predetermined storage unit in which the identification information of the equipment is associated with information on the parts used in the equipment, based on the identification information identified in the equipment identification step; a defect detection step of detecting whether or not a part used in the equipment shown in the image is defective based on the acquired image and the acquired part information; Execute The parts used in the equipment vary in color depending on the type of part, the part information includes correspondence information between the type and color of the part, the defect detection step detects whether or not a part used in the equipment is defective based on a color of the part captured in the acquired image and the part information; program.

Images