Maintenance support system and maintenance support method for wind turbine generator facility

Abstract

To provide a maintenance support system, etc., for wind turbine generator facilities that simplify processing in managing captured image information.SOLUTION: A maintenance support system 10 for wind turbine generator facilities comprises a control device 2 which acquires captured image information associated with capturing point information representing a capturing point of the tower of a windmill of the wind turbine generation facilities. Based upon a windmill information / tower information imparting database 1 in which windmill information including unit numbers of windmills, tower information including a height location of at least one of a flange and a weld line of the tower, and capturing point information representing the capturing point of the tower are associated with one another, the control device 2 generates a captured image information database 3 in which the captured image information is associated with the windmill information and tower information according to the capturing point information as a key.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a maintenance support system for wind power generation equipment and the like.

Background Art

[0002] As a technology related to the maintenance inspection of wind power generation equipment, for example, the technology described in Patent Document 1 is known. That is, Patent Document 1 describes "a structure display device that displays divided images obtained by dividing a structure into a plurality of imaging ranges, assigns identification information to each of the divided images, and manages one or more pieces of management information in association with the identification information."

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technology described in Patent Document 1, the method for managing the divided images of the structure is complicated, and there is room for simplifying the processing.

[0005] Therefore, an object of the present disclosure is to provide a maintenance support system for wind power generation equipment and the like that simplifies the processing for managing imaging image information.

Means for Solving the Problems

[0006] In order to solve the above-described problems, a maintenance support system for a wind power generation facility according to the present disclosure includes a processing unit that acquires imaging image information associated with imaging point information indicating an imaging point of a tower of a windmill of the wind power generation facility. The processing unit generates a second database in which the imaging image information is associated with the windmill information and the tower information, using the imaging point information as a key, based on a first database in which windmill information including the unit number of the windmill, tower information including at least one of the height positions of the flange and the weld line of the tower, and imaging point information indicating the imaging point of the tower are associated with each other.

Effect of the Invention

[0007] According to the present disclosure, it is possible to provide a maintenance support system for a wind power generation facility or the like that simplifies the processing for managing imaging image information.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Mode for Carrying Out the Invention

[0009] ≪First Embodiment≫ <Configuration of the Maintenance Support System for a Wind Power Generation Facility> FIG. 1 is a configuration diagram of a maintenance support system 10 for a wind power generation facility according to the first embodiment. The maintenance support system 10 shown in FIG. 1 is a system that generates an imaging image information database 3 based on information obtained by imaging a wind power generation facility W1 (see FIG. 3). Further, when predetermined extraction conditions are specified by an operation of an input device 4 by a user, the maintenance support system 10 also has a function of extracting predetermined imaging image information from the imaging image information database 3 based on the extraction conditions and displaying the imaging image information on a display device 5.

[0010] As shown in FIG. 1, the maintenance support system 10 includes a windmill information and tower information attaching database 1 (first database), a control device 2 (processing unit), an imaging image information database 3 (second database), an input device 4, and a display device 5. In the windmill information and tower information attaching database 1, imaging point information, windmill information, and tower information are stored in a state where they are associated with each other. Each of these pieces of information will be described later.

[0011] The control device 2 generates the imaging image information database 3 by associating predetermined windmill information and tower information with the imaging image information of the wind power generation facility W1 (see FIG. 3). Further, the control device 2 extracts predetermined imaging image information from the imaging image information database 3 based on the extraction conditions specified by an operation of the input device 4, and displays this imaging image information on the display device 5.

[0012] As shown in FIG. 1, the control device 2 includes an imaging image information input unit 2a, an imaging image information database generation unit 2b, an extraction condition specifying unit 2c, an imaging image information extraction unit 2d, and a display control unit 2e. The imaging image information input unit 2a acquires imaging image information by receiving the input of the imaging image information of the wind power generation facility W1 (see FIG. 3). For example, the imaging image information may be acquired from a predetermined computer (not shown) via a network (not shown). Alternatively, the imaging image information may be acquired from a recording medium (not shown) such as an SD card.

[0013] The imaging image information is image information generated by imaging the tower 31 (see FIG. 3) of the windmill 30 (see FIG. 3). As shown in FIG. 1, the imaging image information is associated with imaging point information indicating an imaging point and imaging date and time information indicating an imaging date and time.

[0014] The imaging image information database generation unit 2b generates an imaging image information database 3. That is, the imaging image information database generation unit 2b extracts windmill information and tower information corresponding to the imaging point information from the windmill information - tower information - attached database 1 based on the imaging point information associated with the imaging image information. Then, the imaging image information database generation unit 2b generates an imaging image information database 3 in which the imaging point information, the windmill information, the tower information, the imaging date and time information, and the imaging image information are associated with each other.

[0015] Note that the case where the imaging image information database 3 is updated by adding new data (new imaging image information, etc.) to the imaging image information database 3 is also included in the matter that the imaging image information database 3 is "generated".

[0016] The extraction condition specifying unit 2c reads a predetermined extraction condition input by an operation of the input device 4. Then, the extraction condition specifying unit 2c specifies a predetermined extraction condition to the imaging image information extraction unit 2d. Note that, as the input device 4, in addition to a mouse and a keyboard, a touch panel, a pen tablet, a touch pad, or the like is used. The imaging image information extraction unit 2d extracts predetermined imaging image information from the imaging image information database 3 based on the extraction conditions specified by the extraction condition specifying unit 2c.

[0017] The display control unit 2e causes the imaging image information extracted by the imaging image information extraction unit 2d to be displayed on the display device 5 in a predetermined manner. For example, the display control unit 2e may display an overall imaging image of the tower 31 (see FIG. 3) of the windmill 30 (see FIG. 3) specified by the operation of the input device 4, may magnify and display a portion of the welding line of the tower 31, or may display side by side imaging images of a plurality of towers 31 taken at different times. The display device 5 may be, for example, a display of a computer (not shown), or may be a display of a portable terminal such as a smartphone, a tablet, or smart glasses.

[0018] As described above, the imaging image information database 3 is a database in which imaging point information, windmill information, tower information, imaging date and time information, and imaging image information are associated. Details of the imaging image information database 3 will be described later.

[0019] FIG. 2 is an explanatory diagram showing an example of the hardware configuration of the control device 2 included in the maintenance support system. As shown in FIG. 2, the control device 2 includes a CPU 21 (Central Processing Unit), a RAM 22 (Random Access Memory), a ROM 23 (Read Only Memory), an HDD 24 (Hard Disk Drive), a communication interface 25, an input / output interface 26, and a media interface 27, and is configured as a computer in which these are connected via a bus 28.

[0020] The CPU 21 reads a predetermined program stored in the ROM 23 or the HDD 24 and expands it in the RAM 22, thereby executing a predetermined process. The communication interface 25 shown in FIG. 2 is connected to the communication device 6. And information transmission is performed between the communication device 6 via the communication interface 25. The input / output interface 26 is connected to the input device 4 and also connected to the display device 5. The media interface 27 is appropriately connected to the recording medium 7. And information is read from the recording medium 7 or written to the recording medium 7 via the media interface 27.

[0021] Note that the control device 2 may be composed of a single computer, or may be configured such that a plurality of computers (not shown) are connected via signal lines or a network. For example, the functions of the control device 2 may be distributed among a plurality of computers such as a cloud server or an edge server, and these computers may be connected via a network.

[0022] <Configuration of Wind Power Generation Equipment> FIG. 3 is an explanatory diagram of a wind power generation facility W1 that is the target of the maintenance support system. Note that "GL" (Ground Line) shown in FIG. 3 indicates the ground surface where the tower 31 is installed. Also, (X0, Y0) shown in FIG. 3 indicates the values of the X coordinate and Y coordinate of the center position of the tower 31 when the windmill 30 is viewed in plan. The wind power generation facility W1 shown in FIG. 3 is a facility that generates electricity as the blades 34a, 34b, and 34c rotate, and is configured to include the windmill 30.

[0023] The wind turbine 30 includes a tower 31, a nacelle 32, a hub 33, and blades 34a, 34b, 34c. The tower 31 is a column extending vertically from the ground surface. The nacelle 32 houses a speed increaser (not shown), a generator (not shown), and a power converter (not shown), and is installed above the tower 31. The hub 33 is a portion where the roots of the blades 34a, 34b, 34c are installed, and rotates integrally with the blades 34a, 34b, 34c. The blades 34a, 34b, 34c are rotor blades that convert the energy of the wind into rotational energy (kinetic energy).

[0024] With the rotation of the blades 34a, 34b, 34c, power generation is performed by a generator (not shown), and the generated power converted by a power converter (not shown) is transmitted to a power grid (not shown) via a power cable (not shown).

[0025] When the tower 31 and the blades 34a, 34b, 34c of the wind turbine 70 are subject to aging deterioration, cracks, rust, and paint peeling may occur. Therefore, maintenance inspections of the wind turbine 70 are regularly performed. In this embodiment, the maintenance inspection of the tower 31 will be mainly described, but the maintenance inspections of the blades 34a, 34b, 34c are also appropriately performed.

[0026] FIG. 4 is an explanatory diagram regarding the configuration of the tower 31 of the wind turbine. The tower 31 has a configuration in which split structures (reference numerals not shown) provided with flanges at the upper and lower ends are stacked vertically. The lower end of the split structure with the lowest height position is fixed to a foundation 31a embedded in the ground. Each split structure is provided with a flange at the connection location with another split structure. And the flanges of the split structures are butted against each other and fastened with a plurality of bolts (not shown).

[0027] The weld lines shown in Fig. 4 are the welded parts when each divided structure is formed. Specifically, one divided structure is formed by welding a plurality of cylindrical bodies (not shown) in a butted state. Therefore, each divided structure has one or more weld lines in the circumferential direction. Although not shown in Fig. 4, each divided structure also has weld lines in the height direction as the welded parts (welded parts of the steel plates bent into a cylindrical shape) when forming the above-mentioned cylindrical bodies. As shown in Fig. 4, an opening 31b for people to enter and exit is provided at the lower part of the tower 31. A door (not shown) that can be opened and closed is installed in the opening 31b.

[0028] As described above, when the aging of the tower 31 progresses, cracks, rust, and paint cracks may occur. In addition, cracks and the like are particularly likely to occur in the flanges and weld lines of the tower 31. Therefore, in the present embodiment, the tower 31 is imaged by a camera of an unmanned aerial vehicle (not shown) such as a drone, so as to generate imaging image information (a plurality of divided images in the height direction) of the tower 31. Note that the means for imaging the tower 31 is not limited to an unmanned aerial vehicle, and other means may be used. For example, a person may image the tower 31 using a camera from an aerial work platform (not shown). Hereinafter, as an example, the case where the tower 31 is imaged by a camera of an unmanned aerial vehicle (not shown) will be described.

[0029] Fig. 5 is an explanatory diagram of the windmill information and tower information providing database 1. The windmill information and tower information providing database 1 (the first database) shown in Fig. 5 is a database in which the imaging point information, the windmill information, and the tower information are associated with each other as described above. Such a windmill information and tower information providing database 1 is created in advance based on the input operation of the user.

[0030] The imaging point information shown in Fig. 5 is information indicating the imaging points of the tower 31 (see Fig. 3) of the windmill 30 (see Fig. 3) of the wind power generation facility W1 (see Fig. 3). In the example of Fig. 5, a plurality of imaging points are specified by X (latitude) · Y (longitude) · Z (altitude). Based on such imaging points, a flight route of an unmanned aerial vehicle (not shown) is set.

[0031] The unmanned aerial vehicle (not shown) flies along a predetermined flight route and images the tower 31 (see Fig. 3) of the windmill 30 at a plurality of imaging points. The imaging image information, which is the imaging result of the camera of the unmanned aerial vehicle, is associated with the imaging point information and the imaging date and time information (see also the left side of the drawing sheet in Fig. 1) and is appropriately stored in a computer (not shown) or a recording medium (not shown).

[0032] The windmill information shown in Fig. 5 is predetermined information regarding the windmill 30 (see Fig. 3). In the example of Fig. 5, the site, the unit number, the model, the tower azimuth angle, and the total length of the tower are included in the windmill information. In the column of "site", site information indicating the identification information of the site where the windmill 30 is installed is input. In the column of "unit number", the unit number of the windmill 30 to be the object of maintenance inspection is input. In the column of "model", windmill model information indicating the model of the windmill 30 is input. In the column of "tower azimuth angle", windmill tower azimuth angle information indicating the tower azimuth angle of the windmill 30 is input. For example, the azimuth angle of the opening 31b (see Fig. 4) provided at the lower part of the tower 31 (see Fig. 4) may be set as the "tower azimuth angle". The reference (0°) of the "tower azimuth angle" may be true north or another azimuth. In the column of "total length of the tower", tower height information, which is the total length in the height direction of the tower 31 (see Fig. 4), is input.

[0033] The tower information shown in FIG. 5 is information regarding a plurality of flanges and weld lines existing in tower 31 (see FIG. 4). The tower information includes, in addition to the height positions of the flanges and weld lines of tower 31, wall thickness information indicating the designed wall thickness value of tower 31. Note that the designed wall thickness value of tower 31 may be the wall thickness at the weld line or may be the wall thickness at a location other than the weld line. In the example of FIG. 5, the height position of the first flange counted from the top is H11 [m]. Also, for the weld line with the identification information “H1-1”, its wall thickness is t1 and its height position is H21 [m]. Thus, the height positions and the like of each of the plurality of flanges and weld lines existing in tower 31 are included in the tower information.

[0034] FIG. 6 is a flowchart regarding the generation of the captured image information database (also refer to FIG. 1 as appropriate). Note that it is assumed that the windmill information and tower information attached database 1 (see FIG. 5) has already been created at the time of “START” in FIG. 6. Also, it is assumed that a predetermined captured image information has been generated by capturing tower 31 (see FIG. 3) of windmill 30 (see FIG. 3). The captured image information has the captured point information and the captured date and time information associated therewith.

[0035] In step S101, the control device 2 (processing unit) acquires, by the captured image information input unit 2a, the captured image information associated with the captured point information and the captured date and time information (first step). In step S102, the control device 2 adds the windmill information and the tower information to the captured image information by the captured image information database generation unit 2b. As described above, the windmill information and tower information attached database 1 (see FIG. 5) includes the captured point information, and tower 31 (see FIG. 3) is captured at a plurality of captured points specified by this captured point information. The captured image information that is the result of the capture has the captured point information and the captured date and time information associated therewith. Here, the captured point information associated with the captured image information is based on the captured point information of the windmill information and tower information attached database 1 (see FIG. 5).

[0036] Therefore, in step S102, the control device 2 refers to the windmill information and tower information - attached database 1 (the first database: see FIG. 5), and identifies those having the same imaging point information as the imaging point information associated with the imaging - image information. Then, the control device 2 extracts the windmill information and tower information corresponding to this imaging point information from the windmill information and tower information - attached database 1, and adds these windmill information and tower information to the imaging - image information. That is, the control device 2 associates the windmill information and tower information with the imaging - image information using the imaging point information as a key.

[0037] In step S103, the control device 2 (processing unit) generates an imaging - image information database 3 by the imaging - image information database generation unit 2b. That is, the control device 2 generates an imaging - image information database 3 (the second database: see FIG. 7) in which the imaging - image information is associated with the windmill information and tower information using the imaging point information as a key based on the windmill information and tower information - attached database 1 (the first database: see FIG. 5) (the second step). Note that the "second step" includes steps S102 and S103 in FIG. 6.

[0038] By using the imaging point information as a key in this way, the control device 2 can simplify the processing when generating the imaging - image information database 3. After performing the processing of step S103, the control device 2 ends a series of processes related to the generation of the imaging - image information database 3 (END).

[0039] FIG. 7 is an explanatory diagram of the imaging - image information database 3. The imaging image information database 3 (second database) shown in FIG. 7 is a database in which the imaging point information, the windmill information, the tower information, the imaging date and time information, and the imaging image information are associated with each other. As described above, the "imaging point information", "windmill information", and "tower information" shown in FIG. 7 are the same as the data included in the windmill information and tower information providing database 1 (see FIG. 5), so the description thereof will be omitted. Also, in FIG. 7, the illustration of the "height position" included in the "tower information" is omitted, but actually, the information indicating the height positions of the respective flanges and weld lines of the tower 31 (see FIG. 4) is also included in the imaging image information database 3.

[0040] The imaging date and time information shown in FIG. 7 is information indicating the date and time when the tower 31 of the windmill 30 (see FIG. 3) was imaged. Specifically, the date (year, month, day) and the time (hour, minute, second) when the tower 31 of the windmill 30 was imaged are included in the imaging date and time information. The imaging image information is the image information obtained by imaging the tower 31 of the windmill 30. Note that since the imaging image information only needs to be displayable on the display device 5 (see FIG. 1), the data format of the imaging image information is not particularly limited.

[0041] FIG. 8 is a plan view showing the imaging direction at the imaging point. In FIG. 8, the circular area of the tower 31 is indicated by hatching. In the example of FIG. 8, with the azimuth on the front side where the opening 31b (see FIG. 4) of the tower 31 is provided as the reference azimuth (0°), the unmanned aerial vehicle (not shown) moves vertically at the position (X1, Y1) forming an angle α1 from the reference azimuth in a plan view, and images the tower 31. After imaging at the angle α1, the unmanned aerial vehicle moves to the position (X2, Y2) at the angle α2 along the circular orbit R1 indicated by the dashed line, and further images the tower 31 at a predetermined imaging point while moving vertically. In this way, imaging is performed in the order of the angles α1, α2, α3, α4. As described above, a predetermined flight route including the imaging point is preset.

[0042] FIG. 9 is an explanatory diagram showing an example of the flight route of the unmanned aerial vehicle. For example, when imaging the tower 31 at an angle α1 (see also FIG. 8) with a predetermined reference orientation being 0° in a plan view, as shown as the "outbound path" in FIG. 9, while a drone (not shown) ascends from the lower part to the upper part of the tower 31, the tower 31 is sequentially imaged at positions of heights Z1, ···, Zk.

[0043] Next, the drone (not shown) moves circumferentially at the upper part of the tower 31 and images the tower 31 at an angle α2 (see also FIG. 8). Specifically, while the drone descends from the upper part to the lower part of the tower 31, the tower 31 is sequentially imaged at positions of heights Zk, ···, Z1. Similarly, at an angle α3, the drone ascends along the "outbound path", and at an angle α4, the drone descends along the "return path" to image the tower 31 at predetermined imaging points. By setting the flight route of the drone in this way, the outer peripheral surface of the tower 31 can be efficiently imaged.

[0044] FIG. 10 is an explanatory diagram showing another example of the flight route of the drone. In the example of FIG. 10, at a height Z1, after imaging the tower 31 from a plan view angle α1 (see also FIG. 8) with a predetermined reference orientation being 0°, while the drone (not shown) moves circumferentially around the tower 31 along the "outbound path" flight route, the tower 31 is sequentially imaged at angles α2, α3, α4. Then, at an angle α4, the drone ascends to a position of height Z2 and moves circumferentially around the tower 31 along the "return path" flight route, and the tower 31 is sequentially imaged at angles α4, α3, α2. Even with such a flight route, the outer peripheral surface of the tower 31 can be efficiently imaged.

[0045] It should be noted that FIGS. 9 and 10 are just examples, and the flight route of the drone is not limited thereto. For example, the drone may image while ascending or descending spirally around the tower 31. Also, the flight route of the drone in a plan view is not limited to a circular orbit, and for example, it may be an elliptical orbit.

[0046] FIG. 11 is a flowchart regarding extraction and display of captured image information from a captured image information database (also refer to FIG. 1 as appropriate). Note that at the time of "START" in FIG. 11, it is assumed that the captured image information database 3 (refer to FIG. 7) has already been created based on the processing of the flowchart of FIG. 6 described above. In step S201, the control device 2 designates the extraction conditions for the captured image information by the extraction condition designation unit 2c based on the operation of the input device 4 by the user. In step S202, the control device 2 extracts the captured image information that conforms to the extraction conditions by the captured image information extraction unit 2d.

[0047] In step S203, the control device 2 designates the display format of the captured image information. Note that the display format of the captured image information is designated based on the operation of the input device 4 by the user. For example, a predetermined display format such as the first to fourth screen display examples (refer to FIGS. 12 to 16) described later is designated.

[0048] In step S204, the control device 2 causes the display control unit 2e to display the captured image information on the display device 5. That is, the control device 2 displays the captured image information that conforms to the predetermined extraction conditions specified by the user in a predetermined display format.

[0049] In this way, the control device 2 (processing unit) extracts predetermined captured image information from the captured image information database 3 (second database) based on the predetermined extraction conditions specified by the operation of the input device 4 (S201, S202), and causes the display device 5 to display the captured image information (S204). After performing the process of step S204, the control device 2 ends a series of processes regarding extraction and display of the captured image information (END).

[0050] <First screen display example> FIG. 12 is a first screen display example based on predetermined extraction conditions. Each of the rectangular images P1 shown in FIG. 12 is a captured image. Also, the position (X1, Y1) shown in FIG. 12 corresponds to the angle α1 (see FIG. 9) described above. Similarly, (X2, Y2), (X3, Y3), and (X4) correspond to the angles α2, α3, and α4 (see FIG. 9) in this order. Z1, Z2, ···, Zk shown in FIG. 12 indicate the height positions at the time of imaging. For example, the height position of Z1 is set to H1 [m] from the ground surface near the windmill (or the ground surface at the takeoff location of the unmanned aircraft). The same applies to the height positions of Z2, Z3, ···, Zk.

[0051] Based on the latitude (X), longitude (Y), and altitude (Z) of the imaging points included in the imaging point information, the control device 2 (processing unit) causes a plurality of captured images with different height positions of the imaging points to be displayed continuously in the height direction of the tower on the display screen of the display device 5 (see FIG. 1). This enhances the visibility when the user views the captured image of the tower. Also, regardless of the imaging order, a plurality of captured images can be displayed in an aligned state along the height direction of the tower on the display screen.

[0052] In the example of FIG. 12, the captured image information obtained by imaging the windmill of Unit 1 with the site name "A" on July 10, 2023 is displayed. Thus, when the site name, the unit number of the windmill, and the imaging date and time information are given as extraction conditions, the control device 2 (see FIG. 1) extracts the captured image information that meets these extraction conditions from the captured image information database 3 (see FIG. 1) and causes the display device 5 (see FIG. 1) to display the captured image information. In the example of FIG. 12, each captured image when the tower is imaged from different angles in the circumferential direction is displayed continuously in the height direction. Note that the imaging ranges of the captured images adjacent in the height direction may partially overlap. This can prevent gaps from occurring in the imaging range with respect to the tower.

[0053] In addition, the number of captured images when a plurality of captured images are displayed continuously in the height direction of the tower on the display screen is preset. In the example of FIG. 12, it is set such that a total of eight captured images are arranged along the height direction of the tower on the display screen. If there is a shortage or excess in the number of actually arranged captured images that are continuous in the height direction of the tower on the display screen with respect to the preset number, the control device 2 (see FIG. 1) causes the display device 5 (see FIG. 1) to display a message indicating that there is a shortage or excess in the number of captured images. As a result, the user can grasp that there is a missing captured image or the like.

[0054] Also, as shown by the mouse pointer M1 in FIG. 12, when a predetermined image is selected by a user's input operation, the control device 2 enlarges and displays the captured image as shown in FIG. 13 below.

[0055] FIG. 13 is a display example when the image selected by the user's input operation is enlarged and displayed. For example, when a captured image in which the imaging point in plan view is (X1, Y1) and the height position of the imaging point is Z1 is selected by the user's input operation (see also FIG. 12), the control device 2 (see FIG. 1) causes the display device 5 (see FIG. 1) to display an enlarged image as shown in FIG. 13. That is, when one (or more) of a plurality of captured images having different height positions of the imaging point is selected based on the operation of the input device 4 (see FIG. 1), the control device 2 (processing unit) enlarges and displays the selected captured image on the display device 5. As a result, it becomes easier for the user to visually recognize the flange and weld line of the tower, and it becomes easier for the user to find the damaged part of the tower.

[0056] <Second Screen Display Example> FIG. 14 is a second screen display example based on predetermined extraction conditions. In the example of FIG. 14, four captured images of the wind turbine of Unit 1 with the site name "A" captured from the imaging point (X1, Y1) in a plan view are displayed side by side. Specifically, from the left of the display screen, the captured image on July 10, 2020, the captured image on July 10, 2021, the captured image on July 10, 2022, and the captured image on July 10, 2023 are arranged and displayed on one screen.

[0057] As described above, when the site name, the unit number of the wind turbine, and the imaging point information are given as extraction conditions, the control device 2 (see FIG. 1) extracts the imaging image information that conforms to this extraction condition from the imaging image information database 3 (see FIG. 1), and causes the display device 5 (see FIG. 1) to display the imaging image information. In the example of FIG. 14, a plurality of captured images with different capture dates and times are arranged and displayed on one display screen. This makes it easier for the user to grasp the transition of the aging deterioration of the tower.

[0058] <Third Screen Display Example> FIG. 15 is a third screen display example based on a predetermined extraction condition. In the example of FIG. 15, four captured images are displayed side by side when the wind turbines of Units 1, 2, 3, and 4 with the site name "A" are captured from a predetermined tower orientation. Specifically, from the left of the display screen, the captured images of Unit 1, Unit 2, Unit 3, and Unit 4 are arranged and displayed on one screen. Note that the "tower orientation" is the orientation when the front side where the opening 31b for the door (see FIG. 4) is provided is the reference orientation (0°).

[0059] As described above, when the site name, a plurality of unit numbers of the wind turbines, and the tower orientation are given as extraction conditions, the control device 2 (see FIG. 1) extracts the imaging image information that conforms to this extraction condition from the imaging image information database 3 (see FIG. 1), and causes the display device 5 (see FIG. 1) to display the imaging image information. In the example of FIG. 15, the tower images of a plurality of wind turbines with different unit numbers are arranged and displayed on one screen. This makes it easier for the user to visually compare the images of a plurality of wind turbines with different unit numbers captured from a predetermined tower orientation.

[0060] As a result, for example, it becomes easier for the user to understand which wind turbine of which unit is likely to cause deterioration of the tower at the site of "A". Also, by collectively displaying the captured images of each of the plurality of wind turbines from the direction with a high risk of damage (for example, the direction where strong winds are likely to hit), it becomes easier for the user to check whether there is damage to the tower.

[0061] <Fourth Screen Display Example> FIG. 16 is a fourth screen display example based on predetermined extraction conditions. Note that the captured image displayed on the left side of FIG. 16 is a predetermined reference image. Here, the reference image is a captured image obtained by imaging within a predetermined period (within a period when it is assumed that there is almost no damage to the tower) from the time of completion of the construction of the tower or during maintenance. For example, an image captured within one year from the completion of the construction of the tower may be used as the reference image. Such a reference image is used as a reference image when comparing with subsequent captured images.

[0062] In the example of FIG. 16, the captured image (on the right side of the display screen) of the wind turbine of Unit 1 with the site name "A" captured from a predetermined imaging point on July 10, 2023, is displayed on one screen side by side with the reference image (on the left side of the display screen). In this way, when a predetermined wind turbine is specified and the imaging point and imaging date and time of the wind turbine are specified based on the operation of the input device 4 (see FIG. 1), the control device 2 (processing unit) causes the captured image information of the wind turbine and the reference image information of the wind turbine to be displayed side by side on the display screen of the display device 5 (see FIG. 1). As a result, it becomes easier for the user to visually compare the reference image of the tower in a state with almost no damage and the captured image obtained by subsequent imaging. As a result, the user can appropriately set the future repair time based on the imaging date and time of each of the captured image and the reference image and the state of the tower in the captured image.

[0063] Further, the control device 2 (see FIG. 1) may display a plurality of captured images in chronological order together with the reference image. This makes it easier for the user to grasp the temporal change of the outer peripheral surface of the tower while comparing each captured image with the reference image.

[0064] Note that the above-described first to fourth display screen examples (see FIGS. 12 to 16) are merely examples and are not limited thereto. That is, when at least one of the imaging point information, the windmill information, the tower information, and the imaging date and time information is specified as an extraction condition by an operation of the input device 4 (see FIG. 1), the control device 2 (processing unit) causes the display device 5 (see FIG. 1) to display a captured image corresponding to the extraction condition. As a result, a predetermined image that matches the user's extraction condition is displayed on the display device 5, reducing the burden on the user when performing inspections while viewing the screen of the display device 5.

[0065] <Highlighting of flange etc.> FIG. 17 is an example of a screen display when the flange of the tower is highlighted. In the example of FIG. 17, the characters "flange highlighting" are displayed, and further, a plurality of flanges included in the captured image of the tower are highlighted by being surrounded by a square frame Q1. When the highlighting is performed, it is assumed that "flange highlighting" is selected by an operation of the input device 4 (see FIG. 1) by the user. Also, the position of the flange on the display screen is specified based on the information on the height position of the flange in the captured image information database 3 (see FIG. 7) and template matching.

[0066] Note that the method of highlighting the flange is not limited to the example in FIG. 17. For example, the flange portion may be displayed with a horizontal line of a predetermined color. Also, characters that can identify the flange, such as "first flange" or "FR-001", may be displayed on the side of the flange. Such a display is also included in the "highlighting" of the flange. Further, when a predetermined flange is selected by operating the input device 4 (see FIG. 1), the captured image including the flange may be enlarged and displayed. This makes it easier for the user to visually confirm whether there is damage to the flange.

[0067] Also, in the example of FIG. 17, the case where the flange is highlighted is shown, but instead of (or together with) the flange, the welding line of the tower may be highlighted. When highlighting both the flange and the welding line, the color of highlighting the flange and the color of highlighting the welding line may be made different. This makes it easier for the user to distinguish between the flange and the welding line.

[0068] In this way, when the control device 2 (processing unit) causes the display device 5 (see FIG. 1) to display the captured image information specified by operating the input device 4, at least one of the flange and the welding line is highlighted. This makes it easier for the user to visually confirm the locations of the flange and the welding line where damage is likely to occur. Also, it is possible to prevent the user from overlooking each flange and welding line when checking them.

[0069] <Effect> According to the first embodiment, the control device 2 directly associates the windmill information and the tower information with the captured image information using the imaging point information as a key. As a result, processes such as attaching identification information to each captured image information become unnecessary, so that the process of generating the captured image information database 3 (second database) by the control device 2 (processing unit) can be simplified, and the processing load on the control device 2 can be reduced.

[0070] In addition, when the control device 2 generates the captured image information database 3, it is only necessary that the captured image information is associated with the captured point information, which facilitates the integration of data with different formats. Further, the captured point information, the wind turbine information, the tower information, the captured date and time information, and the captured image information are associated and managed uniformly as the captured image information database 3. As a result, the captured image information based on various extraction conditions can be extracted and displayed on the display device 5, improving the convenience for the user.

[0071] Also, based on the extraction conditions specified by the user, predetermined captured image information is extracted from the captured image information database 3. As a result, the user can compare the captured images of a plurality of towers captured during the same period, or compare the captured images obtained by capturing a predetermined tower at a plurality of different times. Further, by arranging the captured image and the reference image side by side for display, it becomes easier for the user to find damage to the tower.

[0072] ≪Second Embodiment≫ The second embodiment is different from the first embodiment in that the control device 2A (see FIG. 18) includes a deterioration damage diagnosis unit 2f (see FIG. 18). Further, the second embodiment is different from the first embodiment in that the diagnosis result of the deterioration damage diagnosis unit 2f is superimposed and displayed on the captured image of the tower. Note that the other aspects are the same as those of the first embodiment. Therefore, the parts different from the first embodiment will be described, and the description of the overlapping parts will be omitted.

[0073] FIG. 18 is a configuration diagram of a maintenance support system 10A for a wind power generation facility according to the second embodiment. The control device 2A of the maintenance support system 10A shown in FIG. 18 includes a deterioration damage diagnosis unit 2f in addition to the configuration described in the first embodiment (see FIG. 1). The deterioration damage diagnosis unit 2f diagnoses the presence or absence of deterioration or damage of the tower using the captured image information based on predetermined extraction conditions. Examples of "deterioration" of the tower include rusting and paint cracking of the tower. Examples of "damage" to the tower include cracks on the outer surface of the tower.

[0074] The control device 2A (processing unit) performs machine learning using, as teacher data, captured images that are known to be locations of deterioration or damage in the tower. Then, the control device 2A diagnoses the presence or absence of deterioration or damage in the tower based on predetermined captured image information extracted based on predetermined extraction conditions and the learning results of the machine learning. In such machine learning, AI (Artificial Intelligence) may be used. This makes it possible to detect minor deterioration and damage that the user may overlook. Also, the burden on the user when visually inspecting the presence or absence of deterioration or damage can be reduced. The diagnosis result of the deterioration and damage diagnosis unit 2f is displayed on the display device 5 by the display control unit 2e in a predetermined manner.

[0075] Note that the control device 2A (processing unit) may perform machine learning in advance using, as teacher data, captured images of the flange or weld line of the tower, and based on the learning results, highlight the flange or weld line included in the captured images extracted from the image information database. This improves the accuracy when the control device 2A highlights the flange or weld line.

[0076] FIG. 19 is an example of a display screen regarding the damaged part D1 of the tower. In the example of FIG. 19, the characters "Highlighted display of damaged part" are displayed, and further, the location of the damaged part D1 in the captured image of the tower is highlighted. As such a highlighted display, in FIG. 19, a partial image including the damaged part D1 is enlarged and displayed. Note that the method of the highlighted display is not limited to the example of FIG. 19. For example, the damaged part D1 may be surrounded by a predetermined frame line or a circular line. Also, characters such as "Damaged part" may be displayed in association with the damaged part D1 on the display screen. These processes are also included in the "highlighted display" of the damaged part D1.

[0077] In this way, when the control device 2A (processing unit: see FIG. 18) diagnoses that there is a location of deterioration or damage in the tower, it highlights the location on the display screen of the display device 5. As a result, the user can immediately grasp where the damage is in the tower, so that the efficiency of the confirmation work on the display screen can be improved. In addition, variations in judgment due to differences in the proficiency levels of individual users can be suppressed.

[0078] In the example of FIG. 19, the characters "Thickness display of damaged part" are displayed, and further, the thickness of the tower (the designed value of the thickness at the location of deterioration or damage) is displayed in the enlarged image of the damaged part. As such a thickness of the tower, for example, the designed value of the thickness included in the imaging image information database 3 (see FIG. 18) is used.

[0079] In this way, when the control device 2A (processing unit: see FIG. 18) diagnoses that there is a location of deterioration or damage in the tower, it causes the display device 5 to display thickness information indicating the thickness of the tower at the location, in association with the location. As a result, the user can grasp the priority of subsequent repair work, and it becomes easier for the user to judge the necessity of detailed inspections such as non-destructive inspections. Note that, generally, the thinner the thickness of the damaged part D1, the higher the priority of the repair work. In addition, the presence or absence of highlighting and thickness display of the damaged part D1 is set based on the operation of the input device 4 (see FIG. 18) by the user.

[0080] FIG. 20 is another example of a display screen regarding the damaged part D1 of the tower. In the example of FIG. 20, the azimuth angle and altitude of the damaged part are displayed in the enlarged area of the damaged part D1. Also, the azimuth angle and altitude of the damaged part D1 are displayed at the location where the site name and unit number are displayed. In this way, when it is diagnosed that there is a location of deterioration or damage in the tower, the control device 2A (processing unit: see FIG. 18) causes the display device 5 (see FIG. 18) to display the azimuth angle and altitude of the location with reference to the central position of the tower in plan view, in association with the location.

[0081] As a result, the user can grasp the azimuth and altitude of the damaged part D1. Therefore, when a worker later enters the inside of the tower to visually inspect the damaged part D1 or perform a detailed inspection such as a non-destructive inspection, the position of the damaged part D1 can be easily identified. In addition, when the user estimates whether there is a damaged part at the same location on the towers of other wind turbines existing at the same site as the wind turbine where the damaged part D1 was found, it can be used as a basis for judgment.

[0082] FIG. 21 is another example of a display screen regarding the damaged part D1 of the tower. In the example of FIG. 21, the dimensions of the damaged part D1 are displayed in the part where the damaged part D1 is enlarged. Also, the dimensions of the damaged part D1 are displayed at the location where the site name and the unit number are displayed. In this way, when the control device 2A (processing unit: see FIG. 18) diagnoses that there is a deteriorated or damaged part of the tower, it causes the display device 5 (see FIG. 18) to display the dimensions of the relevant part in association with the relevant part. By displaying the dimensions of the damaged part D1 in this way, the user can grasp the size of the damaged part D1.

[0083] Note that the dimensions of the damaged part D1 are calculated, for example, by multiplying the number of pixels in the part corresponding to the damaged part on the display screen by a predetermined magnification. Also, when the user designates the range of the damaged part D1 based on the operation of the input device 4 (see FIG. 18), the dimensions of the damaged part D1 may be calculated based on the number of pixels in the range.

[0084] Alternatively (or together with the dimensions of the damaged part D1), the control device 2A (see 18) may cause the area of the damaged part D1 to be displayed. That is, when the control device 2A (processing unit: see FIG. 18) diagnoses that there is a deteriorated or damaged part of the tower, it causes the display device 5 (see FIG. 18) to display at least one of the dimensions and the area of the relevant part in association with the relevant part. As a result, the user can grasp the dimensions and the area of the damaged part D1.

[0085] In addition, when it is diagnosed that there is a deteriorated or damaged part of the tower, the control device 2A (see FIG. 18) may display enlarged images of the part in chronological order. Thereby, the user can grasp how the deteriorated or damaged part has changed.

[0086] Further, when the control device 2A (see FIG. 18) diagnoses that there is a damaged or deteriorated part of the tower, the part may be marked to leave a history. Also, for a part that the user visually examines the captured image and determines may correspond to damage or deterioration of the tower, the part may be marked by operating the input device 4 (see FIG. 18) to leave a history. For example, a part designated by the user's mouse drag on the display screen may be left as a colored image. Thereby, overlooking minor deterioration can be suppressed.

[0087] <Effect> According to the second embodiment, the damage diagnosis unit 2f of the control device 2A can find the damaged part of the tower. In addition, by the control device 2A highlighting the damaged part, the visibility for the user is enhanced. Also, by displaying the azimuth angle, altitude, dimensions, and area of the damaged part, the user can easily grasp where on the tower there is damage of what size.

[0088] ≪Modification Example≫ As described above, the maintenance support system and maintenance support method for the wind power generation facility according to the present disclosure have been described in each embodiment, but the present disclosure is not limited to these descriptions and various changes can be made. For example, in each embodiment, the case where information indicating the height positions of the flange and the weld line is stored in the wind turbine information and tower information providing database 1 (first database: see FIG. 5) has been described, but the present invention is not limited to this. That is, tower information including the height position of at least one of the flange and the weld line of the tower may be included in the wind turbine information and tower information providing database 1 (first database). In this case, the tower information in the imaging image information database 3 (second database) shall also include the height position of at least one of the flange and the weld line of the tower. Even with such a configuration, the same effects as those of each embodiment can be achieved.

[0089] In each embodiment, the case where the site, the unit number, the model, the tower azimuth angle, and the total length of the tower are included in the wind turbine information (see FIGS. 5 and 7) has been described, but the present invention is not limited to this. That is, at least one of the site, the unit number, the model, the tower azimuth angle, and the total length of the tower may be included in the wind turbine information. In each embodiment, in addition to the height positions of the flange and the weld line of the tower, the case where the value of the wall thickness of the tower at the weld line is included in the tower information has been described (see FIGS. 5 and 7), but the present invention is not limited to this. For example, at least one of the inner diameter and the outer diameter of the tower at the weld line may be included in the tower information. In the embodiment, the case where the wind turbine is provided on the ground has been described, but the present invention is not limited to this. For example, the embodiment can also be applied when imaging the tower of a wind turbine such as an offshore wind farm.

[0090] In addition, each of the above-described configurations, functions, processing units, processing means, etc. may be realized in hardware by designing a part or all of them, for example, by using an integrated circuit. Also, each of the above-described configurations, functions, etc. may be realized in software by a processor interpreting and executing a program for realizing each function. Information such as programs, tables, and files for realizing each function can be stored in a memory, a recording device such as a hard disk or an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD. In addition, the control lines and information lines show those considered necessary for explanation, and not all control lines and information lines are necessarily shown on the product. In reality, it may be considered that almost all components are interconnected.

Explanation of Signs

[0091] 1 Windmill Information and Tower Information Granting Database (First Database) 2, 2A Control Device (Processing Unit) 2a Imaging Image Information Input Unit 2b Imaging Image Information Database Generation Unit 2c Extraction Condition Designation Unit 2d Imaging Image Information Extraction Unit 2e Display Control Unit 2f Deterioration and Damage Diagnosis Unit 3 Imaging Image Information Database (Second Database) 4 Input Device 5 Display Device 10, 10A Maintenance Support System 30 Windmill 31 Tower D1 Damage Part S101 Step (First Step) S102, S103 Steps (Second Step) W1 Wind Power Generation Equipment

Claims

1. A maintenance support system for a wind power generation facility, comprising a processing unit that acquires imaging image information associated with imaging point information indicating an imaging point of a tower of a windmill of the wind power generation facility, wherein the processing unit generates a second database in which the imaging image information is associated with the windmill information and the tower information, using the imaging point information as a key, based on a first database in which windmill information including the unit number of the windmill, tower information including at least one of the height positions of the flange and the weld line of the tower, and imaging point information indicating the imaging point of the tower are associated with each other.

2. The processing unit extracts predetermined imaging image information from the second database based on a predetermined extraction condition specified by an operation of an input device, and causes a display device to display the imaging image information. The maintenance support system for a wind power generation facility according to claim 1, characterized in that.

3. The windmill information includes the unit number, site information indicating identification information of a site that is the installation location of the windmill, windmill type information indicating the type of the windmill, and windmill tower azimuth angle information indicating the azimuth angle of the tower of the windmill. The maintenance support system for a wind power generation facility according to claim 1, characterized in that.

4. The tower information includes wall thickness information indicating a designed value of the wall thickness of the tower. The maintenance support system for a wind power generation facility according to claim 1, characterized in that.

5. Based on the latitude, longitude, and altitude of the imaging point included in the imaging point information, the processing unit causes a plurality of imaging images with different height positions of the imaging point to be displayed continuously in the height direction of the tower on a display screen of the display device. The maintenance support system for a wind power generation facility according to claim 1, characterized in that.

6. When one or more of a plurality of imaging images with different height positions of the imaging point are selected based on an operation of an input device, the processing unit causes the display device to display the selected imaging image in an enlarged manner. The maintenance support system for a wind power generation facility according to claim 5, characterized in that.

7. The second database includes imaging date and time information indicating the imaging date and time of the tower. When at least one of the imaging point information, the wind turbine information, the tower information, and the imaging date and time information is specified as the extraction condition by an operation of the input device, the processing unit causes the display device to display an imaging image corresponding to the extraction condition. The maintenance support system for a wind power generation facility according to claim 2, characterized in that.

8. The second database includes reference image information obtained by imaging within a predetermined period from the completion of construction or maintenance of the tower. When a predetermined wind turbine is specified based on an operation of the input device and the imaging point and imaging date and time of the wind turbine are specified, the processing unit displays the imaging image information of the wind turbine and the reference image information of the wind turbine side by side on the display screen of the display device. The maintenance support system for a wind power generation facility according to claim 2, characterized in that.

9. When the processing unit causes the display device to display the imaging image information specified by the operation of the input device, the processing unit highlights at least one of the flange and the weld line. The maintenance support system for a wind power generation facility according to claim 2, characterized in that.

10. The processing unit performs machine learning using, as teacher data, an imaging image known to be a location of deterioration or damage in the tower, and based on the predetermined imaging image information extracted based on the extraction condition and the learning result of the machine learning, diagnoses the presence or absence of deterioration or damage in the tower. The maintenance support system for a wind power generation facility according to claim 2, characterized in that.

11. When the processing unit diagnoses that there is a location of deterioration or damage in the tower, the processing unit highlights the location on the display screen of the display device. The maintenance support system for a wind power generation facility according to claim 10, characterized in that.

12. When the processing unit diagnoses that there is a location of deterioration or damage in the tower, the processing unit causes the display device to display, in association with the location, wall thickness information indicating the designed value of the wall thickness of the tower at the location. The maintenance support system for a wind power generation facility according to claim 10, characterized in that.

13. When the processing unit diagnoses that there is a location of deterioration or damage in the tower, the processing unit causes the display device to display, in association with the location, the azimuth angle and altitude of the location with respect to the center position of the tower in plan view. The maintenance support system for a wind power generation facility according to claim 10, characterized in that.

14. When the processing unit diagnoses that there is a deteriorated or damaged portion of the tower, it causes the display device to display at least one of the dimensions and area of the portion in association with the portion. The maintenance support system for a wind power generation facility according to claim 10, characterized by the above.

15. A first step in which the processing unit acquires imaging image information associated with imaging point information indicating an imaging point of a tower of a wind turbine of a wind power generation facility; A second step in which the processing unit generates a second database in which the imaging image information is associated with the wind turbine information and the tower information, using the imaging point information as a key, based on a first database in which wind turbine information including the unit number of the wind turbine, tower information including the height position of at least one of the flange and the weld line of the tower, and imaging point information indicating the imaging point of the tower are associated with each other. A maintenance support method for a wind power generation facility, comprising:

Images