Fan blade state detection method and device

Through automatic image shooting of drones and ultrasonic distance measurement detection, the problem of wind turbine blades is solved, efficient and safe blade status monitoring is achieved, and detection complexity and power generation loss are reduced.

CN119062529AActive Publication Date: 2024-12-03GOLDWIND SCI & TECH CO LTD

Patent Information

Application Number
CN202411470509.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-18
Publication Date
2024-12-03
Estimated Expiration
2044-10-18

AI Technical Summary

Technical Problem

The blades of wind turbine units are easily damaged during high-speed operation, resulting in reduced power generation performance or safety risks. The existing detection methods are costly, complex and difficult to monitor deterioration status such as blade cracks in real time.

Method used

The drone is used to automatically take images based on the operating status of the fan, and to detect the blade status through an ultrasonic ranging device to achieve efficient detection without shutdown.

Benefits of technology

It reduces the power generation loss of wind farms, simplifies the detection process, improves the accuracy and safety of blade status judgment, and reduces the operational complexity and workload of relevant personnel.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119062529A_ABST
    Figure CN119062529A_ABST
Patent Text Reader

Abstract

The invention discloses a fan blade state detection method and device, and the method comprises the steps: enabling a controller of an unmanned plane to receive fan state data through the communication connection between the unmanned plane and a fan; a controller of the unmanned aerial vehicle responds to the fan state data to indicate that the fan is in a running state, the unmanned aerial vehicle is controlled to fly according to a first route to shoot fan blades to obtain a first image, and the fan blade state is detected through the first image; the controller of the unmanned aerial vehicle responds to the fan state data to indicate that the fan is in a shutdown state, the unmanned aerial vehicle is controlled to fly according to a second route to shoot fan blades to obtain a second image, and the fan blade state is detected through the second image, the first image comprises images of all fan blades shot at preset time intervals when the unmanned aerial vehicle is in a hovering state, and the second image comprises images of all fan blades shot in real time when the unmanned aerial vehicle is in a non-hovering state.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure generally relates to the field of wind power generation technology, and more specifically, to a method and device for detecting the status of wind turbine blades. Background Art

[0002] In the wind power industry, as the demand for the use of wind energy becomes stronger to achieve greater power benefits, the capacity of wind turbines (hereinafter referred to as "turbines") and the blades of wind turbines (hereinafter referred to as "wind turbines") are becoming larger and larger. However, under this development trend, as the blade length of wind turbines (for example, megawatt-class turbines) increases, the asymmetric load effects on the turbines caused by factors such as wind shear effect, tower shadow effect and turbulence may intensify.

[0003] As the main component for converting wind energy into mechanical energy, the fan blades are affected by high-speed centrifugal force and alternating airflow force while driving the impeller to rotate. In addition, the working environment of the fan is relatively harsh, which may cause the condition of the fan blades to deteriorate after the fan has been running for a period of time. For example, cracks may occur. The deterioration of the blade condition may not only affect the power generation performance of the fan, but may even cause the blades to break. In this case, due to the high impeller speed, the broken blades have greater energy, which may cause serious accidents and even safety risks of sweeping the tower. Therefore, timely detection of the blade status is of great significance and role in the safe operation of the fan. Summary of the invention

[0004] The embodiments of the present disclosure provide a method and device for detecting the status of wind turbine blades, thereby utilizing a drone to automatically capture images according to the actual operating status of the wind turbine to detect the status of the wind turbine blades.

[0005] In a general aspect, a method for detecting the status of wind turbine blades is provided, the detection method being applied to a controller of an unmanned aerial vehicle, the detection method comprising: receiving, by the controller of the unmanned aerial vehicle status data, wind turbine status data via a communication connection between the unmanned aerial vehicle and the wind turbine; controlling, by the controller of the unmanned aerial vehicle, in response to the wind turbine status data indicating that the wind turbine is in an operating state, to photograph the wind turbine blades to obtain a first image, so as to detect the status of the wind turbine blades through the first image; controlling, by the controller of the unmanned aerial vehicle, in response to the wind turbine status data indicating that the wind turbine is in a stopped state, to photograph the wind turbine blades to obtain a second image, so as to detect the status of the wind turbine blades through the second image, wherein the first image includes images of all wind blades photographed at preset time intervals when the unmanned aerial vehicle is in a hovering state, and the second image includes images of all wind blades photographed in real time when the unmanned aerial vehicle is in a non-hovering state.

[0006] Optionally, in response to the wind turbine status data indicating that the wind turbine is in an operating state, the step of controlling the UAV to fly along a first route to photograph the wind turbine to obtain a first image, so as to detect the status of the wind turbine blades through the first image may include: in response to the wind turbine status data indicating that the wind turbine is in an operating state, performing the following processing: based on the wind turbine hub height in the wind turbine status data, controlling the UAV to fly along the first route to a preset hovering position and then hover; after the UAV hovers, photographing the wind blades to obtain a first image, so as to detect the status of the wind turbine blades through the first image, wherein the first route includes a route from the UAV taking off to hovering, and the preset hovering position is a position at a first preset distance from the wind turbine hub plane and a second preset distance from the central axis of the wind turbine hub.

[0007] Optionally, the step of photographing the wind blades after the drone hovers to obtain a first image, and detecting the state of the wind blades through the first image may include: after the drone hovers, performing the following processing: detecting, by means of a ranging device located in the drone, a first time point when the first wind blade passes through an effective shooting area of ​​the drone and a second time point when the second wind blade passes through the effective shooting area of ​​the drone; when the preset time interval has passed after the second time point, controlling the drone to automatically photograph a third wind blade image, wherein the preset time interval is equal to the difference between the second time point and the first time point minus the difference between the preset shooting time of the drone; detecting, by means of the ranging device, that the third wind blade passes through the effective shooting area of ​​the drone; a third time point in the effective shooting area; in response to the difference between the third time point and the second time point minus the preset time interval being less than or equal to a preset threshold, performing the following processing: when the preset time interval has passed after the third time point, controlling the drone to automatically shoot a first wind blade image; through the ranging device, detecting a fourth time point when the first wind blade passes through the effective shooting area of ​​the drone again; when the preset time interval has passed after the fourth time point, controlling the drone to automatically shoot a second wind blade image, thereby obtaining the first image including the third wind blade image, the first fan blade image and the second fan blade image, so as to detect the state of the wind blade through the first image.

[0008] Optionally, after the step of detecting the third time point when the third wind blade passes through the effective shooting area of ​​the drone through the ranging device, in response to the difference between the third time point and the second time point minus the preset time interval being greater than the preset threshold, the step of returning to execute the first time point when the first wind blade passes through the effective shooting area of ​​the drone and the second time point when the second wind blade passes through the effective shooting area of ​​the drone can be performed to re-acquire the first updated image after the fan speed changes, thereby detecting the status of the fan blade through the first updated image.

[0009] Optionally, the preset hovering position may include at least one preset hovering position, and the step of photographing the wind blades to obtain a first image after the drone hovers may include: photographing a group of blade partial images corresponding to the current hovering position after the drone hovers at each of the at least one preset hovering position to obtain a first image, wherein the first image includes at least one group of blade partial images corresponding to the at least one hovering position photographed by the drone at the at least one hovering position, and the at least one group of blade partial images constitute a complete image of all wind blades.

[0010] Optionally, in response to the wind turbine status data indicating that the wind turbine is in a shutdown state, the step of controlling the drone to fly along a second route to photograph the wind turbine to obtain a second image, so as to detect the status of the wind turbine blades through the second image may include: in response to the wind turbine status data indicating that the wind turbine is in a shutdown state, performing the following processing: determining a first angle between the first wind blade and the vertical direction based on the wind turbine status data; controlling the drone to photograph the wind turbine in real time along the second route corresponding to the first angle to obtain a second image, so as to detect the status of the wind turbine blades through the second image.

[0011] Optionally, the step of controlling the drone to photograph the wind turbine in real time along the second route corresponding to the first angle to obtain a second image, and detecting the state of the wind blades through the second image may include: controlling the drone to photograph the first wind blade image, the second wind blade image and the third wind blade image in real time along the route corresponding to the first angle, the route corresponding to the second angle and the route corresponding to the third angle, respectively, so as to obtain the second image including the first wind blade image, the second wind blade image and the third wind blade image, and detecting the state of the wind blades through the second image, wherein the second angle is an angle with the horizontal direction that is the sum of the first angle and 30 degrees, and the third angle is an angle with the horizontal direction that is the difference between 30 degrees and the first angle.

[0012] Optionally, the steps of controlling the drone to respectively take a route corresponding to the first angle, a route corresponding to the second angle, and a route corresponding to the third angle to capture a first wind blade image, a second wind blade image, and a third wind blade image in real time may include: in response to a ranging device located in the drone detecting that the drone has flown to a position corresponding to the tip of the first wind blade, controlling the drone to fly to the upper left at the first angle and capturing the first wind blade image in real time until the ranging device detects that the drone has flown over a position corresponding to a wind turbine hub; in response to the ranging device detecting that the drone has flown over a position corresponding to a wind turbine hub, controlling the drone to fly to the upper right at the second angle and capturing the second wind blade image in real time until the ranging device detects that the drone has flown over a position corresponding to a wind turbine hub. the drone flies to a position corresponding to the tip of the second fan blade; in response to the ranging device detecting that the drone flies to a position corresponding to the tip of the second fan blade, the drone is controlled to fly to the lower left at the second angle for a preset time period, wherein the preset time period is a time period corresponding to the real-time shooting of the second fan blade; the drone is controlled to fly to the left in a horizontal direction until the ranging device detects that the drone flies to a position corresponding to the root of the third fan blade; in response to the ranging device detecting that the drone flies to a position corresponding to the root of the third fan blade, the drone is controlled to fly to the upper left at the third angle and shoot the image of the third fan blade in real time until the ranging device detects that the drone flies to a position corresponding to the tip of the third fan blade.

[0013] In another general aspect, a device for detecting the status of wind turbine blades is provided, the device comprising: a communication module configured to receive wind turbine status data via a communication connection between a drone and the wind turbine; a control module configured to control the drone to fly along a first route to photograph the wind turbine blades to obtain a first image in response to the wind turbine status data indicating that the wind turbine is in an operating state, so as to detect the status of the wind turbine blades through the first image; and control the drone to fly along a second route to photograph the wind turbine blades to obtain a second image in response to the wind turbine status data indicating that the wind turbine is in a stopped state, so as to detect the status of the wind turbine blades through the second image, wherein the first image includes images of all wind blades taken at preset time intervals when the drone is in a hovering state, and the second image includes images of all wind blades taken in real time when the drone is in a non-hovering state.

[0014] Optionally, in response to the wind turbine status data indicating that the wind turbine is in an operating state, the control module controls the UAV to fly along a first route to photograph the wind turbine to obtain a first image, and the operation of detecting the status of the wind turbine blades through the first image may include: in response to the wind turbine status data indicating that the wind turbine is in an operating state, performing the following processing: based on the wind turbine hub height in the wind turbine status data, controlling the UAV to fly along the first route to a preset hovering position and then hover; after the UAV hovers, photographing the wind blades to obtain a first image, and detecting the status of the wind turbine blades through the first image, wherein the first route includes a route from the UAV taking off to hovering, and the preset hovering position is a position at a first preset distance from the wind turbine hub plane and a second preset distance from the central axis of the wind turbine hub.

[0015] Optionally, the control module photographs the wind blades after the drone hovers to obtain a first image, and the operation of detecting the state of the wind blades through the first image may include: after the drone hovers, performing the following processing: detecting, through a ranging device located in the drone, a first time point when the first wind blade passes through an effective shooting area of ​​the drone and a second time point when the second wind blade passes through the effective shooting area of ​​the drone; when the preset time interval has passed after the second time point, controlling the drone to automatically capture a third wind blade image, wherein the preset time interval is equal to the difference between the second time point and the first time point minus the difference between the preset shooting time of the drone; detecting, through the ranging device, that the third wind blade passes through the drone a third time point in the effective shooting area of ​​the drone; in response to the difference between the third time point and the second time point minus the preset time interval being less than or equal to a preset threshold, performing the following processing: when the preset time interval has passed after the third time point, controlling the drone to automatically shoot a first wind blade image; through the ranging device, detecting a fourth time point when the first wind blade passes through the effective shooting area of ​​the drone again; when the preset time interval has passed after the fourth time point, controlling the drone to automatically shoot a second wind blade image, thereby obtaining the first image including the third wind blade image, the first fan blade image and the second fan blade image, so as to detect the state of the wind blade through the first image.

[0016] Optionally, the control module can also be configured as follows: after the step of detecting the third time point when the third fan blade passes through the effective shooting area of ​​the drone through the ranging device, in response to the difference between the third time point and the second time point minus the preset time interval being greater than the preset threshold, returning to execute the step of detecting the first time point when the first fan blade passes through the effective shooting area of ​​the drone and the second time point when the second fan blade passes through the effective shooting area of ​​the drone, so as to re-acquire the first updated image after the fan speed changes, thereby detecting the status of the fan blade through the first updated image.

[0017] Optionally, the preset hovering position may include at least one preset hovering position, and the operation of the control module photographing the wind blades to obtain a first image after the drone hovers may include: photographing a group of blade partial images corresponding to the current hovering position after the drone hovers at each of the at least one preset hovering position to obtain a first image, wherein the first image includes at least one group of blade partial images corresponding to the at least one hovering position photographed by the drone at the at least one hovering position, and the at least one group of blade partial images constitute a complete image of all wind blades.

[0018] Optionally, the control module controls the UAV to fly along a second route to photograph the wind turbine to obtain a second image in response to the fan status data indicating that the wind turbine is in a shutdown state, and the operation of detecting the status of the wind turbine blades through the second image may include: in response to the fan status data indicating that the wind turbine is in a shutdown state, performing the following processing: determining a first angle between the first wind blade and the vertical direction based on the fan status data; controlling the UAV to photograph the wind turbine in real time along the second route corresponding to the first angle to obtain a second image, and detecting the status of the wind turbine blades through the second image.

[0019] Optionally, the control module controls the UAV to photograph the wind turbine in real time along the second route corresponding to the first angle to obtain a second image, and the operation of detecting the state of the wind blades through the second image may include: controlling the UAV to photograph the first wind blade image, the second wind blade image and the third wind blade image in real time along the route corresponding to the first angle, the route corresponding to the second angle and the route corresponding to the third angle, respectively, so as to obtain the second image including the first wind blade image, the second wind blade image and the third wind blade image, so as to detect the state of the wind blades through the second image, wherein the second angle is an angle with the horizontal direction that is the sum of the first angle and 30 degrees, and the third angle is an angle with the horizontal direction that is the difference between 30 degrees and the first angle.

[0020] Optionally, the control module controls the drone to respectively take a route corresponding to the first angle, a route corresponding to the second angle, and a route corresponding to the third angle to capture a first wind blade image, a second wind blade image, and a third wind blade image in real time, including: in response to a ranging device located in the drone detecting that the drone has flown to a position corresponding to the tip of the first wind blade, controlling the drone to fly to the upper left at the first angle and capturing the first wind blade image in real time until the ranging device detects that the drone has flown over a position corresponding to a wind turbine hub; in response to the ranging device detecting that the drone has flown over a position corresponding to a wind turbine hub, controlling the drone to fly to the upper right at the second angle and capturing the second wind blade image in real time until the ranging device detects that the drone has flown over a position corresponding to a wind turbine hub. the drone flies to a position corresponding to the tip of the second fan blade; in response to the ranging device detecting that the drone flies to a position corresponding to the tip of the second fan blade, the drone is controlled to fly to the lower left at the second angle for a preset time period, wherein the preset time period is a time period corresponding to the real-time shooting of the second fan blade; the drone is controlled to fly to the left in a horizontal direction until the ranging device detects that the drone flies to a position corresponding to the root of the third fan blade; in response to the ranging device detecting that the drone flies to a position corresponding to the root of the third fan blade, the drone is controlled to fly to the upper left at the third angle and shoot the image of the third fan blade in real time until the ranging device detects that the drone flies to a position corresponding to the tip of the third fan blade.

[0021] In another general aspect, a computer program product is provided, the computer program product comprising a computer program / instruction, wherein the computer program / instruction, when executed by a processor, implements the method for detecting a status of a wind turbine blade as described above.

[0022] In another general aspect, a computer-readable storage medium is provided, which, when instructions in the computer-readable storage medium are executed by a processor of an electronic device / server, enables the electronic device / server to perform the method for detecting the status of a wind turbine blade as described above.

[0023] In another general aspect, a computing device for an unmanned aerial vehicle is provided, the computing device comprising: at least one processor; and at least one memory storing computer executable instructions, wherein the computer executable instructions, when executed by the at least one processor, cause the at least one processor to execute the method for detecting the status of a wind turbine blade as described above.

[0024] According to the method and device for detecting the status of wind turbine blades in the embodiments of the present disclosure, it is proposed to use a drone to automatically take images according to the actual operating status of the wind turbine, so as to timely and efficiently detect the status of wind turbine blades under various wind turbine operating conditions. In addition, by not having to limit the operating status of the wind turbine when using a drone to perform detection, for example, there is no need to limit the operating status of the wind turbine to a shutdown state, thereby effectively reducing the power generation loss of the wind farm. By using a drone to take images to detect the status of the blades, only the image needs to be analyzed, the difficulty of material recognition is reduced, and the development workload is reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The above and other objects and features of the embodiments of the present disclosure will become more apparent through the following description in conjunction with the accompanying drawings showing the embodiments, in which:

[0026] Figure 1 is a flow chart showing a method for detecting a state of a fan blade according to an embodiment of the present disclosure;

[0027] Figure 2 is an example flow chart showing a method for detecting a state of a wind turbine blade according to an embodiment of the present disclosure;

[0028] Figure 3 is a schematic diagram showing the positional relationship between a drone and a wind turbine in a method for detecting a wind turbine blade state according to an embodiment of the present disclosure;

[0029] Figure 4 is a schematic diagram showing an automatic shooting time point according to an embodiment of the present disclosure;

[0030] Figure 5 is an example flow chart showing detection of a fan blade state according to one embodiment of the present disclosure;

[0031] FIG. 6A to FIG. 6C is a schematic diagram showing the positional relationship between a drone and a wind turbine in a method for detecting a wind turbine blade state according to another embodiment of the present disclosure;

[0032] Figure 7 is a schematic diagram showing a detection indicator light of a drone according to an embodiment of the present disclosure;

[0033] Figure 8 is a structural block diagram showing a device for detecting a state of a fan blade according to an embodiment of the present disclosure;

[0034] Fig. 9A and Fig. 9B They are schematic diagrams showing a detection system for a fan blade state according to an embodiment of the present disclosure;

[0035] Fig.10is an example flow chart illustrating a method for communication address matching according to an embodiment of the present disclosure;

[0036] Fig.11 is a block diagram illustrating a computing device for a drone according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0037] The following specific embodiments are provided to help the reader obtain a comprehensive understanding of the methods, devices and / or systems described herein. However, after understanding the disclosure of the present application, various changes, modifications and equivalents of the methods, devices and / or systems described herein will be clear. For example, the order of operations described herein is only an example and is not limited to those orders set forth herein, but can be changed as will be clear after understanding the disclosure of the present application, except for operations that must occur in a specific order. In addition, for greater clarity and simplicity, the description of features known in the art may be omitted.

[0038] The features described herein can be implemented in different forms and should not be construed as being limited to the examples described herein. Rather, the examples described herein have been provided to illustrate only some of the many possible ways to implement the methods, devices, and / or systems described herein, which will be clear after understanding the disclosure of the present application.

[0039] As used herein, the term "and / or" includes any one of the associated listed items and any combination of any two or more.

[0040] The terms used herein are only used to describe various examples and are not intended to limit the disclosure. Unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. The terms "comprise", "include" and "have" indicate the presence of the described features, quantities, operations, components, elements and / or combinations thereof, but do not exclude the presence or addition of one or more other features, quantities, operations, components, elements and / or combinations thereof.

[0041] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as those generally understood by a person of ordinary skill in the art to which the present disclosure belongs after understanding the present disclosure. Unless explicitly defined as such herein, terms (such as those defined in a general dictionary) should be interpreted as having a meaning consistent with their meaning in the context of the relevant art and the present disclosure, and should not be interpreted in an idealized or overly formal manner.

[0042] Furthermore, in the description of examples, when it is considered that a detailed description of a well-known related structure or function would cause vague interpretation of the present disclosure, such a detailed description will be omitted.

[0043] Reference will now be made in detail to the embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like parts throughout. The embodiments will be described below with reference to the drawings in order to explain the present disclosure.

[0044] In the related art, the blade condition caused by blade degradation is generally small, which makes it difficult to detect through human observation with the help of telescopes and other equipment. In addition, since wind speed and wind direction are transient, it is difficult to detect conditions such as blade cracks and splits through existing wind turbine operation data and blade vibration methods.

[0045] In the present disclosure, the status of the wind turbine blade may include at least one of the following items: concave blocks, paint peeling, scratches, cracks, ice and pollution. In the following, for the convenience of description, some relevant descriptions may be made by taking blade cracks as an example.

[0046] For example, the detection of blade cracks is used as an example to illustrate the shortcomings of existing methods. Specifically, existing methods for detecting blade cracks include a blade detection trolley method, an ultrasonic flaw detection method, a color recognition detection method, and a blade vibration detection method.

[0047] The disadvantages of the blade inspection cart method include high cost, inconvenience in installation, and inconvenience in high-altitude online operations. In addition, since the three blades of the wind turbine are located in different directions, it is more difficult to install when inspecting the blades facing upward when the wind turbine is shut down. In addition, when it is necessary to rotate the blades to change the azimuth, not only do relevant personnel need to log in to the warehouse to operate, but there are also the following problems: if the wind speed is low when performing the inspection, the impeller may be difficult to rotate, which leads to an adverse effect on the inspection time; and if the wind speed is high when performing the inspection, the swing of the blades may affect the stability of the device. In addition, since it takes a long time to install and disassemble the blade inspection cart, it may indirectly lead to an extension of the wind turbine downtime, which may greatly affect the power generation of the entire wind farm as the number of units / wind turbines increases.

[0048] Regarding the ultrasonic flaw detection method, this method uses ultrasonic echoes to detect blade cracks. Its disadvantages are: this method can only detect cracks that penetrate and are relatively wide, but because the depth and width of blade cracks are random, it is difficult to detect cracks on the blade surface and cracks with smaller widths. In addition, since the surface of the wind turbine blade (especially the windward surface) is a curved surface structure, this method may cause false detection due to the existence of the curved surface.

[0049] Regarding the color recognition detection method, it is necessary to first set different color coatings on the bottom and surface of the blade, and then detect whether the blade has cracks by detecting different colors. Its disadvantage is that since the fan is exposed to the external natural environment for a long time, factors such as light and dust will cause the color to change or become undetectable due to being covered, which deteriorates the detection effect of this method. In addition, this method also requires improvements to the production process of the blades and processing of the blades, which will increase the design cost and cannot detect previously installed blades. Therefore, this method has great limitations.

[0050] Regarding the blade vibration detection method, this method realizes detection by collecting data from vibration sensors installed on the blades. Its disadvantages are that the algorithm is complex, and the data corresponding to cracks are difficult to effectively distinguish from the data generated by wind mutation, wind shear, turbulence, control factors (for example, given speed jitter), etc.

[0051] In response to the above-mentioned problems related to blade crack detection, the present application proposes a method and device for detecting the status of wind turbine blades to solve the above-mentioned problems related to blade status detection.

[0052] Refer to the following Figures 1 to 11 A method and device for detecting the status of a fan blade according to an embodiment of the present disclosure are described in detail.

[0053] Figure 1 1 is a flow chart showing a method 100 for detecting a state of a wind turbine blade according to an embodiment of the present disclosure. Here, the method 100 for detecting a state of a wind turbine blade according to an embodiment of the present disclosure can be applied to a controller of a drone, so that the drone automatically executes the detection method 100 via the control of its controller.

[0054] Reference Figure 1 In step S101, the wind turbine status data is received via the communication connection between the drone and the wind turbine.

[0055] In step S102, in response to the wind turbine status data indicating that the wind turbine is in operation, the drone is controlled to fly along a first route to photograph the wind turbine blades to obtain a first image, so as to detect the status of the wind turbine blades through the first image. Hereinafter, the scheme corresponding to this step may be referred to as the first scheme and the corresponding detection mode may be referred to as the first detection mode.

[0056] Here, the first image includes images of all wind turbine blades taken at preset time intervals when the drone is in a hovering state.

[0057] According to an embodiment of the present disclosure, step S102 may further include: in response to the fan status data indicating that the fan is in a running state, executing steps S1021 to S1022:

[0058] In step S1021, based on the wind turbine hub height in the wind turbine status data, the UAV is controlled to fly to a preset hovering position along a first route and then hover.

[0059] In step S1022, after the drone is hovering, the wind blades are photographed to obtain a first image, so as to detect the status of the wind blades through the first image.

[0060] For example, the first route includes a route from the drone taking off to hovering, and the preset hovering position is a position at a first preset distance from the wind turbine hub plane and a second preset distance from the wind turbine hub central axis. For example, the preset hovering position may include at least one preset hovering position.

[0061] According to the embodiments of the present disclosure, by automatically taking images of blades based on a preset hovering position, there is no need to limit the wind turbine operation state to a shutdown state, thereby effectively reducing the power generation loss of the wind farm. In addition, by using drones to take images to detect the blade state, only the image needs to be analyzed, which reduces the difficulty of material recognition and the development workload.

[0062] According to an embodiment of the present disclosure, step S1022 may further include: after the drone hovers, performing the following steps S21 to S25:

[0063] In step S21, a distance measuring device in the drone is used to detect a first time point when a first wind turbine blade passes through an effective shooting area of ​​the drone and a second time point when a second wind turbine blade passes through the effective shooting area of ​​the drone.

[0064] In the present disclosure, regarding the distance measuring device, the present disclosure may use, for example but not limited to, ultrasonic and / or infrared distance measuring instruments, ultrasonic and / or infrared level measuring instruments, etc. as distance measuring devices, and for the sake of convenience of description, the present disclosure mainly uses ultrasonic distance measuring instruments as distance measuring devices (hereinafter referred to as ultrasonic distance measuring instruments) as examples for specific description. For example, the characteristics of ultrasonic distance measuring instruments are briefly described here: ultrasonic waves have strong directivity, consume ultrasonic energy slowly, and propagate over a long distance in a medium.

[0065] In step S22, when a preset time interval has passed after the second time point, the drone is controlled to automatically capture a third wind turbine blade image. Here, the preset time interval is equal to the difference between the second time point and the first time point minus the difference of the preset shooting time of the drone.

[0066] In step S23, the distance measuring device is used to detect the third time point when the third wind turbine blade passes through the effective shooting area of ​​the drone.

[0067] In step S24, in response to the difference between the third time point and the second time point minus the preset time interval being less than or equal to the preset threshold, the following steps S241 to S243 are performed:

[0068] In step S241, when a preset time interval has passed after the third time point, the drone is controlled to automatically capture the first wind turbine blade image.

[0069] In step S242, the distance measuring device is used to detect a fourth time point at which the first wind turbine blade passes through the effective shooting area of ​​the drone again.

[0070] In step S243, when a preset time interval has passed after the fourth time point, the drone is controlled to automatically capture the second wind blade image, thereby obtaining a first image including the third wind blade image, the first wind blade image and the second wind blade image, so as to detect the status of the wind blade through the first image.

[0071] According to the embodiments of the present disclosure, by utilizing an ultrasonic ranging device to detect and record the time when a blade passes by, the time interval between two blades passing by can be obtained, and then the time point for automatically taking a picture of the blade next time can be obtained based on the photographing delay time, thereby accurately taking pictures when the blade arrives (starting the photographing in advance and completing the photographing accurately), avoiding empty shots or blurred images.

[0072] After step S23, in step S25, in response to the difference between the third time point and the second time point minus the preset time interval being greater than a preset threshold, return to the step of detecting the first time point when the first fan blade passes through the effective shooting area of ​​the drone and the second time point when the second fan blade passes through the effective shooting area of ​​the drone, so as to reacquire the first updated image after the fan speed changes, thereby detecting the status of the fan blades through the first updated image.

[0073] According to an embodiment of the present disclosure, through the above step S25, the shooting position of the drone can be adjusted in time when the wind turbine operating parameters change during the shooting and detection process, so that the detection result is more accurate and the safety of the drone is ensured by adjusting its own shooting position.

[0074] As an example, in the case where the preset hovering positions include at least one preset hovering position, step S1022 may further include: after the drone hovers at each preset hovering position in at least one preset hovering position, capturing a set of blade local images corresponding to the current hovering position to obtain a first image.

[0075] For example, the first image includes at least one group of blade partial images corresponding to at least one hovering position and taken by the drone at at least one hovering position, and the at least one group of blade partial images constitutes a complete image of all wind turbine blades.

[0076] According to the embodiments of the present disclosure, by performing automatic shooting at multiple hovering positions, the integrity of the captured images can be ensured, that is, the images including various regions of all blades.

[0077] According to the embodiments of the present disclosure, by utilizing ultrasonic ranging and image recognition methods, it is possible to automatically detect whether the photographing of the current blade is completed, thereby improving the timeliness of photographing and detection, and also improving the accuracy of blade status judgment.

[0078] In step S103, in response to the wind turbine status data indicating that the wind turbine is in a shutdown state, the drone is controlled to fly along a second route to photograph the wind turbine blades to obtain a second image, so as to detect the status of the wind turbine blades through the second image. Hereinafter, the scheme corresponding to this step may be referred to as the second scheme and the corresponding detection mode may be referred to as the second detection mode.

[0079] Here, the second image includes images of all wind turbine blades taken in real time when the drone is in a non-hovering state.

[0080] According to an embodiment of the present disclosure, step S103 may further include: in response to the fan status data indicating that the fan is in a shutdown state, executing the following steps S1031 and S1032:

[0081] In step S1031, a first angle between a first fan blade and a vertical direction is determined based on the fan status data.

[0082] Step S1032, controlling the UAV to take real-time photos of the wind turbine along a second route corresponding to the first angle to obtain a second image, so as to detect the status of the wind turbine blades through the second image.

[0083] As an example, step S1032 may further include: controlling the drone to respectively take a route corresponding to the first angle, a route corresponding to the second angle, and a route corresponding to the third angle to take a first wind blade image, a second wind blade image, and a third wind blade image in real time, thereby obtaining a second image including the first wind blade image, the second wind blade image, and the third wind blade image, so as to detect the state of the wind blade through the second image. Here, the second angle is an angle with a horizontal direction that is an angle equal to the sum of the first angle and 30 degrees, and the third angle is an angle with a horizontal direction that is an angle equal to the difference between 30 degrees and the first angle.

[0084] According to the embodiments of the present disclosure, by means of a preset azimuth angle and / or angle a, it is possible to realize automatic photography and detection of blade images by a drone when the wind turbine is stopped without the need for manual operation and control, thereby effectively avoiding a series of problems such as the drone flying out of the blade detection range, the drone hitting the blades, and operational errors due to various reasons such as long distance and poor visibility during manual control.

[0085] As an example, step S1032 may further include steps S31 to S35:

[0086] In step S31, in response to the ranging device located in the UAV detecting that the UAV has flown to a position corresponding to the tip of the first wind turbine blade, the UAV is controlled to fly to the upper left at a first angle and capture an image of the first wind turbine blade in real time until the ranging device detects that the UAV has flown over a position corresponding to the wind turbine hub.

[0087] In step S32, in response to the ranging device detecting that the UAV has flown over a position corresponding to the wind turbine hub, the UAV is controlled to fly to the upper right at a second angle and capture an image of the second wind turbine blade in real time until the ranging device detects that the UAV has flown over a position corresponding to the tip of the second wind turbine blade.

[0088] In step S33, in response to the distance measuring device detecting that the drone flies over a position corresponding to the tip of the second wind turbine blade, the drone is controlled to fly leftward and downward at a second angle for a preset time period. Here, the preset time period is a time period corresponding to the real-time shooting of the second wind turbine blade.

[0089] In step S34, the UAV is controlled to fly horizontally to the left until the distance measuring device detects that the UAV flies to a position corresponding to the root of the third wind turbine blade.

[0090] In step S35, in response to the ranging device detecting that the UAV has flown to a position corresponding to the root of the third wind turbine blade, the UAV is controlled to fly to the upper left at a third angle and capture an image of the third wind turbine blade in real time until the ranging device detects that the UAV has flown over a position corresponding to the tip of the third wind turbine blade.

[0091] According to the embodiments of the present disclosure, an ultrasonic ranging device is utilized to synchronously trigger the camera function of a drone while playing a safety role, thereby enabling the drone to automatically capture blade images and detect blade degradation conditions such as cracks based on automatic detection of the hub and relevant parts of the blades by the ultrasonic ranging device, and the entire process does not require operation by relevant personnel.

[0092] As an example, refer to Figure 2 An example of the detection method 100 is illustrated. Figure 2 is a flow chart showing an example of a method for detecting a status of a wind turbine blade according to an embodiment of the present disclosure.

[0093] Reference Figure 2 , in step S201, it is determined whether the communication connection between the UAV and the current wind turbine is successful.

[0094] In step S202, when the communication connection is successfully established, it is determined whether the current wind turbine is in an operating state based on the wind turbine status data received from the wind turbine via the communication connection.

[0095] In step S203, in response to the fan being in the running state, the first solution is automatically executed. In step S204, in response to the fan being in the stopping state, the second solution is automatically executed.

[0096] During the execution of the first solution, in step S205, if the impeller speed changes during the detection process, the time for the drone to take pictures of the blades is calculated in real time based on the real-time speed value of the impeller.

[0097] In step S206, it is determined whether the wind direction has changed and / or whether the wind turbine has started yaw control. If so, in step S207, the direction of the UAV and the distance between the UAV and the blades are automatically adjusted according to the change in the operating state of the wind turbine blades.

[0098] The drone automatically selects the appropriate detection mode according to the fan status (operating status or shutdown status), thereby improving the automation of the detection. In addition, there is no need to start the fan for detection when the fan is in the shutdown state, and there is no need to shut down the fan for detection when the fan is in the operating state.

[0099] Below, we will refer to Figures 3 to 6C To specifically describe the first solution corresponding to step S102 (eg Figures 3 to 5 ) and the second solution corresponding to step S103 (as shown FIG. 6A to FIG. 6C shown).

[0100] Specifically, Figure 3 is a schematic diagram showing the positional relationship between a drone and a wind turbine in a method for detecting a wind turbine blade state according to an embodiment of the present disclosure, Figure 4 is a schematic diagram showing an automatic shooting time point according to an embodiment of the present disclosure, and Figure 5 is an example flow chart illustrating detection of a wind turbine blade status according to one embodiment of the present disclosure. FIG. 6A to FIG. 6C Schematic diagram showing the positional relationship between a drone and a wind turbine in a method for detecting a wind turbine blade state according to another embodiment of the present disclosure.

[0101] In an embodiment, Figure 3 , FIG. 6A to FIG. 6C As shown, blades of the wind turbine are shown as blade 101 , blade 102 , and blade 103 , and the drone is shown as drone 104 .

[0102] As an example, see Figure 3 and Figure 5In block S501, it is determined whether the drone has reached a preset height and a preset distance from the wind turbine hub plane. For example, the preset height here may be the height of the wind turbine hub. In addition, the drone may fly to the preset height through a height sensor provided in the drone, and the distance determination involved below may be achieved through a distance measuring device provided in the drone.

[0103] After determining that the drone has reached the preset altitude, block S502 is executed. In block S502, the drone is controlled to move a distance S to the left or right.

[0104] It should be noted that, when the preset height is the hub height of the wind turbine, in block S502, the drone can also be controlled to move a distance S in other directions besides the left and right, and is not limited to moving the distance S to the left or right. In this example, the first route of the drone includes a route from takeoff to the position reached by flying to the hub height of the wind turbine and a route to the position reached by moving the distance S thereafter.

[0105] Furthermore, in the case of this example, the wind turbine hub height may be pre-stored in the controller of the drone, or may be received from the outside, for example, from the wind turbine via a communication connection with the wind turbine.

[0106] As another example, the above-mentioned preset height is not limited to the height of the wind turbine hub, that is, it is not equal to the height of the wind turbine hub. In the case of this example, blocks S501 and S502 can be combined into one step, in which the drone is controlled to fly to a position that is a first preset distance from the wind turbine hub plane and a second preset distance from the wind turbine hub center axis. Here, the second preset distance can be the above-mentioned distance S, and the first preset distance is used to ensure the operational safety of the drone.

[0107] For example, the safety of the drone in the above operation can be ensured by an ultrasonic distance measuring device, and there is no special requirement for the accuracy of the ultrasonic distance measuring device, that is, the ultrasonic distance measuring device can detect the distance between the drone and the blade in real time, thereby preventing the drone from getting too close to the blade, for example, preventing the drone from colliding with the blade, etc. In addition, after the drone position exceeds the position corresponding to the wheel hub, the ultrasonic distance measuring device can automatically start the direction adjustment and automatically detect the next blade.

[0108] In addition, in the present disclosure, all situations involving the use of ultrasonic ranging devices to ensure a safe distance between the drone and the wind turbine are also applicable to the above description herein and will not be repeated hereafter.

[0109] After frame S502, the drone hovers and executes frame S503. In frame S503, the first blade time T1 of the blade 101 passing through the effective shooting area of ​​the drone is detected by the ultrasonic ranging device, and the second blade time T2 of the blade 102 passing through the effective shooting area of ​​the drone is detected by the ultrasonic ranging device, thereby calculating the automatic shooting time T0 according to the shutter times Tp, T1 and T2 (as shown in frame S504).

[0110] Then, in block S505, the ultrasonic ranging device is used to detect the third blade time T3 of the blade 103 passing through the effective shooting area of ​​the drone. In block S506, it is determined whether the difference between T3 and T2 is close to T0. If so, block S507 is executed, otherwise, the process returns to block S303 to re-execute the relevant operations.

[0111] In block S507 , preparations are made to photograph the three blades in the next rotation cycle (ie, the next revolution) of the fan blades according to the previously obtained time parameter T0 , so that photographing the three blades in the current cycle is completed in S508 .

[0112] In this example, due to the long length of the blades and the limited effective shooting area of ​​the drone, it is very likely that by hovering only once based on the distance S, only a partial image of each of the three blades can be captured, and the complete image of all the blades cannot be captured. In this case, it is necessary to hover several times (i.e., each distance corresponds to one hovering) at distances different from the distance S (the distance corresponds to the number of hovering times) and perform the above operations to obtain a complete image of all the blades.

[0113] By using the ultrasonic distance measuring device to detect and record the time when the blades pass, the time interval between two blades passing by can be obtained, and then according to the delay time of the camera shutter, the time point of the next automatic photo of the blade can be obtained, so that the photo can be taken accurately when the blade arrives, and the situation of failing to capture the corresponding image of the blade will not occur. Figure 4 The above effects are described below with examples.

[0114] Reference Figure 4 , Figure 4 This is a statistical diagram of the automatic photo taking time. Figure 4In the figure, t1 indicates the time when the ultrasonic ranging device detects that blade 101 has reached the position directly opposite to the drone (here, it can be understood as the position of the drone's position coordinates mapped to the hub plane or the position reached by the blade when the distance between the drone and the blade is the shortest), t2 indicates the time when the ultrasonic ranging device detects that blade 102 has reached the position directly opposite to the drone, and t3 indicates the time when the ultrasonic ranging device detects that blade 103 has reached the position directly opposite to the drone. Assuming that the shutter time of the camera set on the drone is Tp, when blade 102 reaches the drone position, the photo shooting is started in advance at the moment of t2+(t2-t1)-Tp. The effect of this is that when blade 103 arrives, the photo shooting operation of blade 103 is just started, thereby achieving accurate photo shooting when the blade arrives.

[0115] Furthermore, when taking a picture of the blade 103, ultrasonic ranging is performed again to detect the difference between the time of successful ranging and the calculated photographing time. If the difference is too large, it indicates that the impeller speed has changed (e.g. Figure 4 In this case, the automatic photographing time interval for the leaves is recalculated.

[0116] According to the above example of the present disclosure, by automatically calculating the time interval for taking photos, the accuracy of taking photos of each area of ​​the blade is ensured, avoiding the situation of missing photos (only taking photos of the gaps between the blades without taking photos of the blades) or blurred images, thereby reducing the workload of screening and cleaning image data, and by using image data instead of video data, the workload of data analysis can be reduced. In addition, by automatically adjusting the time interval for taking photos according to the impeller speed, this solution is more suitable for the actual operating environment of the wind turbine and is more suitable for a longer automatic detection process.

[0117] As another example, when the wind turbine is shut down, the detection method according to this example includes automatically taking images of the blades 101 , 102 , and 103 , respectively.

[0118] Reference FIG. 6A to FIG. 6C , the detection method according to this example includes steps (1) to (6):

[0119] In step (1), the drone determines the angle a between the blade 101 and the vertical direction based on the blade azimuth angle.

[0120] Here, the blade azimuth angle may be pre-stored in the controller of the drone, or may be received from the outside, for example, from the wind turbine via a communication connection with the wind turbine. In addition, the angle a may also be pre-stored in the controller of the drone, or may be received from the outside, for example, from the wind turbine via a communication connection with the wind turbine. In addition, the blade azimuth angle and / or the angle a may be used for the drone to automatically correct its orientation.

[0121] In addition, regarding the blade azimuth angle, it is defined as: when the tip of the blade is facing upward, the corresponding blade azimuth angle is 0 degrees, and after the blade rotates one circle and turns to the position where the tip is facing again, the corresponding blade azimuth angle is 360 degrees, that is, the blade azimuth angle is an angle value that changes continuously and periodically as the blade rotates from 0 degrees to 360 degrees.

[0122] As an example, the azimuth angles of the three blades of the fan can be calculated by the impeller azimuth angle. For example, assuming that the three blades of the fan are represented as blade 1, blade 2, and blade 3, and the angle when the tip of blade 1 is facing is 0 degrees of the impeller azimuth angle, then in this case, the azimuth angle of blade 1 is 0 degrees, the azimuth angle of blade 2 is 120 degrees, and the azimuth angle of blade 3 is 240 degrees.

[0123] In step (2), after the angle a is determined, the drone can be started and fly to a position corresponding to the tip of the blade 101 through distance detection by the ultrasonic distance measuring device, so as to prepare to start taking pictures of the blade 101.

[0124] In step (3), the drone is automatically controlled to fly upward and left at an angle a and take pictures to ensure that the image of the entire blade is captured, until the ultrasonic distance measuring device detects no ultrasonic echo (also known as: detecting that the drone exceeds the position corresponding to the hub), at which time it can be determined that the blade 101 has been photographed. The drone then automatically adjusts its direction and prepares to photograph the next blade.

[0125] In step (4), the drone is automatically controlled to fly upward and rightward at an angle of 30+a and take pictures to ensure that the image of the entire blade is captured, until the ultrasonic ranging device detects no ultrasonic echo, at which time it can be determined that the blade 102 has been photographed. The drone then automatically adjusts its direction and prepares to photograph the next blade.

[0126] In step (5), the drone is automatically controlled to fly downward to the left at an angle of (30+a) for a preset time period, which is the flight time period recorded by the drone in step (4) from the root of the blade 102 to the tip of the blade.

[0127] In step (6), the drone is then automatically controlled to fly horizontally to the left. When the blade (e.g., the root of blade 103) is detected again by the ultrasonic ranging device, the drone flies upward to the left at an angle of 30-a and takes pictures until the ultrasonic ranging sensor detects no ultrasonic echo. At this time, it is determined that the shooting of blade 103 has been completed.

[0128] At this step (6), the drone has completed the photographing operation of all blades, and then the drone can return to the preset position (for example, the preset coordinates on the ground).

[0129] In the present disclosure, during the flight of the UAV, the blade contour and center line can be detected. If the position of the UAV is detected to be offset, the position of the UAV is automatically corrected. For example, if the position is detected to be biased to the left, the position of the UAV is automatically corrected to the right; or if the position is detected to be biased to the right, the position of the UAV is automatically corrected to the left; or if the position is detected to be biased upward, the position of the UAV is automatically corrected downward; if the position is detected to be biased downward, the position of the UAV is automatically corrected upward.

[0130] In the present disclosure, after the drone completes capturing and storing images of all blades, the drone controller (which may include a processor (e.g., a central processing unit (CPU)) and an image processing device (GPU) for short) may process all image data to analyze and obtain blade status data, such as the specific conditions of cracks. For example, such blade status data may be displayed on the drone through different colored indicator lights (e.g., Figure 7 For example, the indicator light for each blade can be set as a three-color indicator light, indicating the three states of the blade being normal (green), slightly abnormal (yellow), and seriously abnormal (red).

[0131] In addition, in the present disclosure, an automatic direction adjustment device and a camera device are also provided in the drone. The automatic direction adjustment device is configured to control the flight of the drone in terms of direction control to automatically complete the shooting of all blades without the need for manual operation and control by relevant personnel. The camera device is configured to acquire graphics so that the GPU can identify graphic features by, for example, but not limited to, a contour detection algorithm.

[0132] Figure 8 is a structural block diagram showing a device for detecting a state of a wind turbine blade according to an embodiment of the present disclosure. Fig. 9A and Fig. 9B They are schematic diagrams showing a system for detecting the status of a wind turbine blade according to an embodiment of the present disclosure.

[0133] Reference Figure 8 According to an embodiment of the present disclosure, a wind turbine blade status detection device 800 may include a communication module 810 and a control module 820 .

[0134] According to an embodiment of the present disclosure, the communication module 810 is configured to receive wind turbine status data via a communication connection between the drone and the wind turbine.

[0135] For example, in one example, the functionality of the communication module 810 may be provided by Fig. 9A In another example, if the UAV has determined that it will perform detection when the wind turbine is shut down before the wind turbine is shut down, the following can also be done: Fig. 9B As shown, the functionality of the communication module 810 is not implemented via a wireless communication module.

[0136] According to an embodiment of the present disclosure, the control module 820 is configured to perform the following operations 1) and 2):

[0137] In operation 1), in response to the wind turbine status data indicating that the wind turbine is in operation, the drone is controlled to fly along a first route to photograph the wind turbine blades to obtain a first image, so as to detect the status of the wind turbine blades through the first image. Here, the first image includes images of all wind turbine blades taken at preset time intervals when the drone is in a hovering state.

[0138] As an example, operation 1) may further include: in response to the wind turbine status data indicating that the wind turbine is in an operating state, performing the following processes 11) and 12):

[0139] In processing 11), based on the wind turbine hub height in the wind turbine status data, the UAV is controlled to fly to a preset hovering position along a first route and then hover.

[0140] In process 12), after the drone hovers, the wind blades are photographed to obtain a first image, so as to detect the status of the wind blades through the first image.

[0141] For example, the first route includes a route from the drone taking off to hovering, and the preset hovering position is a position at a first preset distance from the wind turbine hub plane and a second preset distance from the wind turbine hub central axis. In addition, as an example, the preset hovering position may include at least one preset hovering position.

[0142] As an example, the process 12) may further include: after the drone is hovering, executing the following processes 121) to 125):

[0143] In processing 121), a distance measuring device in the UAV is used to detect a first time point when a first wind turbine blade passes through an effective shooting area of ​​the UAV and a second time point when a second wind turbine blade passes through the effective shooting area of ​​the UAV.

[0144] In process 122), when a preset time interval has passed after the second time point, the drone is controlled to automatically capture a third wind turbine blade image. Here, the preset time interval is equal to the difference between the second time point and the first time point minus the difference between the preset shooting time of the drone.

[0145] In processing 123), the distance measuring device is used to detect the third time point when the third wind turbine blade passes through the effective shooting area of ​​the drone.

[0146] In process 124), in response to the difference between the third time point and the second time point minus the preset time interval being less than or equal to the preset threshold, the following processes 1241) to 1243) are performed:

[0147] In processing 1241), after a preset time interval has passed since the third time point, the drone is controlled to automatically capture the first wind turbine blade image.

[0148] In processing 1242), the distance measuring device is used to detect a fourth time point when the first wind turbine blade passes through the effective shooting area of ​​the drone again.

[0149] In processing 1243), after a preset time interval has passed after the fourth time point, the drone is controlled to automatically capture a second wind blade image, thereby obtaining a first image including a third wind blade image, a first wind blade image, and a second wind blade image, so as to detect the status of the wind blades through the first image.

[0150] In addition, after processing 123), in processing 125), in response to the difference between the third time point and the second time point minus the preset time interval being greater than a preset threshold, return to the step of detecting the first time point when the first fan blade passes through the effective shooting area of ​​the drone and the second time point when the second fan blade passes through the effective shooting area of ​​the drone, so as to re-acquire the first updated image after the fan speed changes, thereby detecting the status of the fan blades through the first updated image.

[0151] As an example, in the case where the preset hovering position includes at least one preset hovering position, the process 12) may further include: after the drone hovers at each preset hovering position in the at least one preset hovering position, a set of blade partial images corresponding to the current hovering position is captured to obtain a first image. Here, the first image includes at least one set of blade partial images corresponding to the at least one hovering position captured by the drone at the at least one hovering position, and the at least one set of blade partial images constitutes a complete image of all wind turbine blades.

[0152] In operation 2), in response to the wind turbine status data indicating that the wind turbine is in a shutdown state, the drone is controlled to fly along a second route to photograph the wind turbine blades to obtain a second image, so as to detect the status of the wind turbine blades through the second image. Here, the second image includes images of all wind turbine blades taken in real time when the drone is in a non-hovering state.

[0153] As an example, operation 2) may further include: in response to the wind turbine status data indicating that the wind turbine is in a shutdown state, performing the following processes 21) and 22):

[0154] In process 21), a first angle between the first fan blade and the vertical direction is determined based on the fan status data.

[0155] In process 22), the drone is controlled to take real-time photos of the wind turbine along a second route corresponding to the first angle to obtain a second image, so as to detect the status of the wind turbine blades through the second image.

[0156] As an example, processing 22) may further include: controlling the drone to capture the first wind blade image, the second wind blade image and the third wind blade image in real time along a route corresponding to the first angle, a route corresponding to the second angle and a route corresponding to the third angle, respectively, so as to obtain a second image including the first wind blade image, the second wind blade image and the third wind blade image, so as to detect the status of the wind blade through the second image.

[0157] Here, the second angle is an angle with the horizontal direction that is the sum of the first angle and 30 degrees, and the third angle is an angle with the horizontal direction that is the difference between 30 degrees and the first angle.

[0158] For example, process 22) may further include processes 221) to 225):

[0159] In processing 221), in response to the ranging device located in the UAV detecting that the UAV has flown to a position corresponding to the tip of the first wind turbine blade, the UAV is controlled to fly to the upper left at a first angle and capture the image of the first wind turbine blade in real time until the ranging device detects that the UAV has flown over a position corresponding to the wind turbine hub.

[0160] In processing 222), in response to the ranging device detecting that the UAV has flown over a position corresponding to the wind turbine hub, the UAV is controlled to fly to the upper right at a second angle and capture an image of the second wind turbine blade in real time until the ranging device detects that the UAV has flown over a position corresponding to the tip of the second wind turbine blade.

[0161] In process 223), in response to the distance measuring device detecting that the drone flies over the position corresponding to the tip of the second wind turbine blade, the drone is controlled to fly to the lower left at a second angle for a preset time period. Here, the preset time period is a time period corresponding to the real-time shooting of the second wind turbine blade.

[0162] In process 224), the UAV is controlled to fly horizontally to the left until the distance measuring device detects that the UAV flies to a position corresponding to the root of the third wind turbine blade.

[0163] In processing 225), in response to the ranging device detecting that the UAV has flown to a position corresponding to the root of the third wind turbine blade, the UAV is controlled to fly to the upper left at a third angle and capture an image of the third wind turbine blade in real time until the ranging device detects that the UAV has flown over a position corresponding to the tip of the third wind turbine blade.

[0164] Reference Fig. 9A According to an embodiment of the present disclosure, a wind blade status detection system may include: a drone controller (including a processor), a ranging device (including a control circuit, a transmitter and a receiver), an image processing device (may be referred to as a GPU) (here, although the GPU is shown as being independent of the drone controller, it may be included in the drone controller) and a wireless communication module.

[0165] According to an embodiment of the present disclosure, the wireless communication module may be configured to receive data sent by the ground controller of the drone, and / or to communicate data with the fan controller. For example, the communication data includes but is not limited to the impeller speed, fan status, impeller azimuth, wind speed value, wind direction value, etc. In addition, the wireless communication module supports various communication protocols, such as WiFi, Bluetooth (here, the distance of Bluetooth communication can reach 300m under preset conditions), and various generations of mobile communication technology protocols.

[0166] As an example, the wireless communication module can communicate with the wind turbine controller or the ground controller and obtain the status data of the wind turbine in real time, so as to automatically execute the detection method of the present disclosure according to the actual operating status of the wind turbine.

[0167] For example, Fig.10 The flowchart of the wireless communication module and the wind turbine controller is shown. Fig.10 , Fig.10 is an example flow chart for communication address matching according to an embodiment of the present disclosure. The overall process includes: according to the wind turbine number in the wind farm, setting the corresponding communication address in the controller of the drone, and establishing a connection with the corresponding wind turbine. Specific steps S1001 to S1007 can be as follows Fig.10 As shown, no further description is given here.

[0168] It is worth noting that, in step S1004, if the fan is not powered on, the second solution is directly executed. Here, the wireless communication module can determine that the fan is not powered on by the failure of the communication connection, but the present disclosure is not limited thereto, and the fan can also be determined to be not powered on by other means, for example, receiving information corresponding to the fan not being powered on from the ground controller. In addition, after step S1007, the specific detection operation to be executed can be determined according to the execution conditions of the first solution and the second solution.

[0169] According to the embodiment of the present disclosure, the working principle of the control circuit is as follows: the control circuit first sends a pulse signal to the transmitter (for example, an ultrasonic probe), and then the transmitter transmits an ultrasonic signal to the outside; after the ultrasonic signal encounters the obstruction of the blade, an echo pulse signal is generated, which is received by the receiver; the control circuit calculates the time difference between the pulse signal and the echo pulse signal (for example, Fig. 9A and 9B The distance between the UAV and the blade is obtained by multiplying the T shown in Figure 1 by the sound wave transmission speed (for example, Fig. 9A and 9B L) as shown, and transmits the distance to the controller of the drone for controlling the flight of the drone.

[0170] In addition, a display screen may be provided in the drone and / or in a ground controller corresponding to the drone to display the abnormal images of the blades that are automatically saved for identification and confirmation by relevant personnel.

[0171] It should be noted that the operations performed on the above-mentioned structural frames can be referred to in Figure 1 The related contents described are similar and will not be repeated here.

[0172] Fig.11 is a block diagram illustrating a computing device 1100 for a drone according to an embodiment of the present disclosure.

[0173] Reference Fig.11 According to an embodiment of the present disclosure, a computing device 1100 for a drone may include a processor 1110 and a memory 1120. The processor 1110 may include (but not limited to) a central processing unit (CPU), a digital signal processor (DSP), a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a microprocessor, an application-specific integrated circuit (ASIC), etc. The memory 1120 may store computer-executable instructions to be executed by the processor 1110. The memory 1120 includes a high-speed random access memory and / or a non-volatile computer-readable storage medium. When the processor 1110 executes the computer-executable instructions stored in the memory 1120, the detection method described above may be implemented.

[0174] The detection method according to the embodiment of the present disclosure may be written as a computer program / instruction to form a computer program product and stored on a computer-readable storage medium. When the computer program / instruction is executed by a processor, the detection method as described above may be implemented. When the instructions in the computer-readable storage medium are executed by a processor of an electronic device / server, the electronic device / server is enabled to execute the detection method as described above. Examples of computer-readable storage media include: read-only memory (ROM), random access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD+R, CD-RW, CD+RW, DVD-ROM, DVD-R, DVD+R, DVD-RW, DVD+RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or optical disk storage, hard disk drive (HDD), solid state drive (SSD), card storage (such as, multimedia card, secure digital (SD) card or extreme digital (XD) card), magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid state disk and any other device, any other device is configured to store computer program and any associated data, data files and data structures in a non-transitory manner and provide the computer program and any associated data, data files and data structures to a processor or computer so that the processor or computer can execute the computer program. In one example, the computer program and any associated data, data files and data structures are distributed on a networked computer system so that the computer program and any associated data, data files and data structures are stored, accessed and executed in a distributed manner by one or more processors or computers.

[0175] According to the method and device for detecting the status of wind turbine blades in the embodiments of the present disclosure, it is proposed to use a drone to automatically take images according to the actual operating status of the wind turbine, so as to timely and efficiently detect the status of wind turbine blades under various wind turbine operating conditions, thereby realizing the detection of blade cracks, etc., reducing the workload of relevant personnel and the complexity of operation, and reducing the maintenance downtime of wind turbines.

[0176] On the other hand, by eliminating the need to limit the operating state of the wind turbine when using drones to perform inspections, for example, eliminating the need to limit the operating state of the wind turbine to a shutdown state, the power generation loss of the wind farm is effectively reduced.

[0177] On the other hand, by using drones to take images to detect the status of the blades, only the images need to be analyzed, which reduces the difficulty of material recognition and the development workload.

[0178] On the other hand, by presetting the azimuth value and utilizing the fixed angle relationship between the blades, the drone can automatically shoot and detect blade images without the need for human operation and control, thereby effectively avoiding a series of problems such as the drone flying out of the blade detection range, the drone hitting the blades, and operational errors due to various reasons such as long distance and poor visibility during human control.

[0179] On the other hand, the advantages of the ultrasonic ranging device adopted in the present invention are: preventing the drone from colliding with the blades, and can also be used to synchronously trigger the drone's camera function, so that the drone can automatically capture and detect the blade image without the need for operation by relevant personnel, and because the ultrasonic ranging device is mainly used to detect the safe distance from wind turbine blades, etc., there are no special requirements for the detection accuracy of the device, thereby reducing the equipment cost of the ultrasonic ranging device and reducing the overall detection cost.

[0180] On the other hand, since the detection method disclosed in the present invention is a contactless detection method, there is no need to install any equipment on the wind turbine, and the difficulty of implementation is greatly reduced compared with the existing detection methods.

[0181] Although some embodiments of the present disclosure have been disclosed and described, it will be appreciated by those skilled in the art that modifications and variations may be made to the embodiments without departing from the concept and spirit of the present disclosure, the scope of which is defined by the claims and their equivalents.

Claims

1. A method for detecting the status of a fan blade, characterized in that: The detection method is applied to the controller of the UAV, and the detection method includes: The controller of the drone receives the status data of the wind turbine via the communication connection between the drone and the wind turbine; In response to the wind turbine status data indicating that the wind turbine is in an operating state, a controller of the drone controls the drone to fly along a first route to photograph the wind turbine blades to obtain a first image, so as to detect the status of the wind turbine blades through the first image; In response to the wind turbine status data indicating that the wind turbine is in a shutdown state, the controller of the drone controls the drone to fly along a second route to photograph the wind turbine blades to obtain a second image, so as to detect the status of the wind turbine blades through the second image. The first image includes images of all wind blades taken at preset time intervals when the drone is in a hovering state, and the second image includes images of all wind blades taken in real time when the drone is in a non-hovering state.

2. The detection method according to claim 1, characterized in that: In response to the wind turbine status data indicating that the wind turbine is in an operating state, the step of controlling the drone to fly along a first route to photograph the wind turbine to obtain a first image, and detecting the status of the wind turbine blades through the first image includes: In response to the fan status data indicating that the fan is in an operating state, the following processing is performed: Based on the wind turbine hub height in the wind turbine status data, controlling the UAV to fly to a preset hovering position along the first route and then hover; After the drone hovers, the wind turbine blades are photographed to obtain a first image, so as to detect the status of the wind turbine blades through the first image. The first route includes a route from the take-off of the UAV to its hovering, and the preset hovering position is a position at a first preset distance from the plane of the wind turbine hub and a second preset distance from the central axis of the wind turbine hub.

3. The detection method according to claim 2, characterized in that: The step of photographing the wind blades after the drone hovers to obtain a first image, and detecting the state of the wind blades through the first image comprises: After the drone hovers, perform the following processing: By means of a distance measuring device in the drone, a first time point at which a first wind turbine blade passes through an effective shooting area of ​​the drone and a second time point at which a second wind turbine blade passes through the effective shooting area of ​​the drone are detected; When the preset time interval has passed after the second time point, the drone is controlled to automatically take a third wind turbine blade image, wherein the preset time interval is equal to the difference between the second time point and the first time point minus the difference between the preset shooting time of the drone; By means of the distance measuring device, detecting a third time point at which a third wind turbine blade passes through an effective shooting area of ​​the drone; In response to the difference between the third time point and the second time point minus the preset time interval being less than or equal to a preset threshold, performing the following processing: When the preset time interval has passed after the third time point, controlling the drone to automatically capture the first wind turbine blade image; By means of the distance measuring device, detecting a fourth time point at which the first wind turbine blade passes through the effective shooting area of ​​the drone again; When the preset time interval has passed after the fourth time point, the drone is controlled to automatically capture the second wind blade image, thereby obtaining the first image including the third wind blade image, the first wind blade image and the second wind blade image, so as to detect the status of the wind blade through the first image.

4. The detection method according to claim 3, characterized in that: After the step of detecting the third time point when the third wind blade passes through the effective shooting area of ​​the drone through the ranging device, in response to the difference between the third time point and the second time point minus the preset time interval being greater than the preset threshold, return to the step of detecting the first time point when the first wind blade passes through the effective shooting area of ​​the drone and the second time point when the second wind blade passes through the effective shooting area of ​​the drone, so as to re-acquire the first updated image after the wind speed changes, thereby detecting the status of the wind blade through the first updated image.

5. The detection method according to claim 2, characterized in that: The preset hovering position includes at least one preset hovering position, and the step of photographing the wind turbine blades to obtain a first image after the drone hovers includes: After the drone hovers at each of the at least one preset hovering position, a group of blade partial images corresponding to the current hovering position are captured to obtain a first image. The first image includes at least one group of blade partial images corresponding to the at least one hovering position and taken by the drone at the at least one hovering position, and the at least one group of blade partial images constitute a complete image of all wind turbine blades.

6. The detection method according to claim 1, characterized in that: In response to the wind turbine status data indicating that the wind turbine is in a shutdown state, the step of controlling the drone to fly along a second route to photograph the wind turbine to obtain a second image, thereby detecting the status of the wind turbine blades through the second image comprises: In response to the fan status data indicating that the fan is in a shutdown state, the following processing is performed: Determine a first angle between a first fan blade and a vertical direction based on the fan status data; The drone is controlled to take real-time photos of the wind turbine along the second route corresponding to the first angle to obtain a second image, so as to detect the status of the wind turbine blades through the second image.

7. The detection method according to claim 6, characterized in that: The step of controlling the drone to take real-time photos of the wind turbine along the second route corresponding to the first angle to obtain a second image, and detecting the status of the wind turbine blades through the second image comprises: controlling the drone to respectively take a route corresponding to the first angle, a route corresponding to the second angle, and a route corresponding to the third angle to capture a first wind blade image, a second wind blade image, and a third wind blade image in real time, thereby obtaining the second image including the first wind blade image, the second wind blade image, and the third wind blade image, so as to detect the state of the wind blade through the second image, The second angle is an angle with the horizontal direction equal to the sum of the first angle and 30 degrees, and the third angle is an angle with the horizontal direction equal to the difference between 30 degrees and the first angle.

8. The detection method according to claim 7, characterized in that: The steps of controlling the drone to respectively take a route corresponding to the first angle, a route corresponding to the second angle, and a route corresponding to the third angle to take a first wind turbine blade image, a second wind turbine blade image, and a third wind turbine blade image in real time include: In response to a distance measuring device in the UAV detecting that the UAV flies to a position corresponding to the tip of the first wind turbine blade, the UAV is controlled to fly to the upper left at the first angle and to capture an image of the first wind turbine blade in real time until the distance measuring device detects that the UAV flies to a position corresponding to the wind turbine hub; In response to the distance measuring device detecting that the UAV flies over a position corresponding to a hub of a wind turbine, the UAV is controlled to fly to the upper right at the second angle and to capture an image of a second wind turbine blade in real time until the distance measuring device detects that the UAV flies over a position corresponding to a tip of the second wind turbine blade; In response to the distance measuring device detecting that the drone flies over a position corresponding to the tip of the second wind turbine blade, controlling the drone to fly to the lower left at the second angle for a preset time period, wherein the preset time period is a time period corresponding to real-time photographing of the second wind turbine blade; Controlling the UAV to fly leftward in a horizontal direction until the distance measuring device detects that the UAV flies to a position corresponding to the root of the third wind turbine blade; In response to the ranging device detecting that the UAV has flown to a position corresponding to the root of the third wind turbine blade, the UAV is controlled to fly to the upper left at the third angle and to capture an image of the third wind turbine blade in real time until the ranging device detects that the UAV has flown over a position corresponding to the tip of the third wind turbine blade.

9. A device for detecting the status of a fan blade, characterized in that: The device comprises: The communication module is configured to: receive status data of the wind turbine via a communication connection between the drone and the wind turbine; The control module is configured as follows: In response to the wind turbine status data indicating that the wind turbine is in an operating state, controlling the drone to fly along a first route to photograph the wind turbine blades to obtain a first image, so as to detect the status of the wind turbine blades through the first image; In response to the wind turbine status data indicating that the wind turbine is in a shutdown state, controlling the drone to fly along a second route to photograph the wind turbine blades to obtain a second image, so as to detect the status of the wind turbine blades through the second image, The first image includes images of all wind blades taken at preset time intervals when the drone is in a hovering state, and the second image includes images of all wind blades taken in real time when the drone is in a non-hovering state.

10. A computer program product, characterized in that The computer program product comprises a computer program / instruction, and when the computer program / instruction is executed by a processor, the method for detecting the status of a wind turbine blade according to any one of claims 1 to 8 is implemented.

11. A computing device for an unmanned aerial vehicle, characterized in that: include: at least one processor; at least one memory storing computer executable instructions, Wherein, when the computer executable instructions are executed by the at least one processor, the at least one processor is prompted to execute the method for detecting the status of a wind turbine blade according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Method, apparatus and system for detecting state of blower blade through unmanned plane

    CN105651780A

  • Method, device and system for detecting damage of fan blades based on unmanned aerial vehicle

    CN106762451A

  • Wind turbine generator appearance defect detection method, platform, unmanned aerial vehicle and system

    CN111708380A

  • Wind driven generator inspection method and device based on unmanned aerial vehicle

    CN115791796A

  • Method and device for automatically planning inspection path of fan blade based on unmanned aerial vehicle

    CN116880537A

Cited By

  • Blade detection method and device based on unmanned aerial vehicle, electronic equipment and storage medium

    CN119625587A

  • Unmanned aerial vehicle-based blade detection method and device, electronic equipment and storage medium

    CN119625587B