Power line inspection control method and device

Through refined positioning technology combined with satellite positioning and CNN neural network, the autonomous navigation and control of drones in power line inspection is achieved, and the problem of low drone inspection efficiency is solved, and the patrol efficiency and stability are improved. .

CN118963398APending Publication Date: 2024-11-15STATE GRID JIBEI ELECTRIC POWER COMPANY LIMITED CHENGDE POWER SUPPLY +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411062723.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

When using drones to conduct power line inspections, the lack of independent navigation and control makes it impossible to achieve independent inspection operations, resulting in low patrol efficiency.

Method used

By performing refined positioning processing based on satellite positioning information and preset transmission line fitting curves, combined with CNN neural network and offline maps, the drone is controlled to independently perform patrol tasks, and autonomous patrol without the need for online control of the operator.

Benefits of technology

It improves the efficiency of power line inspection, enables drones to fly automatically along power lines for inspection, reduces manual intervention, and improves the stability and efficiency of patrol.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118963398A_ABST
    Figure CN118963398A_ABST
Patent Text Reader

Abstract

The invention discloses an inspection control method and device for an electric power circuit, and the method specifically comprises the steps: controlling an unmanned plane for executing the inspection of the electric power circuit to take off in response to an inspection start instruction of a user; positioning the unmanned aerial vehicle according to satellite positioning information collected in real time to obtain coarse positioning information of the unmanned aerial vehicle; acquiring power transmission line information of a power line at the current position of the unmanned aerial vehicle; performing refined positioning processing according to the coarse positioning information, the power transmission line information and a preset power transmission line fitting curve to obtain refined positioning information; and according to the refined positioning information, a preset off-line map and a work task, controlling the unmanned aerial vehicle to inspect the power line. Based on the scheme, the unmanned aerial vehicle can perform autonomous inspection on the power line without online control of an operator, so that the inspection efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of electric power equipment, and more specifically, to a patrol control method and device for electric power lines. Background Art

[0002] At present, with the continuous development of artificial intelligence and communication technology, the performance of various channel visualization equipment has been continuously enhanced. It has the advantages of high-definition images, light equipment, low cost, and intelligent alarm. It can effectively overcome the difficulties in power transmission line inspections, such as complex terrain, slow manual inspections, and high risk factors. It has been widely used in the monitoring of hidden dangers of external damage to power transmission line channels. Among them, drones, as a new type of monitoring equipment with a special perspective, can realize the inspection of transmission lines in a lighter, more flexible and safer way. However, in the current inspection process using drones, due to the lack of autonomous navigation and control of line maps, drones cannot conduct autonomous inspections, and operators are required to perform online control based on the current video, resulting in low inspection efficiency. Summary of the invention

[0003] In view of this, the present application provides a patrol control method and device for power lines, which are used to control a drone to perform autonomous patrol operations on power lines based on a lightweight navigation map to improve patrol efficiency.

[0004] In order to achieve the above objectives, the proposed solution is as follows:

[0005] A patrol control method for a power line, the patrol control method comprising the steps of:

[0006] In response to the user's inspection start command, the drone used to perform power line inspection is controlled to take off;

[0007] Positioning the UAV according to the satellite positioning information collected in real time to obtain rough positioning information of the UAV;

[0008] Obtaining transmission line information of the power line at the current location of the drone;

[0009] Performing refined positioning processing according to the coarse positioning information, the transmission line information and a preset transmission line fitting curve to obtain refined positioning information;

[0010] According to the refined positioning information, the preset offline map and the work task, the drone is controlled to perform an inspection on the power line.

[0011] Optionally, the step of obtaining the transmission line information of the power line at the current location of the drone comprises the steps of:

[0012] Collecting image information of the power line based on the video recording equipment of the drone;

[0013] The image information is processed based on a CNN neural network to obtain the transmission line information.

[0014] Optionally, performing refined positioning processing according to the coarse positioning information, the transmission line information and a preset transmission line fitting curve to obtain refined positioning information comprises the steps of:

[0015] Comparing the transmission line information with the transmission line fitting curve to obtain a positioning correction value;

[0016] The coarse positioning information is processed according to the positioning correction amount to obtain the refined positioning information.

[0017] Optionally, the following steps are also included:

[0018] The transmission line fitting curve is constructed based on the transmission line image information collected by the UAV.

[0019] Optionally, the step of constructing the transmission line fitting curve based on the transmission line image information collected by the drone comprises the following steps:

[0020] Controlling the UAV to fly along the power line to be inspected based on the high-precision map, and obtaining the whole line image information collected by the UAV during the flight and the satellite positioning information corresponding to the whole line image information;

[0021] Processing the image information of the entire line based on a CNN neural network to obtain two-dimensional point chain information of the power line to be inspected;

[0022] Processing the two-dimensional point chain information using the satellite positioning information to obtain three-dimensional point chain information;

[0023] The three-dimensional point chain information piece is subjected to three-dimensional quadratic curve fitting processing to obtain the transmission line fitting curve.

[0024] Optionally, the following steps are also included:

[0025] The transmission line fitting curve is updated based on crowdsourcing data information.

[0026] Optionally, the updating process of the transmission line fitting curve based on crowdsourced data information comprises the steps of:

[0027] Acquire the crowdsourced data information collected by multiple inspection drones, wherein the crowdsourced data information includes image information and satellite positioning information collected by each inspection drone during the inspection of the power line to be inspected;

[0028] Performing data unification processing on the crowd-sourced data information to obtain maintenance information;

[0029] The transmission line fitting curve is corrected based on the maintenance information.

[0030] A patrol control device for a power line, the patrol control device comprising:

[0031] A take-off execution module is configured to respond to a user's inspection start instruction and control the take-off of a drone used to perform power line inspection;

[0032] A coarse positioning module is configured to locate the UAV according to the satellite positioning information collected in real time to obtain coarse positioning information of the UAV;

[0033] An information acquisition module is configured to acquire transmission line information of a power line at a current location of the drone;

[0034] A fine positioning module is configured to perform fine positioning processing according to the coarse positioning information, the transmission line information and a preset transmission line fitting curve to obtain fine positioning information;

[0035] The inspection execution module is configured to control the drone to perform inspection on the power line according to the refined positioning information, a preset offline map and a work task.

[0036] Optionally, also include:

[0037] The offline construction module is configured to construct the transmission line fitting curve based on the transmission line image information collected by the drone.

[0038] Optionally, also include:

[0039] The crowdsourcing update module is configured to update the transmission line fitting curve based on the crowdsourcing data information.

[0040] It can be seen from the above technical scheme that the present application discloses a patrol control method and device for power lines, specifically, responding to the user's patrol start command, controlling the take-off of a drone used to perform power line patrol; positioning the drone according to the real-time collected satellite positioning information to obtain the drone's rough positioning information; obtaining the transmission line information of the power line at the drone's current location; performing refined positioning processing according to the rough positioning information, the transmission line information and the preset transmission line fitting curve to obtain refined positioning information; and controlling the drone to perform patrol inspections on the power lines according to the refined positioning information, the preset offline map and the work task. Based on this scheme, the drone can perform autonomous patrol inspections on the power lines without the need for operator online control, thereby improving patrol efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0042] Figure 1 A flow chart of a power line inspection control method according to an embodiment of the present application;

[0043] Figure 2 A flowchart of another power line inspection control method according to an embodiment of the present application;

[0044] Figure 3 A flowchart of another power line inspection control method according to an embodiment of the present application;

[0045] Figure 4 A block diagram of a power line inspection control device according to an embodiment of the present application;

[0046] Figure 5 A block diagram of another power line inspection control device according to an embodiment of the present application;

[0047] Figure 6 This is a block diagram of another power line inspection control device according to an embodiment of the present application. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0049] This solution aims to parameterize and lightweight 3D reconstruction of the transmission lines under maintenance, and adopts a crowdsourcing 3D reconstruction solution. The so-called crowdsourcing means that the unique map can be maintained and updated through the information provided by different types of drones. This lightweight transmission line map can first provide prior information for drone automatic inspections, and at the same time provide positioning layers, navigation layers, and visualization layers, so that drones can perform more stable automatic inspections, saving most of the time for manual inspections.

[0050] Embodiment 1

[0051] Figure 1 This is a flow chart of a power line inspection control method according to an embodiment of the present application.

[0052] like Figure 1 As shown, the inspection control method of this embodiment is applied to a drone equipped with inspection equipment, such as video recording equipment, radar equipment, etc., for inspecting power lines. The inspection control method includes the following steps:

[0053] S1. Control the drone to take off according to the user's inspection start command.

[0054] That is, after receiving the inspection start command sent by the user through remote control or other means, the drone is controlled to take off and arrive at the inspection starting point or interruption point based on the command, and the first or next stage of the inspection task begins. Generally speaking, after the drone completes takeoff, it should arrive at the proximity of the power line being inspected.

[0055] S2. Roughly locate the UAV based on satellite positioning information.

[0056] That is, according to the satellite positioning information collected in real time by the satellite positioning equipment carried by the drone, generally speaking, the satellite positioning information is the latitude and longitude information, altitude information and time information collected based on the Beidou positioning system, GPS system, etc. Since the accuracy of satellite positioning information cannot meet the accuracy required for power line inspection, only a position parameter with poor accuracy, namely coarse positioning information, can be obtained based on satellite positioning information.

[0057] S3. Obtain the transmission line information of the power line where the drone is located.

[0058] That is, based on the image information of the power line to be inspected collected by the drone, the transmission line information of the power line is obtained. This is achieved through the following steps:

[0059] First, image information of the power line collected by the video recording device carried by the drone is obtained, and the image information can be pictures or video materials.

[0060] Then, the CNN neural network is used to process the image information and extract the transmission line information of the power line.

[0061] S4. Perform fine positioning processing on the power line based on the coarse positioning information and transmission line information.

[0062] That is, after obtaining the above-mentioned rough positioning information and transmission line information, the rough positioning information, the transmission line information and the preset transmission line fitting curve are finely positioned to obtain the fine positioning information of the power line. The transmission line fitting curve in this embodiment is based on the image information of the current line collected by the drone, and is a kind of curve data obtained through the processing of preset steps. It is a three-dimensional point chain information expressed by points, lines, heights and longitudes and latitudes. The specific process includes:

[0063] Firstly, the obtained transmission line information is compared with the transmission line fitting curve at any time to obtain the positioning correction value.

[0064] Then, the coarse positioning information is processed based on the positioning correction amount, thereby obtaining precise positioning information that is much more precise than the coarse positioning information.

[0065] S5. Control the drone to perform inspections based on the refined positioning information, offline maps, and work tasks.

[0066] The offline map is an electronic map pre-installed in the drone's control device. The work task refers to the wires, towers and other power equipment between the starting points of the power lines that need to be inspected during this flight, which pass through multiple locations. The specific process is to plan the task based on the refined positioning information, offline map and work tasks, and control the drone based on the planned route, altitude and residence information, so that the drone flies along the power lines to be inspected and inspects the power lines during the flight.

[0067] It can be seen from the above technical scheme that this embodiment provides a patrol control method for power lines, specifically, responding to the user's patrol start command, controlling the take-off of a drone used to perform power line patrol; positioning the drone according to the real-time collected satellite positioning information to obtain the drone's rough positioning information; obtaining the transmission line information of the power line at the current location of the drone; performing refined positioning processing according to the rough positioning information, the transmission line information and the preset transmission line fitting curve to obtain refined positioning information; and controlling the drone to perform patrol inspections on the power lines according to the refined positioning information, the preset offline map and the work task. Based on this scheme, the drone can perform autonomous patrol inspections on the power lines without the need for operator online control, thereby improving the patrol efficiency.

[0068] In addition, the transmission line fitting curve in the present application is one of the core improvements. Therefore, the present embodiment provides the following specific implementation method for constructing a transmission line fitting curve based on the transmission line image information collected by the drone. The specific process is as follows: Figure 2 As shown:

[0069] S401, controlling the UAV to fly along the designated power lines and collect images.

[0070] That is, the selected UAV with inspection function is controlled to fly along the power line to be inspected based on the high-precision map, and the image information of the entire line is obtained by the UAV collecting images of the power line during the flight. At the same time, the satellite positioning information corresponding to the image information can be obtained at any time based on the satellite positioning equipment set up by it.

[0071] This step aims to maintain the 3D reconstructed map. It does not limit the types of participating drones. During each inspection, the existing high-precision map is used to guide the automatic inspection. After each inspection, the reconstruction results of this inspection are updated to the high-precision reconstructed map. Using this working method, multiple inspection results can be fully utilized to obtain more accurate information around the line. The specific operation process of this step is as follows:

[0072] Step 1: The drone takes off and starts working according to the specified inspection route.

[0073] Step 2: The drone obtains the existing high-precision reconstructed map from the data cloud. First, it uses GNSS (Global Positioning System) to determine whether there is a three-dimensional reconstructed map at the current location of the drone. If there is three-dimensional reconstructed map information on the inspection route, the existing map information is used to guide the inspection work. The specific guided patrol work is completed according to the different layers of the map: the positioning layer guides the positioning work during the inspection process, and the real-time layer guides the dynamic avoidance of obstacles. If there is no high-precision reconstructed map at this location, the inspection work is guided by the GNSS positioning information.

[0074] Step 3: After the drone completes the entire inspection or during the inspection, the inspection data is uploaded to the data cloud.

[0075] S402, processing the image information of the entire line based on the CNN neural network.

[0076] By processing the image information of the entire line, the two-dimensional point chain information of the power line to be inspected is obtained.

[0077] S403: Process the two-dimensional point chain information using satellite positioning information.

[0078] After obtaining the two-dimensional point chain information, based on the satellite positioning information obtained by the positioning device, for each data point in the satellite positioning information, including longitude and latitude information and altitude information, the two-dimensional point chain information is processed to obtain three-dimensional point chain information.

[0079] S404, performing three-dimensional quadratic curve fitting processing on the three-dimensional point chain information.

[0080] After the three-dimensional point chain information is obtained, a three-dimensional quadratic curve fitting process is performed on it to obtain the above-mentioned transmission line fitting curve.

[0081] In combination with the above technical solutions, the specific form of the high-precision map needs to be specified during actual implementation.

[0082] in:

[0083] The map layer is designed as follows: based on the point cloud representation, all objects are represented as point clouds, where the color information of the point cloud represents different objects, with wires represented as gray, power towers as black, trees and vegetation as green, and other artificial buildings as yellow;

[0084] The positioning layer is represented as a voxel grid. Each voxel grid is mathematically described as the point cloud geometric distribution of objects in the environment, and is divided into point feature voxel grids, line feature voxel grids, and surface voxel grids according to their distribution patterns. Special transmission lines are represented as cubic curves.

[0085] The real-time layer is represented as: binding the spatiotemporal relationship of the real-time information and saving the real-time reconstructed 3D point cloud. That is, the observation point cloud at any time and any position can be transmitted back;

[0086] The specific implementation steps are as follows:

[0087] Step 1: Based on the previously set cruising path and the currently obtained information, the UAV performs voxel processing on the point cloud collected in real time, and correlates and compares it with the voxel information in the existing map for real-time positioning. With the positioning information, the path is cruised in combination with the surrounding perception algorithm and planning control algorithm inside the UAV.

[0088] Step 2: Unify the collected information, process the information collected by different cameras into a unified image size, and unify the point cloud density of data obtained by different lidar sensors.

[0089] Step 3: Update the high-precision reconstructed map based on the collected information, corresponding to different layers:

[0090] Step 4: Observe the offline high-precision map, conduct detailed analysis on areas with large changes, observe the observation information in the real-time layer, and determine whether there is a warning distance between vegetation and lines based on the point cloud relationship in the real-time map.

[0091] In addition, another specific implementation of this embodiment also includes an update scheme for the transmission line fitting curve, specifically updating the transmission line fitting curve based on crowdsourcing data information, specifically including the following steps: Figure 3 As shown:

[0092] S411. Obtain crowdsourced data information collected by multiple inspection drones.

[0093] The so-called crowdsourced data information refers to data collected by drones of all models and types, based on different models of recording equipment and other sensors, including image information, satellite positioning information and other information.

[0094] S412: Perform data unification processing on crowdsourcing data information.

[0095] After unified processing, maintenance information for correcting the transmission line fitting curve is obtained. That is, the information collected by crowdsourcing drones is processed in a unified way to eliminate the data differences between different models of drones. For example, the information collected by different cameras is processed in a unified image size, the data obtained by different lidar sensors are unified in point cloud density, the longitude and latitude positioning information of satellite positioning information is unified into a rectangular coordinate system with the starting point of the entire power line as the origin, and the high-frequency attitude sensors (IMU, barometer, etc.) are unified to the same data collection frequency.

[0096] S413: Correct the transmission line fitting curve based on the maintenance information.

[0097] After obtaining the maintenance information, the preset transmission line fitting curve is corrected, which can ensure the correctness of the curve and realize automatic maintenance after the real line changes, without the need for manual maintenance when necessary.

[0098] In addition, in the data cloud, human operators can view real-time alarm information through the real-time layer information in the UI interface, view the corresponding location information, time information, image information, point cloud information, map reconstruction information, and make further judgments on whether an emergency has occurred. If a situation endangers the safety of the circuit, personnel need to be urgently arranged to conduct manual inspections to confirm and eliminate the danger.

[0099] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0100] Although operations are depicted in a particular order, this should not be understood as requiring that the operations be performed in the particular order shown or in a sequential order.Multitasking and parallel processing may be advantageous under certain circumstances.

[0101] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0102] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as C or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer.

[0103] Embodiment 2

[0104] Figure 4 A block diagram of a power line inspection control device according to an embodiment of the present application.

[0105] like Figure 4 As shown, the inspection control device of this embodiment is applied to a drone equipped with inspection equipment, such as video recording equipment, radar equipment, etc., for inspecting power lines. The inspection control device includes a takeoff execution module 10, a coarse positioning module 20, an information acquisition module 30, a fine positioning module 40 and an inspection execution module 50.

[0106] The takeoff execution module is used to control the drone to take off according to the user's inspection start command.

[0107] That is, after receiving the inspection start command sent by the user through remote control or other means, the drone is controlled to take off and arrive at the inspection starting point or interruption point based on the command, and the first or next stage of the inspection task begins. Generally speaking, after the drone completes takeoff, it should arrive at the proximity of the power line being inspected.

[0108] The coarse positioning module is used to roughly locate the UAV based on satellite positioning information.

[0109] That is, according to the satellite positioning information collected in real time by the satellite positioning equipment carried by the drone, generally speaking, the satellite positioning information is the latitude and longitude information, altitude information and time information collected based on the Beidou positioning system, GPS system, etc. Since the accuracy of satellite positioning information cannot meet the accuracy required for power line inspection, only a position parameter with poor accuracy, namely coarse positioning information, can be obtained based on satellite positioning information.

[0110] The information acquisition module is used to obtain the transmission line information of the power line where the drone is located.

[0111] That is, based on the image information of the power line to be inspected collected by the drone, the transmission line information of the power line is obtained. This module is specifically implemented through the following steps:

[0112] First, image information of the power line collected by the video recording device carried by the drone is obtained, and the image information can be pictures or video materials.

[0113] Then, the CNN neural network is used to process the image information and extract the transmission line information of the power line.

[0114] The fine positioning module is used to perform fine positioning processing on the power lines based on the coarse positioning information and the transmission line information.

[0115] That is, after obtaining the above-mentioned rough positioning information and transmission line information, the rough positioning information, the transmission line information and the preset transmission line fitting curve are finely positioned to obtain the fine positioning information of the power line. The transmission line fitting curve in this embodiment is based on the image information of the current line collected by the drone, and is a kind of curve data obtained through the processing of preset steps. It is a three-dimensional point chain information expressed by points, lines, heights and longitudes. The specific execution process of this module includes:

[0116] Firstly, the obtained transmission line information is compared with the transmission line fitting curve at any time to obtain the positioning correction value.

[0117] Then, the coarse positioning information is processed based on the positioning correction amount, thereby obtaining precise positioning information that is much more precise than the coarse positioning information.

[0118] The inspection execution module is used to control the drone to perform inspections based on refined positioning information, offline maps and work tasks.

[0119] The offline map is an electronic map pre-installed in the drone's control device. The work task refers to the wires, towers and other power equipment between the starting points of the power lines that need to be inspected during this flight, which pass through multiple locations. The specific process is to plan the task based on the refined positioning information, offline map and work tasks, and control the drone based on the planned route, altitude and residence information, so that the drone flies along the power lines to be inspected and inspects the power lines during the flight.

[0120] It can be seen from the above technical scheme that this embodiment provides a patrol control device for power lines, specifically, responding to the user's patrol start command, controlling the take-off of a drone used to perform power line patrol; positioning the drone according to the real-time collected satellite positioning information to obtain the drone's rough positioning information; obtaining the transmission line information of the power line at the current location of the drone; performing refined positioning processing according to the rough positioning information, the transmission line information and the preset transmission line fitting curve to obtain refined positioning information; and controlling the drone to perform patrol inspections on the power lines according to the refined positioning information, the preset offline map and the work task. Based on this scheme, the drone can perform autonomous patrol inspections on the power lines without the need for operator online control, thereby improving the patrol efficiency.

[0121] In addition, a specific implementation of this embodiment also includes an offline construction module 60, such as Figure 5 As shown in the figure, it is used to construct a transmission line fitting curve based on the transmission line image information collected by the UAV. The specific execution process of this module is as follows:

[0122] S401, controlling the UAV to fly along the designated power lines and collect images.

[0123] That is, the selected UAV with inspection function is controlled to fly along the power line to be inspected based on the high-precision map, and the image information of the entire line is obtained by the UAV collecting images of the power line during the flight. At the same time, the satellite positioning information corresponding to the image information can be obtained at any time based on the satellite positioning equipment set up by it.

[0124] This step aims to maintain the 3D reconstructed map. It does not limit the types of participating drones. During each inspection, the existing high-precision map is used to guide the automatic inspection. After each inspection, the reconstruction results of this inspection are updated to the high-precision reconstructed map. Using this working method, multiple inspection results can be fully utilized to obtain more accurate information around the line. The specific operation process of this step is as follows:

[0125] Step 1: The drone takes off and starts working according to the specified inspection route.

[0126] Step 2: The drone obtains the existing high-precision reconstructed map from the data cloud. First, it uses GNSS (Global Positioning System) to determine whether there is a three-dimensional reconstructed map at the current location of the drone. If there is three-dimensional reconstructed map information on the inspection route, the existing map information is used to guide the inspection work. The specific guided patrol work is completed according to the different layers of the map: the positioning layer guides the positioning work during the inspection process, and the real-time layer guides the dynamic avoidance of obstacles. If there is no high-precision reconstructed map at this location, the inspection work is guided by the GNSS positioning information.

[0127] Step 3: After the drone completes the entire inspection or during the inspection, the inspection data is uploaded to the data cloud.

[0128] S402, processing the image information of the entire line based on the CNN neural network.

[0129] By processing the image information of the entire line, the two-dimensional point chain information of the power line to be inspected is obtained.

[0130] S403: Process the two-dimensional point chain information using satellite positioning information.

[0131] After obtaining the two-dimensional point chain information, based on the satellite positioning information obtained by the positioning device, for each data point in the satellite positioning information, including longitude and latitude information and altitude information, the two-dimensional point chain information is processed to obtain three-dimensional point chain information.

[0132] S404, performing three-dimensional quadratic curve fitting processing on the three-dimensional point chain information.

[0133] After the three-dimensional point chain information is obtained, a three-dimensional quadratic curve fitting process is performed on it to obtain the above-mentioned transmission line fitting curve.

[0134] In addition, in another specific implementation of this embodiment, a crowdsourcing update module 70 is also included. Figure 6 As shown, it is used to update the transmission line fitting curve based on crowdsourcing data information. The specific operation steps of this module are as follows:

[0135] S411. Obtain crowdsourced data information collected by multiple inspection drones.

[0136] The so-called crowdsourced data information refers to data collected by drones of all models and types, based on different models of recording equipment and other sensors, including image information, satellite positioning information and other information.

[0137] S412: Perform data unification processing on crowdsourcing data information.

[0138] After unified processing, maintenance information for correcting the transmission line fitting curve is obtained. That is, the information collected by crowdsourcing drones is processed in a unified way to eliminate the data differences between drones of different models. For example, the information collected by different cameras is processed in a unified image size, the data obtained by different lidar sensors are unified in point cloud density, the longitude and latitude positioning information of satellite positioning information is unified into a rectangular coordinate system with the starting point of the entire power line as the origin, and the high-frequency attitude sensors (IMU, barometer, etc.) are unified to the same data collection frequency.

[0139] S413: Correct the transmission line fitting curve based on the maintenance information.

[0140] After obtaining the maintenance information, the preset transmission line fitting curve is corrected, which can ensure the correctness of the curve and realize automatic maintenance after the real line changes, without the need for manual maintenance when necessary.

[0141] In addition, in the data cloud, human operators can view real-time alarm information through the real-time layer information in the UI interface, view the corresponding location information, time information, image information, point cloud information, map reconstruction information, and make further judgments on whether an emergency has occurred. If a situation endangers the safety of the circuit, personnel need to be urgently arranged to conduct manual inspections to confirm and eliminate the danger.

[0142] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0143] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0144] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0145] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0146] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0147] The technical solution provided by the present invention is introduced in detail above. Specific examples are used in this article to illustrate the principle and implementation mode of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation mode and application scope. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. A patrol control method for a power line, characterized in that: The inspection control method comprises the steps of: In response to the user's inspection start command, the drone used to perform power line inspection is controlled to take off; Positioning the UAV according to the satellite positioning information collected in real time to obtain rough positioning information of the UAV; Obtaining transmission line information of the power line at the current location of the drone; Performing refined positioning processing according to the coarse positioning information, the transmission line information and a preset transmission line fitting curve to obtain refined positioning information; According to the refined positioning information, the preset offline map and the work task, the drone is controlled to perform an inspection on the power line.

2. The inspection control method according to claim 1, characterized in that: The step of obtaining the transmission line information of the power line at the current location of the drone comprises the following steps: Collecting image information of the power line based on the video recording equipment of the drone; The image information is processed based on a CNN neural network to obtain the transmission line information.

3. The inspection control method according to claim 1, characterized in that: The performing of refined positioning processing according to the coarse positioning information, the transmission line information and the preset transmission line fitting curve to obtain refined positioning information comprises the steps of: Comparing the transmission line information with the transmission line fitting curve to obtain a positioning correction value; The coarse positioning information is processed according to the positioning correction amount to obtain the refined positioning information.

4. The inspection control method according to any one of claims 1 to 3, characterized in that: Also includes the steps: The transmission line fitting curve is constructed based on the transmission line image information collected by the UAV.

5. The inspection control method according to claim 4, characterized in that: The method of constructing the transmission line fitting curve based on the transmission line image information collected by the drone includes the following steps: Controlling the UAV to fly along the power line to be inspected based on the high-precision map, and obtaining the whole line image information collected by the UAV during the flight and the satellite positioning information corresponding to the whole line image information; Processing the image information of the entire line based on a CNN neural network to obtain two-dimensional point chain information of the power line to be inspected; Processing the two-dimensional point chain information using the satellite positioning information to obtain three-dimensional point chain information; The three-dimensional point chain information piece is subjected to three-dimensional quadratic curve fitting processing to obtain the transmission line fitting curve.

6. The inspection control method according to claim 4, characterized in that: Also includes the steps: The transmission line fitting curve is updated based on crowdsourcing data information.

7. The inspection control method according to claim 6, characterized in that: The updating process of the transmission line fitting curve based on crowdsourced data information comprises the steps of: Acquire the crowdsourced data information collected by multiple inspection drones, wherein the crowdsourced data information includes image information and satellite positioning information collected by each inspection drone during the inspection of the power line to be inspected; Performing data unification processing on the crowd-sourced data information to obtain maintenance information; The transmission line fitting curve is corrected based on the maintenance information.

8. A patrol control device for a power line, characterized in that: The inspection control device comprises: A take-off execution module is configured to respond to a user's inspection start instruction and control the take-off of a drone used to perform power line inspection; A coarse positioning module is configured to locate the UAV according to the satellite positioning information collected in real time to obtain coarse positioning information of the UAV; An information acquisition module is configured to acquire transmission line information of a power line at a current location of the drone; A fine positioning module is configured to perform fine positioning processing according to the coarse positioning information, the transmission line information and a preset transmission line fitting curve to obtain fine positioning information; The inspection execution module is configured to control the drone to perform inspection on the power line according to the refined positioning information, a preset offline map and a work task.

9. The inspection control device according to claim 8, characterized in that: Also includes: The offline construction module is configured to construct the transmission line fitting curve based on the transmission line image information collected by the drone.

10. The inspection control device according to claim 9, characterized in that: Also includes: The crowdsourcing update module is configured to update the transmission line fitting curve based on the crowdsourcing data information.