Power transmission line inspection system and method based on unmanned aerial vehicle, electronic equipment and medium

By installing AI edge computing equipment on drones and optimizing patrol routes and tasks in real time, the problem that it is difficult to consider multi-dimensional influencing factors in the drone inspection path planning is solved, and comprehensive coverage and efficient patrol of transmission lines are achieved. Improve the stability of the power network.

CN119070182AInactive Publication Date: 2024-12-03STATE GRID SHANDONG ELECTRIC POWER CO HUIMIN COUNTY POWER SUPPLY CO
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411176660.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-26
Publication Date
2024-12-03
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing drone patrol path planning is difficult to consider multi-dimensional influencing factors, resulting in a "blind spot" in the patrol path, which may miss potential failure points and affect the stability of the power network.

Method used

Adopt a drone inspection system based on AI edge computing equipment to optimize inspection routes and tasks by tracking target objects and environmental data in real time, ensuring that drones can fully cover transmission lines, especially in complex terrain and remote areas.

Benefits of technology

It improves the comprehensiveness and efficiency of drone inspections, reduces the consumption of manpower, material resources and time, and ensures the stability and safety of the power network.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119070182A_ABST
    Figure CN119070182A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a power transmission line inspection system and method based on an unmanned aerial vehicle, electronic equipment and a medium, and belongs to the field of power inspection. The system comprises an unmanned aerial vehicle, AI edge computing equipment and an inspection control center, wherein the unmanned aerial vehicle carries task load equipment and is used for carrying out power transmission line inspection according to a preset inspection route; the AI edge computing device is installed on the unmanned aerial vehicle and used for tracking a target object in real time, controlling the camera to carry out identification and shooting tasks, extracting key information in the inspection data and transmitting the key information to the inspection control center; and the inspection control center is used for adjusting and optimizing the inspection route and task of the unmanned aerial vehicle in real time according to the key information, and generating an inspection report according to the inspection data transmitted by the unmanned aerial vehicle. The routing inspection route and task are adjusted and optimized in real time through key information in the routing inspection data, the comprehensiveness of unmanned aerial vehicle routing inspection is further ensured, and certain data support is provided for the stability of a power network.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of electric power inspection, and in particular to a transmission line inspection system, method, electronic equipment and medium based on an unmanned aerial vehicle. Background Art

[0002] With the continuous expansion and increasing complexity of the power grid, the inspection of transmission lines has become a key link in ensuring the stability and safety of power supply. Traditional inspection methods, such as manual inspection, not only consume a lot of manpower, material resources and time, but also have inspection blind spots in certain areas (such as remote mountainous areas, swampy areas, etc.), and cannot fully cover all transmission lines. In addition, manual inspection also faces problems such as high safety risks and low work efficiency. Especially in severe weather conditions, the safety of inspectors is difficult to guarantee.

[0003] In recent years, the rapid development of drone technology has brought changes to power transmission line inspection. The drone inspection system has been widely used in the field of power inspection due to its high efficiency, flexibility and safety.

[0004] Inspection route planning is an important part of the drone inspection system. However, existing route planning often fails to take into account multi-dimensional influencing factors, resulting in "blind spots" in the inspection route, that is, some areas may not be covered by drones. This may cause potential fault points to be missed, affecting the stability of the power network. Summary of the invention

[0005] The purpose of the embodiments of the present invention is to provide a transmission line inspection system, method, electronic device and medium based on a drone, which are used to fully or at least partially solve the technical problems existing in the above-mentioned prior art.

[0006] In order to achieve the above-mentioned object, an embodiment of the present invention provides a transmission line inspection system based on a drone, including: a drone, an AI edge computing device, and an inspection control center; Among them, the drone is equipped with mission payload equipment, which is used to inspect the transmission lines according to the preset inspection route; AI edge computing devices, installed on drones, are used to track target objects in real time, control cameras to carry out identification and shooting tasks, and extract key information from inspection data and transmit it to the inspection control center; The inspection control center is used to adjust and optimize the inspection routes and tasks of drones in real time based on key information, and generate inspection reports based on the inspection data transmitted by drones.

[0007] Optionally, the inspection route settings include: The inspection control center collects and analyzes the inspection requirements of the power transmission lines to be inspected input by the user, and imports the geographical information and surrounding environment data of the power transmission lines to be inspected into the inspection control center; The inspection control center plans the inspection route of the drone based on the geographic information of the power transmission line to be inspected and the surrounding environment data.

[0008] Optionally, after the inspection control center plans the inspection route of the drone based on the geographic information of the power transmission line to be inspected and the surrounding environment data, the inspection control center is further used to: The inspection route is optimized according to the obstacles around the inspection route to obtain the target inspection route; According to the inspection requirements input by the user, set inspection tasks for the drone; wherein the inspection tasks at least include taking photos of specific areas, recording temperature data, and identifying abnormal conditions; Associate the set inspection tasks with the planned target inspection routes to ensure that the drone performs inspections according to the set tasks during flight.

[0009] Optionally, the AI ​​edge computing device is specifically used for: Receive image data transmitted by the camera, analyze pixel information in the image data, identify the target area that matches the characteristics of the target object, and output the location and size information of the target area; When a target object is detected in the target area, the movement trajectory of the target object is tracked in consecutive image frames using the position, size and speed information of the target object; The camera shooting field of view of the drone is adjusted according to the motion trajectory of the target object to ensure that the target object always remains within the camera's field of view.

[0010] Optionally, the inspection control center is specifically used for: Receive flight data, environmental data, and inspection images transmitted by the drone, and identify the drone’s current location, speed, and flight status information; Based on the current position, speed and flight status of the drone, the completion status of the drone's current inspection task is evaluated. If an area has not been inspected or the inspection effect does not meet expectations, it will be marked as an area to be re-inspected; Determine whether to adjust the inspection route or task priority based on the drone's current location, speed, and flight status information combined with weather data and geographic information data.

[0011] On the other hand, the present invention also provides a power transmission line inspection method applied to a power transmission line inspection system based on a drone, comprising: Control the drone to inspect the power transmission lines according to the preset inspection route; Use the AI ​​edge computing device installed on the drone to track the target object in real time, control the camera to carry out identification and shooting tasks, and extract key information from the inspection data; The key information is transmitted to the inspection control center so that the inspection control center can adjust and optimize the inspection route and tasks of the drone in real time, and generate an inspection report based on the inspection data transmitted by the drone.

[0012] On the other hand, the present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned power transmission line inspection method when executing the program.

[0013] On the other hand, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the above-mentioned power transmission line inspection method are implemented.

[0014] Through the above technical solutions, drones can quickly cover large areas, especially in complex terrain and remote areas, avoiding the large consumption of manpower, material resources and time in traditional manual inspections. The inspection routes and tasks can be adjusted and optimized in real time through key information in the inspection data, further ensuring the comprehensiveness of drone inspections, improving inspection efficiency, and providing certain data support for the stability of the power network.

[0015] Other features and advantages of the embodiments of the present invention will be described in detail in the subsequent detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the following specific implementations, they are used to explain the embodiments of the present invention, but do not constitute a limitation on the embodiments of the present invention. In the accompanying drawings: Figure 1 It is a structural schematic diagram of a transmission line inspection system based on a drone provided in an embodiment of the present invention; Figure 2 It is an implementation flow chart of a power transmission line inspection method applied to a power transmission line inspection system based on a drone provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0017] The specific implementation of the embodiment of the present invention is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described here is only used to illustrate and explain the embodiment of the present invention, and is not used to limit the embodiment of the present invention.

[0018] See also Figure 1As shown, it is a structural schematic diagram of a transmission line inspection system based on a drone provided in an embodiment of the present invention, including: a drone 10, an AI edge computing device 11 and an inspection control center 12.

[0019] Among them, the drone 10 is equipped with a mission payload device, which is used to inspect the transmission lines according to a preset inspection route; the AI ​​edge computing device 11 is installed on the drone 10, which is used to track the target object in real time, and control the camera to carry out identification and shooting tasks, as well as extract key information from the inspection data and transmit it to the inspection control center 12; the inspection control center 12 is used to adjust and optimize the inspection route and tasks of the drone in real time according to the key information, and generate an inspection report for the inspection data transmitted by the drone 10.

[0020] It should be noted that a data transmission network is used for data transmission between the drone and the inspection control center, mainly using 5G communication technology to ensure the real-time and stability of data transmission. At the same time, the system also has data encryption and security protection functions to ensure the security and integrity of the data.

[0021] Preferably, the UAV is equipped with mission payload equipment including at least an optoelectronic pod, a gimbal, a camera, an infrared thermal imager, etc.

[0022] In some embodiments, the setting of the inspection route includes: the inspection control center collects and analyzes the inspection requirements of the transmission lines to be inspected input by users, and imports the geographic information and surrounding environment data of the transmission lines to be inspected into the inspection control center; the inspection control center plans the inspection route of the drone based on the geographic information and surrounding environment data of the transmission lines to be inspected.

[0023] It should be understood that geographic information includes but is not limited to the precise location and height of the transmission lines. The setting of the drone's inspection route will also take into account factors such as the direction of the transmission lines, topography, and flight safety.

[0024] In some embodiments, after the inspection control center plans the inspection route of the drone based on the geographic information of the transmission line to be inspected and the surrounding environment data, the inspection control center is also used to: optimize the inspection route according to the obstacles around the inspection route to obtain the target inspection route; set inspection tasks for the drone according to the inspection requirements input by the user; wherein the inspection tasks at least include taking photos of specific areas, recording temperature data, and identifying abnormal conditions; and associate the set inspection tasks with the planned target inspection route to ensure that the drone performs inspections according to the set tasks during flight.

[0025] It should be noted that before the formal inspection, the inspection control center will conduct simulated flights and tests to ensure that the drone can perform inspections according to the preset routes and tasks. During the inspection process, if special circumstances are encountered or new inspection requirements are discovered, the inspection control center can make real-time adjustments to the inspection routes and tasks based on actual conditions, including but not limited to the specific transmission line sections to be inspected, inspection priorities, and inspection time requirements.

[0026] In some embodiments, the AI ​​edge computing device is specifically used to: receive image data transmitted by a camera, analyze pixel information in the image data, identify a target area that matches the characteristics of the target object, and output the position and size information of the target area; when a target object is detected in the target area, track the motion trajectory of the target object in continuous image frames using the position, size, and speed information of the target object; and adjust the camera shooting field of view of the drone according to the motion trajectory of the target object to ensure that the target object always remains within the camera's field of view.

[0027] Specifically, the analysis process of pixel information includes converting color images into grayscale images to reduce the amount of data processed while retaining sufficient image information. Use the mean filter algorithm to remove image noise and smooth the image. Use the Sobel operator edge detection algorithm to extract edge information in the image and detect corner points in the image for target tracking and matching, where corner points are points in the image where pixel values ​​change dramatically. Set one or more thresholds to segment the image into different regions or objects. Group the pixels in the image into different regions based on the similarity between pixels. Use Blob analysis to detect connected regions in the image, extract target objects in the image, and calculate their number, position, shape, direction, size and other information.

[0028] In the first frame of the image, the initial position and size of the target object are identified using the above-mentioned feature extraction and image segmentation methods. Based on the initial position and size of the target object, the bounding box of the target object in the image is determined. In subsequent image frames, the point set that matches the feature points of the target object is found by matching feature points (corner points). In each frame, the center point coordinates of the target object are obtained and recorded as the position information of the target object in the frame. The width and height of the target object in the bounding box are recorded to determine the scale change of the target object during movement. The position and size information of each frame are organized in chronological order to form a time series to reflect the movement and change process of the target object over time. The center point coordinates of each frame are plotted in the coordinate system using the drawing library, and the coordinates of each center point are connected to form the trajectory of the target object.

[0029] Specifically, the process of extracting edge information from an image using the Sobel operator edge detection algorithm includes using the gradient magnitude calculation formula ,in, and Represents the gradient of the image in the x and y directions, and calculates the gradient amplitude of each pixel. To determine the edge strength at each pixel. A threshold T is set in advance, and the gradient amplitude of each pixel is compared with the threshold T. If the gradient amplitude of a pixel is greater than T, the pixel is considered an edge point.

[0030] It should be noted that the target object can be set according to a specific application scenario, such as an insulator or a tower pole, etc., and is not limited here.

[0031] In some embodiments, the inspection control center is specifically used to: receive flight data, environmental data, and inspection images transmitted by the drone, and identify the drone's current position, speed, and flight status information; evaluate the completion of the drone's current inspection task based on the drone's current position, speed, and flight status information, and if an area has not been inspected or the inspection effect does not meet expectations, mark it as an area to be re-inspected; determine whether to adjust the inspection route or task priority based on the drone's current position, speed, and flight status information combined with weather data and geographic information data.

[0032] Specifically, based on the current position, speed and flight status information of the UAV, the evaluation of the completion of the current inspection task of the UAV includes first comparing the position trajectory, using the GIS system to visualize the position trajectory of the UAV, and then comparing the real-time position of the UAV with the predetermined inspection route to check whether it deviates from the predetermined trajectory; analyzing whether the flight speed of the UAV is kept within a reasonable range. If the speed is too fast or too slow, it will affect the quality and coverage of the inspection; observing the pitch angle, yaw angle and roll angle of the UAV in the GIS system to check whether the attitude of the UAV is stable; determining the inspection coverage rate based on the position trajectory of the UAV and the map information of the inspection area. If the inspection route of the UAV does not deviate from the predetermined trajectory, the flight speed is kept within a reasonable range, the attitude of the UAV is stable, and the inspection coverage rate meets the preliminary review requirements, it indicates that the inspection task of the UAV is completed. If any of these conditions is not met, it means that the inspection task is not completed.

[0033] In a specific embodiment, suppose that a power company is using drones to inspect a vast area of ​​power lines. This area includes various terrains such as mountains, plains and lakes, and the climate is changeable, and sometimes there will be adverse weather conditions such as strong winds and rain. The drone flies according to the preset inspection route, while transmitting real-time flight data (such as altitude, speed, heading, etc.), environmental data (such as temperature, humidity, wind speed, etc.) and inspection images (such as high-definition photos or videos of power lines). The inspection control center receives this data in real time and stores it in the database for subsequent analysis. By analyzing the flight data, the inspection control center can accurately identify the current position, speed and flight status of the drone (such as stable flight, hovering, turning, etc.). At the same time, combined with the inspection image, the control center can also understand the shooting angle and clarity of the drone on the power line.

[0034] Suppose that when a drone is inspecting a mountainous area, due to signal interference or terrain obstruction, the image quality of a certain section of the power line is poor and the line status cannot be clearly judged. When evaluating this part of the data, the inspection control center will mark it as a "not inspected" or "inspection effect does not meet expectations" area to be re-inspected. The control center may receive a forecast showing that there will be strong winds in the future, which may affect the stable flight and shooting quality of the drone. Based on the above information, the inspection control center decides to adjust the inspection route and task priority. For the mountainous power lines to be re-inspected, since the upcoming strong winds may increase the flight risk, the control center decides to increase their priority and arrange the drone for re-inspection as soon as possible. At the same time, considering the impact of strong winds on drone flight, the control center also decides to adjust the inspection route to avoid wind outlets and terrain areas that are easily affected by wind. The inspection control center sends the adjusted inspection route and task priority instructions to the drone. After receiving the instructions, the drone continues to perform the inspection task according to the new route and priority.

[0035] Through the above technical solutions, drones can quickly cover large areas, especially in complex terrain and remote areas, avoiding the large consumption of manpower, material resources and time in traditional manual inspections. The inspection routes and tasks can be adjusted and optimized in real time through key information in the inspection data, further ensuring the comprehensiveness of drone inspections, improving inspection efficiency, and providing certain data support for the stability of the power network.

[0036] See also Figure 2 As shown, it is a flowchart of an implementation of a power transmission line inspection method applied to a power transmission line inspection system based on a drone provided by an embodiment of the present invention, including the following execution steps: Step 200: Control the UAV to inspect the power transmission line according to a preset inspection route.

[0037] Step 201: Use the AI ​​edge computing device installed on the drone to track the target object in real time, control the camera to perform recognition and shooting tasks, and extract key information from the inspection data.

[0038] Step 202: The key information is transmitted to the inspection control center, so that the inspection control center can adjust and optimize the inspection route and tasks of the drone in real time, and generate an inspection report based on the inspection data transmitted by the drone.

[0039] On the other hand, the present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned power transmission line inspection method when executing the program.

[0040] On the other hand, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the above-mentioned power transmission line inspection method are implemented.

[0041] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0042] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0043] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1A function specified in one or more boxes.

[0044] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0045] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0046] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0047] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0048] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0049] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A transmission line inspection system based on drones, It is characterized in that include: Drones, AI edge computing devices, and inspection control centers; Among them, the drone is equipped with mission payload equipment, which is used to inspect the transmission lines according to the preset inspection route; AI edge computing devices, installed on drones, are used to track target objects in real time, control cameras to carry out identification and shooting tasks, and extract key information from inspection data and transmit it to the inspection control center; The inspection control center is used to adjust and optimize the inspection routes and tasks of drones in real time based on key information, and generate inspection reports based on the inspection data transmitted by drones.

2. The power transmission line inspection system according to claim 1, It is characterized in that Inspection route settings include: The inspection control center collects and analyzes the inspection requirements of the power transmission lines to be inspected input by the user, and imports the geographical information and surrounding environment data of the power transmission lines to be inspected into the inspection control center; The inspection control center plans the inspection route of the drone based on the geographic information of the power transmission line to be inspected and the surrounding environment data.

3. The power transmission line inspection system according to claim 2, It is characterized in that After the inspection control center plans the inspection route of the drone based on the geographic information of the power transmission line to be inspected and the surrounding environment data, the inspection control center is also used to: The inspection route is optimized according to the obstacles around the inspection route to obtain the target inspection route; According to the inspection requirements input by the user, set inspection tasks for the drone; wherein the inspection tasks at least include taking photos of specific areas, recording temperature data, and identifying abnormal conditions; Associate the set inspection tasks with the planned target inspection routes to ensure that the drone performs inspections according to the set tasks during flight.

4. The power transmission line inspection system according to claim 1, It is characterized in that AI edge computing devices are specifically used for: Receive image data transmitted by the camera, analyze pixel information in the image data, identify the target area that matches the characteristics of the target object, and output the location and size information of the target area; When a target object is detected in the target area, the movement trajectory of the target object is tracked in consecutive image frames using the position, size and speed information of the target object; The camera shooting field of view of the drone is adjusted according to the motion trajectory of the target object to ensure that the target object always remains within the camera's field of view.

5. The power transmission line inspection system according to claim 1, It is characterized in that The inspection control center is specifically used for: Receive flight data, environmental data, and inspection images transmitted by the drone, and identify the drone’s current location, speed, and flight status information; Based on the current position, speed and flight status of the drone, the completion status of the drone's current inspection task is evaluated. If an area has not been inspected or the inspection effect does not meet expectations, it will be marked as an area to be re-inspected; Determine whether to adjust the inspection route or task priority based on the drone's current location, speed, and flight status information combined with weather data and geographic information data.

6. A power transmission line inspection method applied to the power transmission line inspection system based on a drone as described in any one of claims 1 to 5, It is characterized in that include: Control the drone to inspect the power transmission lines according to the preset inspection route; Use the AI ​​edge computing device installed on the drone to track the target object in real time, control the camera to carry out identification and shooting tasks, and extract key information from the inspection data; The key information is transmitted to the inspection control center so that the inspection control center can adjust and optimize the inspection route and tasks of the drone in real time, and generate an inspection report based on the inspection data transmitted by the drone.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the program, the steps of the power transmission line inspection method according to claim 6 are implemented.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed by a processor, the steps of the power transmission line inspection method according to claim 6 are implemented.