Autonomous flight drone system for monitoring underground power distribution lines

The autonomous drone system addresses safety and efficiency issues in underground conduit inspections by using a marker line for stable flight and navigation, enabling accurate surveillance and rapid abnormality detection.

KR103046746B1Active Publication Date: 2026-11-11안덕순
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
KR1020260151748
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2026-08-13
Publication Date
2026-11-11
Estimated Expiration
2046-08-13

AI Technical Summary

Technical Problem

Conventional methods for inspecting underground power conduits face challenges such as safety risks for workers, low efficiency, and difficulty in maintaining drone stability and accurate location recognition due to poor lighting, repetitive structures, and unreliable distance sensors, leading to instability in drone flight and path control.

Method used

An autonomous flight drone system that utilizes a marker line consisting of two lines on the conduit ceiling to maintain a constant distance, calculates altitude and position corrections based on pixel differences, and uses curve markers for stable navigation through curved sections, enabling periodic inspections without human intervention.

Benefits of technology

The system ensures safe, efficient, and accurate monitoring of underground power conduits by reducing safety risks, improving inspection efficiency, and maintaining drone stability and navigation accuracy, with rapid identification of abnormalities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112026099277501-PAT00021_ABST
    Figure 112026099277501-PAT00021_ABST
Patent Text Reader

Abstract

The present invention relates to an autonomous flight drone system for monitoring underground power distribution lines. More specifically, the invention relates to an autonomous flight drone system for monitoring underground power distribution lines in which an autonomous flight drone periodically flies inside an underground power conduit where underground power distribution lines are laid, captures surveillance images of the underground power conduit and underground power distribution lines, and collects and analyzes the captured surveillance images through a docking station and a monitoring server to monitor for any abnormalities in the underground power conduit and underground power distribution lines. Furthermore, the present invention relates to an autonomous flight drone system for monitoring underground power distribution lines in which the autonomous flight drone can stably fly inside the underground power conduit while maintaining a certain distance from the ceiling by utilizing a marker line consisting of two lines displayed on the ceiling of the underground power conduit, and the altitude, left / right position, and direction of travel of the autonomous flight drone can be controlled by analyzing the identification image of said marker line.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] The present invention relates to an autonomous flight drone system for monitoring underground power distribution lines. More specifically, the invention relates to an autonomous flight drone system for monitoring underground power distribution lines in which an autonomous flight drone periodically flies inside an underground power conduit where underground power distribution lines are laid, captures surveillance images of the underground power conduit and underground power distribution lines, and collects and analyzes the captured surveillance images through a docking station and a monitoring server to monitor for any abnormalities in the underground power conduit and underground power distribution lines. Furthermore, the present invention relates to an autonomous flight drone system for monitoring underground power distribution lines in which the autonomous flight drone can stably fly inside the underground power conduit while maintaining a certain distance from the ceiling by utilizing a marker line consisting of two lines displayed on the ceiling of the underground power conduit, and the altitude, left / right position, and direction of travel of the autonomous flight drone can be controlled by analyzing the identification image of said marker line. Background Technology

[0002] Underground power conduits, where underground power distribution lines are laid, are underground facilities that house various cables such as distribution lines, communication lines, and control lines, as well as various devices such as cable support hangers, junction boxes, ventilation equipment, drainage equipment, lighting equipment, and fire detection equipment. Since these underground power conduits are major infrastructure facilities directly related to the stability of power supply, it is necessary to periodically inspect for abnormal conditions such as cable deterioration, overheating, leakage, flooding, condensation, signs of fire, damage to cable support structures, ingress of foreign matter, and equipment failure.

[0003] To this end, conventional methods mainly involved workers directly entering underground power tunnels to inspect them visually, or using equipment such as portable cameras, thermal imaging cameras, and gas detectors to check the internal conditions. However, since underground power tunnels are environments where passageways are narrow, lighting is low, and temperatures and humidity are high, as well as dust, leaks, and hazardous gases may be present, the method of workers directly entering to inspect poses a high risk of safety accidents and has low inspection efficiency.

[0004] Furthermore, underground power conduits feature a linear structure that extends long in the longitudinal direction, often with cables, hangers, junction boxes, and various auxiliary facilities arranged in a repetitive manner. Consequently, inspecting the entire section by physically moving through it consumes a significant amount of time, and the detection of abnormal conditions can vary depending on the inspector's proficiency or fatigue level. Particularly in sections where identical or similar structures appear repeatedly, it is difficult to pinpoint the exact location even if signs of anomalies are detected, which may result in additional time being required for subsequent maintenance work.

[0005] Conventional technologies intended to address this issue have considered methods involving deploying mobile inspection devices or unmanned vehicles into underground power conduits to capture video. However, since the floors of underground power conduits contain drainage channels, elevation differences, cables, obstacles, flooded areas, or work debris, devices moving along the floor suffer from reduced driving stability. Furthermore, the inspectable sections are limited by obstacles or flood conditions, making such methods practically difficult to utilize.

[0006] To address these issues, a technology for automatically patrolling underground power conduits using autonomous drones is being proposed. Autonomous drones have the advantage of being able to move along the interior of underground power conduits with relatively little influence from ground obstacles, elevation differences, or flooding conditions, and can photograph or measure the condition of underground power conduits and distribution lines by being equipped with surveillance cameras, thermal imaging cameras, or various sensors.

[0007] However, it is difficult to directly apply general autonomous flight technology inside underground power tunnels because GPS cannot be used, lighting is very low, and the structure features repeated, identical cables and cable hangers over long distances. In particular, it is difficult to reliably recognize the drone's current location, direction of travel, and target flight path within underground power tunnels, and there is a problem in accurately determining the drone's location or direction of travel based solely on video footage.

[0008] In addition, typical underground power conduits are formed with a width and height of approximately 2 to 4 meters, ensuring space for drone flight; however, considering the various structures and facilities installed near the ceiling, drones must fly long distances while maintaining a constant distance of several tens of centimeters from the ceiling. In this case, since the distance from the ceiling can change significantly even with a height change of only a few centimeters, it is very important to continuously maintain a constant distance during long-distance autonomous flight.

[0009] However, when using general ultrasonic sensors, infrared sensors, optical distance sensors, LiDAR, or vision sensors, measurement errors may occur depending on the ceiling material or surface condition, lighting environment, reflectivity, dust, condensation, etc., making it difficult to consistently maintain high precision during long-distance flights. Additionally, if local irregularities or structures are present on the ceiling surface, the sensor may momentarily measure an incorrect distance, potentially leading to instability in the drone's altitude control.

[0010] In particular, when autonomous drones perform speed changes, attitude control, direction changes, or flight through curved sections, the roll or pitch of the aircraft changes, causing the attitude of the camera capturing the ceiling to tilt as well, which can distort the image of a reference object formed on the ceiling. Such image distortion can destabilize the size, position, or shape information of the reference object within the ceiling image, thereby reducing the reliability of altitude control and path control.

[0011] Furthermore, since the interior of underground power conduits may include curved sections as well as straight ones, it is difficult to accurately determine whether the drone is entering a curved section using a method that simply recognizes obstacles or walls ahead. Additionally, there is a problem in that the drone struggles to stably maintain a flight trajectory corresponding to the shape of the underground power conduit within curved sections. In particular, there is also the issue of difficulty in restoring the normal direction of travel if the drone loses its course due to sudden yaw rotations or disturbances during long-distance flights.

[0012] Furthermore, since the interior of underground power conduits mostly consists of repetitively arranged identical cables and cable hangers, it is difficult to identify the specific location from the recorded footage alone, and it is also difficult for workers to quickly locate the specific position after detecting abnormal signs.

[0013] Furthermore, the interior of underground power conduits is very poor for establishing a wireless communication environment. Wireless signals can be attenuated or reflected by power cables, metal structures, and concrete walls, and if the underground power conduit is formed as a long, enclosed structure, there is a problem in that it is difficult to perform stable real-time communication with a remote monitoring server while the drone is flying.

[0014] Therefore, there is a need to develop an autonomous drone system for monitoring underground power distribution lines that can periodically acquire surveillance images of underground power conduits and distribution lines without a worker directly entering the underground power conduit, stably control the altitude, left / right position, and direction of travel of the autonomous drone even inside underground power conduits where satellite navigation systems are not provided, and respond to issues such as curved sections, loss of direction, failure to recognize paths, and difficulty in specifying shooting locations. Prior art literature

[0015] Korean Registered Patent No. 10-2487554 (2023-01-06) System for Detecting Internal Damage in Utility Tunnels Using Autonomous Mobile Vehicles Korean Published Patent No. 10-2019-0091714 (2019-08-07) Autonomous Exploration Method for Underground Utility Tunnels Using Unmanned Aerial Vehicles Korean Registered Patent No. 10-2710776 (2024-09-23) Power Tunnel Inspection Device Korean Registered Patent No. 10-2019049 (2019-09-02) Mobile Robot for Maintenance of Underground Structures The problem to be solved

[0016] The present invention, devised to solve the aforementioned problems, aims to provide an autonomous flight drone system for monitoring underground power distribution lines that enables periodic acquisition and analysis of surveillance images of underground power conduits and underground power distribution lines without a worker having to directly enter the underground power conduit.

[0017] Another objective of the present invention is to enable an autonomous drone to fly stably along the interior of an underground power conduit, even in environments where a satellite navigation system (GPS) cannot be used, lighting is low, and identical or similar cables and cable hangers are repeatedly arranged, such as inside an underground power conduit.

[0018] Another objective of the present invention is to mark a marker line consisting of two lines (L1, L2) having a constant distance (D) between them on the ceiling of an underground power conduit, and to enable an autonomous drone to fly while maintaining a constant distance (H) from the ceiling by using an identification image captured of the marker line.

[0019] Another objective of the present invention is to enable rapid determination of changes in separation distance between an autonomous flying drone and a ceiling using the number of pixels between two lines (L1, L2) captured in an identification image, without relying on ultrasonic sensors, infrared sensors, optical distance sensors, LiDAR, or general vision sensors, and to generate an altitude correction value (Hc) based on the difference between a measured pixel (P1) and a reference pixel (P0).

[0020] Another objective of the present invention is to enable the autonomous flight drone to perform descent control when it gets too close to the ceiling and ascend control when it gets too far away from the ceiling by pre-storing a reference pixel (P0) when the autonomous flight drone is located at a reference distance (H) from the ceiling and comparing it with an actual pixel (P1) calculated from an identification image captured during actual flight.

[0021] Another objective of the present invention is to enable the correction of the left-right position and direction of travel of an autonomous flight drone by calculating a virtual center point (Cp2) using the respective midpoints (Lm1, Lm2) located at the point where each of the two lines (L1, L2) captured in the identification image is bisected, without separately forming a physical center mark between the two lines (L1, L2), and by calculating a virtual center line (C2) along the center between the two lines (L1, L2).

[0022] Another objective of the present invention is to determine the degree of lateral deviation of an autonomous flight drone using the relative position between a center point (Cp1) located at the center of an identification image and a virtual center point (Cp2) between two lines (L1, L2), and to perform left-right horizontal movement control so that the center of the autonomous flight drone does not deviate from the vertical downward projection area between the two lines (L1, L2).

[0023] Another objective of the present invention is to generate a direction correction value (Dc) based on the angle between a center vertical line (C1) connecting the upper midpoint and the lower midpoint of an identification image and a virtual center line (C2) calculated along the center between two lines (L1, L2), and to use this to perform horizontal angle control so that the direction of travel of an autonomous flight drone remains parallel to the length direction of the marker line.

[0024] Another objective of the present invention is to enable the number of pixels between two lines (L1, L2), a virtual center point (Cp2), and a virtual center line (C2) to be stably calculated in an identification image even if roll or pitch occurs during the process of an autonomous flight drone performing speed changes, acceleration / deceleration, direction changes, or attitude control, by controlling the marker gimbal so that the lens optical axis of the marker camera is oriented vertically toward the ceiling of the underground power conduit.

[0025] Another objective of the present invention is to enable stable flight control and reduce distortion of identification images using only relatively simple gimbal control that maintains a vertical upward direction relative to the direction of gravity, rather than high-difficulty gimbal control that precisely tracks the local normal direction of the ceiling surface, by taking into account the fact that typical underground power conduits may have a gentle slope in the direction of travel but mostly remain horizontal in the width direction.

[0026] Another objective of the present invention is to enable stable passage through the same curved section even when the inspection flight direction and the return flight direction are opposite to each other, by placing curve markers at the starting and ending positions of the curved section, respectively, when the underground power conduit includes a curved section, and generating curve start information or curve end information based on the order in which the curve markers are identified.

[0027] Another objective of the present invention is to control an autonomous drone to fly along a trajectory having a radius of curvature (R) when entering a curved section based on the curve marker by including a radius of curvature (R) and a bending direction when entering a curved section based on the curve marker, and to switch to straight-line flight when exiting the curved section.

[0028] Another objective of the present invention is to enable stable altitude control using a wide angle of view by calculating a reference pixel (P0) using a reference pixel calculation formula that reflects the projection characteristics of the fisheye lens, even when an equidistant projection fisheye lens is used as the lens of a marker camera, and calculating the number of pixels between the point where the center horizontal line (C3) and two lines (L1, L2) intersect as the actual pixel (P1).

[0029] Another objective of the present invention is to determine and correct the lateral deviation or deviation in the direction of travel of an autonomous flying drone by utilizing the curved shape of the virtual center line (C2), the direction of the center of curvature, and the intersection relationship with the center vertical line (C1) when the virtual center line (C2) calculated based on two lines (L1, L2) in the identification image appears in a curved form due to the influence of a fisheye lens or flight attitude.

[0030] Another objective of the present invention is to prevent the loss or prolonged flight of an autonomous drone in the event of a path recognition failure by generating a path absence alarm when two lines (L1, L2) cannot be identified in the identification image, and by causing the autonomous drone to follow the previous flight path in reverse or change its direction of travel by 180 degrees to return to the docking station.

[0031] Another objective of the present invention is to enable an autonomous flight drone to determine and correct its normal direction of travel even when it loses its direction of travel or moves in the opposite direction due to disturbances or control errors, by forming the colors, brightness, or saturation of two lines (L1, L2) differently from each other and identifying the arrangement relationship of the two lines (L1, L2) in an identification image.

[0032] Another objective of the present invention is to enable the rapid and accurate identification of the shooting location of a surveillance video in which an abnormal sign is detected by placing a location marker between two lines (L1, L2) and storing the location identification ID and the distance traveled from the location marker together as metadata of the surveillance video when storing the surveillance video.

[0033] The technical problems that the present invention aims to solve are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art to which the present invention belongs from the description below. means of solving the problem

[0034] The present invention, for solving the aforementioned problems, relates to an autonomous flight drone system for monitoring underground power lines, which can monitor underground power lines and underground power lines by capturing and analyzing images of underground power lines and underground power lines using a drone capable of autonomous flight inside an underground power conduit, comprising: an autonomous flight drone; one or more docking stations located within the underground power conduit, capable of downloading image data captured by the autonomous flight drone and charging the battery of the autonomous flight drone when the autonomous flight drone lands, and capable of transmitting the image data to a remote location; and a monitoring server capable of receiving and analyzing the image data transmitted by the docking station to diagnose abnormalities in the underground power conduit and underground power lines. and a marker line displayed on the ceiling of the underground power conduit, consisting of two lines (L1, L2) having a color contrasting with the color of the ceiling surface of the underground power conduit and having a certain distance (D) between them, extending from the inspection start point to the inspection end point of the underground power conduit; wherein the autonomous flight drone includes a flight control unit, a surveillance camera, a marker camera, a marker gimbal, a control calculation unit, a storage unit, and a communication unit; wherein the surveillance camera captures surveillance images of the underground power conduit or the underground power distribution line while the autonomous flight drone is flying and stores them in the storage unit; wherein the marker camera captures identification images of the marker line while the autonomous flight drone is flying and transmits them in real time to the control calculation unit; wherein the marker gimbal controls the attitude of the marker camera so that the lens optical axis of the marker camera can be in a vertical direction toward the ceiling of the underground power conduit; and wherein the storage unit contains the identification images captured when the marker camera captures the identification images at a certain distance (H) from the ceiling of the underground power conduit A reference pixel (P0), which is the number of pixels between the two lines (L1, L2) mentioned above, is stored, andThe communication unit can connect to the docking station via a local area network to perform data communication, and the control calculation unit analyzes the two lines (L1, L2) captured in the identification image to generate an altitude correction value (Hc), a left-right correction value (Lc), and a direction correction value (Dc), and then transmits them to the flight control unit. The flight control unit controls the autonomous flight drone to take off from the docking station at predetermined time intervals, autonomously fly along the space below the two lines (L1, L2) from the inspection start point to the inspection end point, and then return to the docking station, wherein: - altitude control is performed using the altitude correction value (Hc) so that the autonomous flight drone can fly forward while maintaining the separation distance (H) from the ceiling of the underground power conduit; and - the center of the autonomous flight drone can fly forward without deviating from the vertical downward projection area between the two lines (L1, L2) using the left-right correction value (Lc). Horizontal movement control in the left and right directions is performed, and horizontal angle (yaw) control is performed using the direction correction value (Dc) so that the autonomous flight drone can fly forward while maintaining its direction of travel parallel to the length direction of the marker line, and the reference pixel (P0) is calculated using the distance between lines (D), the separation distance (H), and the specifications of the marker camera, and the value calculated by the number of pixels between the two lines (L1, L2) captured in the identification image is set as the actual pixel (P1), the altitude correction value (Hc) is generated based on the difference between the actual pixel (P1) and the reference pixel (P0), the left and right correction value (Lc) is generated based on the relative position between the center point (Cp1) located at the exact center of the identification image and the virtual center point (Cp2) between the two lines (L1, L2) in the identification image, and the direction correction value (Dc) isIt is preferable to have an autonomous flight drone system for monitoring underground power distribution lines, characterized in that it is generated based on the angle between a central vertical line (C1) connecting the midpoint of the upper side and the midpoint of the lower side of the identification image and a virtual center line (C2) between the two lines (L1, L2) in the identification image, wherein the virtual center point (Cp2) is the midpoint of a virtual line segment connecting each midpoint (Lm1, Lm2) located at the point that bisects each of the two lines (L1, L2) captured in the identification image, and the virtual center line (C2) is a line virtually drawn in the longitudinal direction along the center between the two lines (L1, L2) captured in the identification image.

[0035] In addition to the features described above, the present invention further comprises a height correction value (Hc) which is a value obtained by subtracting the actual pixel (P1) from the reference pixel (P0) (P0-P1) or a value proportional to the subtracted value (P0-P1), wherein the reference pixel (P0) is calculated as shown in the following equation using the line distance (D), the separation distance (H), the focal length (f) of the marker camera, the horizontal length (W) of the image sensor of the marker camera, and the number of horizontal pixels (Pw) of the image sensor.

[0036]

[0037] It is also preferable to have an autonomous flight drone system for monitoring underground power distribution lines, wherein the flight control unit: - maintains the current altitude of the autonomous flight drone when the altitude correction value (Hc) is within a predetermined allowable range; - performs descent control so that the autonomous flight drone moves away from the ceiling of the underground power conduit when the altitude correction value (Hc) is a negative value outside the allowable range; and - performs ascent control so that the autonomous flight drone moves closer to the ceiling of the underground power conduit when the altitude correction value (Hc) is a positive value outside the allowable range; and - increases the amount of control for ascent control or descent control as the absolute value of the altitude correction value (Hc) increases.

[0038] In addition to the features described above, the present invention further comprises: the left-right correction value (Lc) being a deviation distance (d1) from the center between the two lines (L1, L2) of the autonomous flying drone, or a value proportional to the deviation distance (d1); the deviation distance (d1) is calculated as shown in the following equation using the x-coordinate value (P2) of the virtual center point (Cp2) based on the number of pixels, where the center point (Cp1) is set as the coordinate origin (0,0) with the direction of the center vertical line (C1) in the identification image as the y-axis and the direction perpendicular to the y-axis as the x-axis.

[0039]

[0040] (D: Inter-line distance, P1: Actual pixels, P2: Number of pixels relative to the x-axis of the virtual center point Cp2 when the center point Cp1 in the identification image is set as the coordinate origin)

[0041] It is also preferable to have an autonomous flight drone system for monitoring underground power distribution lines, wherein the flight control unit: - maintains the current left and right position of the autonomous flight drone when the left and right correction value (Lc) is within a predetermined allowable range; - performs left and right horizontal movement control for the autonomous flight drone so that the x-coordinate value (P2) or the deviation distance (d1) approaches 0 when the left and right correction value (Lc) is outside the allowable range; and - increases the amount of control for the left and right horizontal movement control as the absolute value of the left and right correction value (Lc) increases.

[0042] In addition to the features described above, the present invention is also preferably an autonomous flight drone system for monitoring underground power distribution lines, wherein the direction correction value (Dc) is the intersection angle (θ) formed by the virtual center line (C2) with respect to the center vertical line (C1) or a value proportional to the intersection angle (θ), and has a positive value when the virtual center line (C2) is tilted clockwise and a negative value when it is tilted counterclockwise; the flight control unit maintains the current flight angle of the autonomous flight drone when the direction correction value (Dc) is within a predetermined allowable range, and performs horizontal angle (yaw) control for the autonomous flight drone so that the intersection angle (θ) approaches 0 when the direction correction value (Dc) is outside the allowable range, and increases the amount of control for the horizontal angle (yaw) control as the absolute value of the direction correction value (Dc) increases, and the control calculation unit calculates the intersection angle (θ) as shown in the following equation.

[0043]

[0044] (x, y are relative coordinates to an arbitrary point on the virtual center line (C2) that is not the intersection point, where the intersection point of the virtual center line (C2) and the center vertical line (C1) is set as the coordinate origin (0,0).)

[0045] In addition to the features described above, the present invention further comprises: the underground power conduit including a curved section; and a curve marker disposed between the two lines (L1, L2) at each of the starting and ending positions of the curved section, wherein each of the curve markers includes an identification ID, a radius of curvature (R) of the curved section, and a bending direction when entering the curved section based on the corresponding curve marker; wherein the control calculation unit generates curve start information or curve end information and transmits it to the flight control unit when the curve marker is included in the identification image, wherein, based on the order in which the curve marker is identified after the autonomous flight drone takes off from the docking station, the curve start information is generated when the curve marker is identified at an odd number, and the curve end information is generated when the curve marker is identified at an even number; wherein the curve start information includes the radius of curvature (R) and the bending direction; and when the flight control unit receives the curve start information, the radius of curvature (R) is directed toward the bending direction for the autonomous flight drone It is also desirable to have an autonomous flight drone system for monitoring underground power distribution lines, wherein the autonomous flight drone is controlled to fly along a trajectory, and when curve termination information is received, it is controlled to fly in a straight direction, and when the autonomous flight drone enters the curve section, the control calculation unit calculates the tangent direction at the point closest to the center point (Cp1) of the identification image from one of the two lines (L1, L2) captured in the identification image, and generates the direction correction value (Dc) based on the angle formed by the center vertical line (C1) and the tangent direction.

[0046] In addition to the features described above, the present invention is also preferably an autonomous flight drone system for monitoring underground power distribution lines, wherein the lens of the marker camera is a fisheye lens of an equidistant projection type, the control calculation unit calculates the number of pixels between the intersection points where the center horizontal line (C3) connecting the center point of the left side and the center point of the right side of the identification image and the two lines (L1, L2) respectively intersect as the actual pixel (P1), and the reference pixel (P0) is calculated as shown in the following equation using the distance between lines (D), the separation distance (H), the focal length (f) of the marker camera, the horizontal length (W) of the image sensor of the marker camera, and the number of horizontal pixels (Pw) of the image sensor.

[0047]

[0048] In addition to the features described above, the control calculation unit, when the virtual center line (C2) calculated based on the two lines (L1, L2) captured in the identification image is calculated in a curved form, - if the virtual center line (C2) and the center vertical line (C1) do not intersect each other, determines that there is a lateral deviation, identifies the direction opposite to the center of curvature of the curve included in the virtual center line (C2) as the correction direction (Xd), and transmits it to the flight control unit; the flight control unit performs left and right direction control to cause the autonomous flight drone to move horizontally in the correction direction (Xd), and performs this until the virtual center line (C2) becomes a straight line; - if the virtual center line (C2) and the center vertical line (C1) have an intersection point where they intersect each other, determines that the direction of travel is misaligned, identifies the rotation direction (Xt) where the intersection angle (θ) of the virtual center line (C2) becomes 0, and transmits it to the flight control unit; and the flight control unit It is also desirable to have an autonomous flight drone system for monitoring underground power distribution lines, characterized by performing horizontal angle control so that the autonomous flight drone rotates in the rotation direction (Xt), and performing this until the virtual centerline (C2) becomes a straight line.

[0049] In addition to the features described above, the present invention is also preferably an autonomous flight drone system for monitoring underground power distribution lines, wherein the control calculation unit transmits a path absence warning to the flight control unit when the two lines (L1, L2) cannot be identified in the identification image, and the flight control unit controls the autonomous flight drone to return to the docking station by following the previous flight path in reverse or changing the direction of travel by 180 degrees when receiving the path absence warning, and the docking station transmits a path absence notification or a non-return notification to the monitoring server when the autonomous flight drone transmits the path absence warning after landing or when the autonomous flight drone does not return within a predetermined scheduled return time after takeoff.

[0050] In addition to the features described above, the present invention is also preferably an autonomous flight drone system for monitoring underground power distribution lines, wherein the two lines (L1, L2) have different colors, brightness, or saturation, and the control calculation unit determines the normal direction of travel of the autonomous flight drone by identifying the difference in color, brightness, or saturation for each of the two lines (L1, L2) in the identification image, and if it is determined that the direction is different from the normal direction of travel as a result of identifying the difference in color, brightness, or saturation, it transmits direction error information to the flight control unit, and the flight control unit controls the horizontal angle so that the arrangement relationship of the colors, brightness, or saturation of the two lines (L1, L2) identified in the identification image matches the normal direction of travel when the direction error information is received.

[0051] In addition to the features described above, the present invention further comprises a position marker positioned between the two lines (L1, L2) at a fixed interval or at a designated point, wherein the position marker includes a position identification ID, and the control calculation unit: - identifies the position identification ID when the position marker is included in the identification image; - receives speed information from the flight control unit and calculates the distance traveled from the position marker in real time; - transmits the position identification ID and the distance traveled to the surveillance camera; and the surveillance camera stores the position identification ID and the distance traveled together as metadata of the surveillance image when storing the surveillance image in the storage unit. Effects of the invention

[0052] The present invention has a configuration that utilizes an autonomous drone to capture surveillance images of underground power conduits and underground power distribution lines, and collects and analyzes the captured images through a docking station and a monitoring server. Since this allows workers to check the condition of underground power conduits and underground power distribution lines without directly entering the underground power conduits, it has the effect of reducing the risk of safety accidents for workers and improving the safety and efficiency of underground power distribution line inspections.

[0053] In addition, the present invention has a configuration in which an autonomous flight drone is controlled to take off from a docking station at predetermined time intervals, fly autonomously inside an underground power conduit, and then return to the docking station. Since this enables periodic and repetitive inspections of underground power conduits and underground power distribution lines, it has the effect of continuously monitoring abnormal conditions of underground power conduits and underground power distribution lines while reducing the burden of manual inspection on workers.

[0054] In addition, the present invention has a configuration in which a docking station can download video data of an autonomous flight drone, charge a battery, and transmit video data to a remote location. Since the operation of the autonomous flight drone, retrieval of video data, and battery management are performed automatically or semi-automatically inside an underground power conduit, it has the effect of reducing the problem of an operator having to frequently enter the site to retrieve the drone, replace the battery, or retrieve video data.

[0055] In addition, the present invention has a configuration in which a monitoring server receives and analyzes video data transmitted from a docking station to diagnose abnormalities in underground power conduits and underground power distribution lines. Since monitoring footage captured inside the underground power conduit is verified and analyzed at a remote location, it has the effect of quickly identifying signs of abnormalities in underground power conduits and underground power distribution lines and shortening the maintenance response time.

[0056] In addition, the present invention has a configuration in which a marker line consisting of two lines (L1, L2) having a constant distance (D) between them is formed on the ceiling of an underground power conduit, and the actual pixel (P1) between the two lines (L1, L2) is calculated in an identification image and compared with a reference pixel (P0). Since the change in the distance between the ceiling and the autonomous flight drone is converted into a change in the number of pixels in the image between the two lines (L1, L2) and detected, the effect is to stably perform altitude control of the autonomous flight drone without relying on a separate high-precision distance sensor.

[0057] In addition, the present invention has a configuration that allows the value obtained by subtracting the actual pixel (P1) from the reference pixel (P0) or a value proportional thereto to be used as an altitude correction value (Hc). Since the autonomous flight drone is determined to be close to the ceiling and performs descent control when the actual pixel (P1) becomes larger than the reference pixel (P0), and the autonomous flight drone is determined to be farther from the ceiling and performs ascent control when the actual pixel (P1) becomes smaller than the reference pixel (P0), the distance (H) from the ceiling can be corrected quickly and intuitively.

[0058] In addition, the present invention has a configuration in which the marker line consists of two lines (L1, L2), and thus reduces the area that needs to be marked on the ceiling compared to the case where a large area marker strip is formed, thereby reducing the burden of construction and reducing the risk that the entire marker mark will become unrecognizable due to dust, condensation, leakage, or contamination.

[0059] In addition, the present invention has a configuration that calculates a virtual center point (Cp2) by connecting the respective midpoints (Lm1, Lm2) located at the point where each of the two lines (L1, L2) captured in the identification image is bisected, and calculates a virtual center line (C2) in the longitudinal direction along the center between the two lines (L1, L2). Since this allows the reference position and reference direction of travel of the drone to be calculated within the identification image without separately forming a physical center mark, it has the effect of enabling left-right position control and direction of travel control while simplifying the ceiling display structure.

[0060] In addition, the present invention has a configuration that generates a left-right correction value (Lc) based on the relative position between a center point (Cp1) located at the center of the identification image and a virtual center point (Cp2), and thus functions to determine how far the current center of the autonomous flying drone has deviated from the vertical downward projection area between two lines (L1, L2), thereby having the effect of suppressing the autonomous flying drone from deviating to the left or right in the narrow internal space of an underground power conduit.

[0061] In addition, the present invention has a configuration that generates a direction correction value (Dc) based on the angle between the center vertical line (C1) and the virtual center line (C2) of the identification image, and since it functions to determine the degree to which the direction of travel of the autonomous flight drone is tilted with respect to the length direction of the marker line, it has the effect of correcting the horizontal angle (yaw) of the autonomous flight drone so that it can stably advance flight along the length direction of the underground power conduit.

[0062] In addition, the present invention has a configuration in which a marker gimbal controls the attitude of a marker camera so that the lens optical axis of the marker camera is vertically oriented toward the ceiling of an underground power conduit. Since this ensures that the shooting direction of the marker camera is stably maintained even when roll or pitch occurs in the body of an autonomous flying drone, it has the effect of enabling more accurate calculation of the number of pixels between two lines (L1, L2), a virtual center point (Cp2), and a virtual center line (C2) in an identification image.

[0063] Furthermore, based on the observation that typical underground power conduits may have a gentle slope in the direction of travel but mostly remain horizontal in the width direction, the present invention allows the marker gimbal to be configured to maintain the lens optical axis vertically upward relative to the direction of gravity. Since this enables the acquisition of stable identification images without precisely tracking the local normal direction of the ceiling surface, it has the effect of improving the reliability of altitude and path control while reducing the complexity of gimbal control.

[0064] In addition, the present invention has a configuration in which curve markers are placed at the starting and ending positions of a curved section, respectively, and curve start information or curve end information is generated based on the order in which the curve markers are identified after the autonomous drone takes off from the docking station. Since this configuration ensures that the curve marker identified first is treated as the start of the curved section even when the inspection flight direction and the return flight direction are opposite to each other, it has the effect of enabling stable passage through the same curved section even during round-trip flight.

[0065] In addition, the present invention has a configuration in which the radius of curvature (R) and the direction of curvature are included in the curve start information, so that when an autonomous flying drone enters a curved section, it flies along a trajectory corresponding to the shape of the curved section, thereby reducing the problem of difficulty in accurately following a curved section by only recognizing obstacles or walls ahead, and reducing the risk of collision in the curved section.

[0066] In addition, the present invention allows the use of an equidistant projection fisheye lens as the lens of the marker camera and has a configuration that calculates a reference pixel (P0) by reflecting the projection characteristics of the fisheye lens. Since it operates to perform altitude control based on the number of pixels between two lines (L1, L2) while capturing marker lines marked on the ceiling with a wide angle of view, it has the effect of stably capturing marker lines inside a narrow underground power tunnel and improving the reliability of altitude control.

[0067] In addition, the present invention has a configuration that determines lateral deviation or deviation in the direction of travel angle by using the intersection of the virtual center line (C2) and the center vertical line (C1) and the intersection angle (θ) when the virtual center line (C2) is calculated in a curved shape in the identification image due to the influence of a fisheye lens or flight attitude. Since the curve distortion in the image is not discarded as a simple error but is utilized as control information, it has the effect of more stably correcting the left and right positions and horizontal angles of the autonomous flight drone.

[0068] In addition, the present invention has a configuration that generates a path absence warning when two lines (L1, L2) cannot be identified in the identification image, and controls the autonomous flight drone to follow the previous flight path in reverse or change its direction of travel by 180 degrees to return to the docking station. Since this prevents the autonomous flight drone from continuing to fly unnecessarily in the event of a marker line recognition failure, it has the effect of preventing the loss, collision, or prolonged flight of the autonomous flight drone.

[0069] In addition, the present invention has a configuration in which the color, brightness, or saturation of two lines (L1, L2) are formed differently from each other, and the normal direction of travel is determined using the arrangement relationship of the two lines (L1, L2) in the identification image. Since this configuration enables the determination of the normal direction of travel even when the autonomous flight drone loses its direction of travel or heads in the opposite direction due to disturbances or control errors, it has the effect of improving the stability of long-distance autonomous flight inside an underground power tunnel.

[0070] In addition, the present invention has a configuration in which a location marker is placed between two lines (L1, L2) and the location identification ID and the distance traveled from the location marker are stored together as metadata of the surveillance video when the surveillance video is stored. Since this allows location information to be recorded even in surveillance videos where it is difficult to specify the shooting location using only repetitive cable and cable hanger structures, it has the effect of quickly and accurately identifying the location where abnormal signs are detected. Brief explanation of the drawing

[0071] FIG. 1 is a conceptual diagram of an autonomous flight drone system for monitoring underground power distribution lines according to the present invention. FIG. 2 is an overall configuration diagram of an autonomous flight drone system for monitoring underground power distribution lines according to the present invention. FIG. 3 is a conceptual diagram for calculating a reference pixel (P0) between two lines (L1, L2) projected onto an identification image of a marker camera when an autonomous flying drone is located at a reference distance (H) from the ceiling. Figure 4 is a diagram illustrating the concept of how the actual pixel (P1) between two lines (L1, L2) in the identification image changes according to the change in the distance between the autonomous flying drone and the ceiling. FIG. 5 is a diagram illustrating the process of calculating a virtual center point (Cp2) and a virtual center line (C2) using two lines (L1, L2) captured in an identification image, and correcting the lateral deviation or misalignment of the autonomous flight drone based on this. FIG. 6 is a diagram illustrating an example of controlling the curved flight of an autonomous drone using a curve marker in a curved section. FIG. 7 is a diagram illustrating the concept of calculating the actual pixel (P1) using the number of pixels between the points where the center horizontal line (C3) and two lines (L1, L2) intersect, respectively, in an embodiment where an equidistant projection fisheye lens is used as the lens of a marker camera. FIG. 8 is a diagram illustrating the process of correcting lateral deviation or deviation in the direction of travel of an autonomous flying drone using the curved shape of a virtual center line (C2) calculated based on two lines (L1, L2) captured in an identification image, in an embodiment where an equidistant projection fisheye lens is used as the lens of a marker camera. Specific details for implementing the invention

[0072] The present invention will be described in detail below so that the aforementioned objectives and features may be clearly understood, and accordingly, a person skilled in the art to which the present invention pertains will be able to easily implement the technical concept of the present invention. Furthermore, in describing the present invention, regarding known technologies related to the present invention that are already well known in the technical field, if it is determined that a detailed description of such known technology might unnecessarily obscure the essence of the present invention, such detailed description will be omitted.

[0073] Furthermore, while the terms used in this invention have been selected to be as widely used as possible, there are also terms arbitrarily chosen by the applicant in specific cases; since the meanings of such terms are described in detail in the relevant description of the invention, it should be noted that the invention should be understood based on the meaning of the terms rather than their mere names. The terms used in the description of the embodiments are used merely to explain specific embodiments and are not intended to limit the embodiments. Unless the context clearly indicates otherwise, singular expressions include plural expressions.

[0074] The embodiments may be modified in various forms and may have various additional embodiments, and specific embodiments are shown in the drawings and described in detail. However, this is not intended to limit the embodiments to specific forms and should be understood to include all modifications, equivalents, or substitutions that fall within the spirit and scope of the embodiments.

[0075] In the description of various embodiments, expressions such as “first,” “second,” “first,” or “second” may modify various components of the embodiments, but do not limit said components. For example, said expressions do not limit the order and / or importance of said components. Such expressions may be used to distinguish one component from another.

[0076] The present invention will be described below with reference to the attached drawings. First, with reference to FIGS. 1 to 5, a basic embodiment of an autonomous flight drone system for monitoring underground power distribution lines according to the present invention will be described. FIG. 1 is a schematic diagram illustrating the state in which an autonomous flight drone system for monitoring underground power distribution lines according to one embodiment of the present invention is operated inside an underground power conduit, and FIG. 2 is a schematic diagram illustrating the overall configuration of an autonomous flight drone system for monitoring underground power distribution lines according to one embodiment of the present invention. In addition, FIG. 3 is a diagram for explaining the concept of setting a reference pixel (P0) using a marker line (200) composed of two lines (L1, L2), FIG. 4 is a diagram illustrating an example of altitude control of an autonomous flight drone (100) according to a change in a measured pixel (P1), and FIG. 5 is a diagram for explaining the concept of calculating a virtual center point (Cp2), a virtual center line (C2), a left-right correction value (Lc), and a direction correction value (Dc) using two lines (L1, L2).

[0077] Referring to FIG. 1, the underground power conduit (10) may include a ceiling surface (11), a floor surface (12), a cable hanger (13), and an underground power distribution line or cable (14). The underground power conduit (10) is an underground structure in which an underground power distribution line is laid, and inside, cables such as power distribution lines, communication lines, and control lines, as well as cable hangers (13) for supporting them, junction boxes, ventilation equipment, drainage equipment, lighting equipment, or fire detection equipment may be arranged. In the present invention, an autonomous flight drone (100) can autonomously fly inside the underground power conduit (10) and capture surveillance images of the underground power conduit (10) and the underground power distribution line (14), and by analyzing the captured images, it is possible to monitor whether there are any abnormalities in the underground power conduit (10) and the underground power distribution line (14).

[0078] The autonomous flight drone system for monitoring underground power distribution lines according to the present invention may include an autonomous flight drone (100), one or more docking stations (300), a monitoring server (400), and a marker line (200). The autonomous flight drone (100) can fly along the internal space of the underground power conduit (10) and capture monitoring images of the underground power conduit (10) or the underground power distribution line (14). The docking station (300) is located within the underground power conduit (10) and, when the autonomous flight drone (100) lands, can download the image data captured by the autonomous flight drone (100), charge the battery of the autonomous flight drone (100), and transmit the image data to a remote location. The monitoring server (400) can receive and analyze the image data transmitted by the docking station (300) to diagnose whether there are any abnormalities in the underground power conduit (10) and the underground power distribution line (14).

[0079] A marker line (200) can be marked on the ceiling surface (11) of the underground power conduit (10). The marker line (200) may consist of two lines (L1, L2) having a color that contrasts with the color of the ceiling surface (11) of the underground power conduit (10) and a constant distance (D) between them. The two lines (L1, L2) can be marked on the ceiling surface (11) so as to extend from the inspection start point of the underground power conduit (10) to the inspection end point. Accordingly, the autonomous flying drone (100) can fly along the space below the two lines (L1, L2) while recognizing the marker line (200) as an image.

[0080] In this embodiment, the marker line (200) may be composed of two lines (L1, L2) having a constant distance (D) between them, without including a separate physical centerline. That is, the autonomous flight drone (100) can perform altitude control, left / right position control, and direction of travel control by calculating the number of pixels between the two lines (L1, L2), the virtual center point (Cp2) between the two lines (L1, L2), and the virtual centerline (C2) between the two lines (L1, L2) within the identification image. Therefore, even without forming a separate physical center mark on the ceiling surface (11), the flight standard of the autonomous flight drone (100) can be set using an image processing method.

[0081] Referring to FIG. 2, the autonomous flight drone (100) may include a flight control unit (110), a surveillance camera (120), a marker camera (130), a marker gimbal (131), a control calculation unit (140), a storage unit (150), and a communication unit (160). According to an embodiment, the autonomous flight drone (100) may further include a sensor unit (170) comprising an inertial sensor, an accelerometer, a gyroscope, a barometric pressure sensor, an obstacle detection sensor, or a combination thereof.

[0082] The flight control unit (110) can perform takeoff, landing, forward flight, altitude control, left-right horizontal movement control, and horizontal angle (yaw) control of the autonomous flight drone (100). Specifically, the flight control unit (110) can control the autonomous flight drone (100) to take off from the docking station (300) at predetermined time intervals, fly autonomously along the space below the two lines (L1, L2) from the inspection start point to the inspection end point of the underground power conduit (10), and then return to the docking station (300).

[0083] The surveillance camera (120) can capture surveillance images of the underground power conduit (10) or underground power distribution line (14) while the autonomous flying drone (100) is flying. The surveillance images captured by the surveillance camera (120) can be stored in the storage unit (150). The surveillance camera (120) may be a general optical camera, and depending on the embodiment, it may be composed of a thermal imaging camera, a low-light camera, a high-resolution camera, or a combination thereof. The surveillance images captured by the surveillance camera (120) can be transmitted to a surveillance server (400) via a docking station (300) and used to determine whether there is an abnormality in the underground power conduit (10) or underground power distribution line (14).

[0084] The marker camera (130) can capture an identification image of a marker line (200) marked on the ceiling surface (11) of an underground power conduit (10) while the autonomous flying drone (100) is flying. The marker camera (130) can transmit the captured identification image to the control calculation unit (140) in real time. The identification image is an image distinct from the surveillance image captured by the surveillance camera (120), and may be an image for controlling the altitude, left and right position, and direction of travel of the autonomous flying drone (100).

[0085] The marker gimbal (131) can control the attitude of the marker camera (130). The marker gimbal (131) can control the attitude of the marker camera (130) so that the lens optical axis of the marker camera (130) is oriented vertically toward the ceiling surface (11) of the underground power conduit (10). Accordingly, even when the body of the autonomous flying drone (100) undergoes changes in roll, pitch, or yaw during flight, the marker camera (130) can stably capture the marker line (200) marked on the ceiling surface (11). In particular, if the lens optical axis of the marker camera (130) is maintained so that it faces the ceiling surface (11), the number of pixels between two lines (L1, L2), the virtual center point (Cp2), and the virtual center line (C2) can be calculated more stably in the identification image.

[0086] A reference pixel (P0) may be stored in the storage unit (150). The reference pixel (P0) may be the number of pixels between two lines (L1, L2) captured in the identification image when the marker camera (130) captures the identification image at a certain distance (H) from the ceiling surface (11) of the underground power conduit (10). That is, the reference pixel (P0) may be defined as the number of reference pixels between two lines (L1, L2) that must appear in the identification image when the autonomous flying drone (100) maintains a target distance (H) from the ceiling surface (11). The reference pixel (P0) may be calculated using the distance between lines (D), the distance (H), and the specifications of the marker camera (130), and may be stored in the storage unit (150) in advance.

[0087] The communication unit (160) can perform data communication by connecting to the docking station (300) via a short-range communication network. For example, when an autonomous flying drone (100) lands at the docking station (300), the communication unit (160) can transmit surveillance video stored in the storage unit (150) to the docking station (300). The docking station (300) can transmit video data to the monitoring server (400) via the communication network (900), and the monitoring server (400) can analyze the received video data to diagnose whether there is an abnormality in the underground power conduit (10) and the underground power distribution line (14).

[0088] The control calculation unit (140) can generate an altitude correction value (Hc), a left / right correction value (Lc), and a direction correction value (Dc) by analyzing the identification image received from the marker camera (130). The control calculation unit (140) can transmit the generated altitude correction value (Hc), left / right correction value (Lc), and direction correction value (Dc) to the flight control unit (110). The flight control unit (110) can perform altitude control so that the autonomous flight drone (100) flies forward while maintaining a distance (H) from the ceiling surface (11) using the altitude correction value (Hc), perform left-right horizontal movement control so that the center of the autonomous flight drone (100) does not go beyond the vertical downward projection area between two lines (L1, L2) using the left-right correction value (Lc), and perform horizontal angle control so that the direction of travel of the autonomous flight drone (100) is maintained parallel to the length direction of the marker line (200) using the direction correction value (Dc).

[0089] The basic concept of calculating the altitude correction value (Hc) is explained with reference to FIG. 3 and FIG. 4. As shown in FIG. 3, two lines (L1, L2) can be displayed on the ceiling surface (11) with a constant distance (D) between them. When the marker camera (130) captures the marker line (200) while the autonomous flying drone (100) is positioned at a reference distance (H) from the ceiling surface (11), the two lines (L1, L2) appear in the identification image at a constant pixel interval. At this time, the number of pixels between the two lines (L1, L2) captured in the identification image can be defined as the reference pixel (P0).

[0090] Referring to FIG. 4, when the autonomous flying drone (100) maintains a reference distance (H) from the ceiling surface (11), the actual pixel (P1) between two lines (L1, L2) captured in the identification image may correspond to the reference pixel (P0). However, when the autonomous flying drone (100a) gets too close to the ceiling surface (11), the actual pixel (P1a) between the two lines (L1, L2) in the identification image may appear larger than the reference pixel (P0). Conversely, when the autonomous flying drone (100b) gets too far from the ceiling surface (11), the actual pixel (P1b) between the two lines (L1, L2) in the identification image may appear smaller than the reference pixel (P0). The control calculation unit (140) can generate an altitude correction value (Hc) based on the difference between the actual pixel (P1) and the reference pixel (P0).

[0091] Accordingly, in the present invention, a change in the distance between the ceiling surface (11) and the autonomous flight drone (100) is represented by a change in the number of pixels between two lines (L1, L2) in the identification image. The control calculation unit (140) generates an altitude correction value (Hc) using this change in the number of pixels, and the flight control unit (110) performs ascent or descent control using the altitude correction value (Hc), thereby enabling the autonomous flight drone (100) to maintain a constant distance (H) from the ceiling surface (11).

[0092] Next, with reference to FIG. 5, the basic calculation concept of the left-right correction value (Lc) and the direction correction value (Dc) will be explained. As illustrated in FIG. 5(a), two lines (L1, L2) may be displayed in the identification image captured by the marker camera (130). The control calculation unit (140) can calculate the respective midpoints (Lm1, Lm2) located at the point where each of the two lines (L1, L2) captured in the identification image is bisected. Here, the midpoints (Lm1, Lm2) can be calculated based on each line (L1, L2) appearing in the identification image, and can be calculated as the position that bisects the line not only when the line is captured in a straight line form but also when it is captured in a curved form.

[0093] The control calculation unit (140) can set a virtual line segment connecting two midpoints (Lm1, Lm2) and calculate the midpoint of the virtual line segment as a virtual center point (Cp2). The virtual center point (Cp2) may be a point representing the central position between two lines (L1, L2) in the identification image. Additionally, the control calculation unit (140) can calculate a virtual center line (C2) in the longitudinal direction along the center between two lines (L1, L2) captured in the identification image. The virtual center line (C2) may not be a line physically marked on the ceiling surface (11), but a virtual reference line calculated by analyzing the two lines (L1, L2) within the identification image.

[0094] The center point (Cp1) located at the exact center of the identification image may represent the center of the captured image of the marker camera (130), that is, the center of the identification image itself. When the autonomous flight drone (100) is located below the center between two lines (L1, L2), the center point (Cp1) of the identification image may coincide with the virtual center point (Cp2) or be located within a predetermined allowable range. Conversely, when the autonomous flight drone (100) deviates in the left or right direction, a relative position difference may occur between the center point (Cp1) of the identification image and the virtual center point (Cp2). The control calculation unit (140) can generate a left / right correction value (Lc) based on the relative position between the center point (Cp1) and the virtual center point (Cp2).

[0095] As illustrated in FIG. 5(b), the control calculation unit (140) can determine how far and in which direction the virtual center point (Cp2) is separated from the center point (Cp1) of the identification image. The relative position of the virtual center point (Cp2) can indicate the degree to which the autonomous flight drone (100) has deviated in the left and right directions from the center between the two lines (L1, L2). The flight control unit (110) can perform left and right horizontal movement control using the left and right correction value (Lc) so that the autonomous flight drone (100) is positioned in the space below the center between the two lines (L1, L2).

[0096] Referring to FIG. 5(c), the control calculation unit (140) can set a center vertical line (C1) connecting the midpoint of the upper edge and the midpoint of the lower edge of the identification image. The center vertical line (C1) may be a reference line indicating the current direction of travel of the autonomous flight drone (100) in the identification image or the vertical reference direction of the image. Additionally, the control calculation unit (140) can set a virtual center line (C2) calculated along the center between two lines (L1, L2). If the direction of travel of the autonomous flight drone (100) is parallel to the length direction of the marker line (200), the center vertical line (C1) and the virtual center line (C2) may coincide or appear nearly parallel. Conversely, if the direction of travel of the autonomous flight drone (100) is inclined with respect to the length direction of the marker line (200), an angle difference may occur between the center vertical line (C1) and the virtual center line (C2).

[0097] The control calculation unit (140) can generate a direction correction value (Dc) based on the angle between the center vertical line (C1) and the virtual center line (C2). The direction correction value (Dc) can indicate how much the direction of travel of the autonomous flight drone (100) is tilted in which direction with respect to the length direction of the marker line (200). The flight control unit (110) can control the horizontal angle (yaw) of the autonomous flight drone (100) using the direction correction value (Dc), and accordingly, the direction of travel of the autonomous flight drone (100) can be kept parallel to the length direction of the marker line (200).

[0098] According to this configuration, the autonomous flight drone system of the present invention can calculate the number of pixels between the two lines (L1, L2), a virtual center point (Cp2), and a virtual center line (C2) in the identification image, even if only a marker line (200) consisting of two lines (L1, L2) is displayed on the ceiling surface (11) of the underground power conduit (10). Therefore, the autonomous flight drone (100) can stably fly autonomously inside the underground power conduit (10) without relying on a separate physical center line or a high-precision distance sensor, while maintaining a constant distance (H) from the ceiling surface (11), not deviating from the vertical downward projection area between the two lines (L1, L2), and maintaining a direction of travel parallel to the length direction of the marker line (200).

[0099] Next, an operational embodiment of the present invention is described in which an autonomous flying drone (100) takes off from a docking station (300), reaches a starting point for inspection, flies to a finishing point for inspection, and then returns to the docking station (300).

[0100] In this embodiment, the storage unit (150) may store path information for reaching a starting point for moving from the docking station (300) to the inspection starting point of the underground power conduit (10). The path information for reaching a starting point may include, for example, information for ascending to a certain height after taking off from the docking station (300), information for rotating by a predetermined horizontal angle, information for advancing by a predetermined distance, or a combination thereof. When the autonomous flight drone (100) takes off from the docking station (300), the flight control unit (110) can control the autonomous flight drone (100) to move near the inspection starting point using the path information for reaching a starting point.

[0101] A start mark (not shown) may be displayed at the inspection start point. The start mark may be placed at or around the start position of a marker line (200) consisting of two lines (L1, L2), and may include a color, brightness, saturation, shape, character, code, pattern, or a combination thereof that can be identified by a marker camera (130). According to an embodiment, the start mark may be placed between the two lines (L1, L2) or may be placed in a form that indicates the start positions of the two lines (L1, L2) together.

[0102] When a start mark is included in the identification image captured by the marker camera (130), the control calculation unit (140) can identify the start mark and determine that the autonomous flight drone (100) has reached the inspection start point. When the control calculation unit (140) transmits the start mark identification information to the flight control unit (110), the flight control unit (110) can control the autonomous flight drone (100) to hover temporarily near the inspection start point.

[0103] While the autonomous flight drone (100) hovers at the inspection starting point, the control calculation unit (140) can search for two lines (L1, L2) in the identification image of the marker camera (130). At this time, the flight control unit (110) can control the autonomous flight drone (100) to perform repetitive left-right horizontal movement, horizontal angle (yaw) change, and altitude change. Accordingly, the two lines (L1, L2) can be stably included within the shooting range of the marker camera (130).

[0104] When two lines (L1, L2) are identified in the identification image, the control calculation unit (140) can determine whether the autonomous flight drone (100) is in a position corresponding to a reference separation distance (H) by comparing the actual pixel (P1) between the two lines (L1, L2) with a reference pixel (P0). Additionally, the control calculation unit (140) can calculate a virtual center point (Cp2) and a virtual center line (C2) based on the two lines (L1, L2) captured in the identification image, and determine the left and right positions and direction of travel of the autonomous flight drone (100) using the relationship with the center point (Cp1) and the center vertical line (C1) of the identification image.

[0105] The flight control unit (110) can repeatedly correct the altitude, left and right position, and horizontal angle of the autonomous flight drone (100) based on the judgment result of the control calculation unit (140). For example, the flight control unit (110) can perform ascent or descent control so that the actual pixel (P1) corresponds to the reference pixel (P0), perform left and right horizontal movement control so that the virtual center point (Cp2) approaches the center point (Cp1) of the identification image, and perform horizontal angle (yaw) control so that the difference in the intersection angle or slope between the virtual center line (C2) and the center vertical line (C1) approaches zero. Once such alignment is completed, the autonomous flight drone (100) can begin autonomous flight along the space below the two lines (L1, L2) from the inspection start point toward the inspection end point.

[0106] A termination mark (not shown) may be displayed at the inspection end point. The termination mark may be placed at or around the end position of a marker line (200) composed of two lines (L1, L2), and may include a color, brightness, saturation, shape, character, code, pattern, or a combination thereof that is distinguishable from the start mark. According to an embodiment, the termination mark may be placed between the two lines (L1, L2), or may be placed in a form that indicates the end positions of the two lines (L1, L2) together.

[0107] When the identification image captured by the marker camera (130) includes a termination mark, the control calculation unit (140) can identify the termination mark and determine that the autonomous flight drone (100) has reached the inspection termination point. When the control calculation unit (140) transmits the termination mark identification information to the flight control unit (110), the flight control unit (110) can control the autonomous flight drone (100) to temporarily hover near the inspection termination point. Subsequently, the flight control unit (110) can control the horizontal angle (yaw) of the autonomous flight drone (100) to rotate the direction of travel of the autonomous flight drone (100) by 180 degrees.

[0108] After the autonomous flight drone (100) has rotated 180 degrees, the control calculation unit (140) can recalculate two lines (L1, L2), a virtual center point (Cp2), and a virtual center line (C2) in the identification image. The flight control unit (110) can control the autonomous flight drone (100) by performing repetitive left-right horizontal movement and horizontal angle change so that the drone is positioned in the vertical downward projection area between the two lines (L1, L2) and aligned parallel to the opposite direction of travel from the inspection end point toward the inspection start point.

[0109] Once alignment is complete, the flight control unit (110) can control the autonomous flight drone (100) to fly back in the direction of the inspection start point along the space below the two lines (L1, L2). Even during the return flight, the control calculation unit (140) can generate an altitude correction value (Hc), a left / right correction value (Lc), and a direction correction value (Dc) using the actual pixel (P1), a virtual center point (Cp2), and a virtual center line (C2) between the two lines (L1, L2), and the flight control unit (110) can control the altitude, left / right position, and direction of travel of the autonomous flight drone (100) using these correction values.

[0110] When the autonomous flight drone (100) flies in the direction of the inspection start point and identifies the start mark again, the control calculation unit (140) can determine that the autonomous flight drone (100) has returned to the inspection start point. In this case, the flight control unit (110) can control the autonomous flight drone (100) to reach the docking station (300) using the return path information from the inspection start point to the docking station (300) stored in the storage unit (150). The return path information may be configured in the reverse order of the path information to reach the start point, or it may be configured with flight command information separately set to return from the inspection start point to the docking station (300).

[0111] According to this configuration, the autonomous flight drone (100) moves from the docking station (300) to the inspection start point using pre-stored path information, and after identifying the start mark at the inspection start point, it can be aligned using two lines (L1, L2) to correspond to the reference separation distance (H), the central position between the two lines (L1, L2), and the longitudinal direction of the marker line (200). Additionally, at the inspection end point, after identifying the end mark, it can rotate 180 degrees to align again in the space below between the two lines (L1, L2) and fly back toward the inspection start point, and after re-identifying the start mark, it can return to the docking station (300) using the stored return path information. Therefore, even if the docking station (300) is not located directly below the marker line (200), the autonomous flight drone (100) can stably enter the inspection section and return to the docking station (300) after traveling back and forth through the inspection section.

[0112] Next, we examine an embodiment of calculating a reference pixel (P0) and controlling altitude in the present invention. FIG. 3 is a diagram illustrating the concept of calculating a reference pixel (P0) in an identification image when an autonomous flying drone (100) is positioned at a reference distance (H) from the ceiling surface (11) of an underground power conduit (10), and a marker camera (130) captures a marker line (200) consisting of two lines (L1, L2). FIG. 4 is a diagram illustrating an example in which the actual pixels (P1, P1a, P1b) between the two lines (L1, L2) in the identification image change according to the change in the distance from the ceiling surface (11) of the autonomous flying drone (100, 100a, 100b), and altitude control of the autonomous flying drone (100) is performed based on this.

[0113] Referring to FIG. 3, a marker line (200) consisting of two lines (L1, L2) having a constant distance (D) between them can be displayed on the ceiling surface (11) of an underground power conduit (10). When an autonomous flying drone (100) is positioned at a predetermined distance (H) from the ceiling surface (11) and a marker camera (130) captures the marker line (200), the identification image may appear as an image in which the two lines (L1, L2) have a constant distance from each other. At this time, the number of pixels between the two lines (L1, L2) captured in the identification image may be defined as a reference pixel (P0).

[0114] The reference pixel (P0) may be the number of reference pixels that must appear between two lines (L1, L2) in the identification image when the autonomous flight drone (100) maintains a target separation distance (H) from the ceiling surface (11). Therefore, the reference pixel (P0) may be stored in advance in the storage unit (150) as a reference value for altitude control of the autonomous flight drone (100). The control calculation unit (140) can determine whether the autonomous flight drone (100) maintains a reference separation distance (H) with respect to the ceiling surface (11) by analyzing the identification image received from the marker camera (130) during flight to calculate the actual pixel (P1) and comparing it with the reference pixel (P0) stored in the storage unit (150).

[0115] In this embodiment, the reference pixel (P0) can be calculated using the line distance (D), the separation distance (H), the focal length (f) of the marker camera (130), the horizontal length (W) of the image sensor of the marker camera (130), and the number of horizontal pixels (Pw) of the image sensor. For example, when using a standard center projection lens, the reference pixel (P0) can be calculated as shown in the following equation.

[0116]

[0117] Here, f is the focal length of the marker camera (130), Pw is the number of horizontal pixels of the image sensor, D is the actual distance between two lines (L1, L2) marked on the ceiling surface (11), W is the horizontal length of the image sensor, and H is the reference separation distance. According to the above equation, as the distance between lines (D) increases, the reference pixel (P0) between two lines (L1, L2) in the identification image becomes larger, and as the separation distance (H) increases, the reference pixel (P0) can become smaller. This corresponds to an image characteristic where the distance between two lines (L1, L2) in the identification image appears wider as the autonomous flying drone (100) approaches the ceiling surface (11), and the distance between two lines (L1, L2) appears narrower as it moves away from the ceiling surface (11).

[0118] Referring to FIG. 4, when the autonomous flight drone (100) maintains a reference distance (H) from the ceiling surface (11), the actual pixel (P1) between two lines (L1, L2) captured in the identification image may be equal to the reference pixel (P0) or within a predetermined allowable range. In this case, the flight control unit (110) can control the autonomous flight drone (100) to maintain its current altitude.

[0119] On the other hand, if the autonomous flight drone (100a) gets too close to the ceiling surface (11), the gap between two lines (L1, L2) in the identification image captured by the marker camera (130) may be enlarged, and the actual pixel (P1a) may appear larger than the reference pixel (P0). In this case, the control calculation unit (140) can confirm that the value obtained by subtracting the actual pixel (P1a) from the reference pixel (P0) is a negative value, and based on this, can determine that the autonomous flight drone (100a) is in a state of being close to the ceiling surface (11). The flight control unit (110) can perform descent control to move the autonomous flight drone (100a) away from the ceiling surface (11) using the altitude correction value (Hc) received from the control calculation unit (140).

[0120] Conversely, if the autonomous flight drone (100b) moves too far away from the ceiling surface (11), the distance between the two lines (L1, L2) in the identification image is reduced, and the actual pixel (P1b) may appear smaller than the reference pixel (P0). In this case, the control calculation unit (140) can confirm that the value obtained by subtracting the actual pixel (P1b) from the reference pixel (P0) is a positive value, and based on this, can determine that the autonomous flight drone (100b) is in a state of moving away from the ceiling surface (11). The flight control unit (110) can perform ascent control to bring the autonomous flight drone (100b) closer to the ceiling surface (11) using an altitude correction value (Hc).

[0121] That is, in this embodiment, the altitude correction value (Hc) may be a value obtained by subtracting the actual pixel (P1) from the reference pixel (P0) (P0-P1), or a value proportional to the subtracted value (P0-P1). The control calculation unit (140) may repeatedly calculate the actual pixel (P1) between two lines (L1, L2) in the identification image captured in real time by the marker camera (130), and generate an altitude correction value (Hc) by comparing it with the reference pixel (P0). The altitude correction value (Hc) is transmitted to the flight control unit (110), and the flight control unit (110) may perform ascent control or descent control according to the sign and magnitude of the altitude correction value (Hc).

[0122] The flight control unit (110) can maintain the current altitude of the autonomous flight drone (100) when the altitude correction value (Hc) is within a predetermined allowable range. Here, the allowable range can be pre-set by considering the resolution of the marker camera (130), the height of the underground power conduit (10), the flight stability of the autonomous flight drone (100), and the safety distance from the ceiling surface (11). For example, if the altitude correction value (Hc) is very small and the actual change in the distance of the autonomous flight drone (100) is within an allowable range, unnecessary ascent or descent control can be avoided.

[0123] Meanwhile, if the altitude correction value (Hc) is a negative value outside the allowable range, this may indicate that the actual pixel (P1) is larger than the reference pixel (P0) and the autonomous flying drone (100) is closer to the ceiling surface (11), so the flight control unit (110) can perform descent control to move the autonomous flying drone (100) away from the ceiling surface (11). Conversely, if the altitude correction value (Hc) is a positive value outside the allowable range, this may indicate that the actual pixel (P1) is smaller than the reference pixel (P0) and the autonomous flying drone (100) is further away from the ceiling surface (11), so the flight control unit (110) can perform ascent control to move the autonomous flying drone (100) closer to the ceiling surface (11).

[0124] Additionally, the flight control unit (110) can increase the amount of control for ascent or descent control as the absolute value of the altitude correction value (Hc) increases. For example, if the difference between the actual pixel (P1) and the reference pixel (P0) is large, it can be seen that the current altitude of the autonomous flight drone (100) deviates significantly from the target separation distance (H), so the flight control unit (110) can apply a relatively large amount of ascent or descent control. Conversely, if the difference between the actual pixel (P1) and the reference pixel (P0) is small, a relatively small amount of control can be applied to smoothly correct the altitude of the autonomous flight drone (100).

[0125] According to this configuration, the autonomous flying drone (100) can determine the change in distance from the ceiling surface (11) by using the change in the number of pixels in the image between two lines (L1, L2) marked on the ceiling surface (11) without relying solely on a separate high-precision distance sensor. Additionally, since an altitude correction value (Hc) can be calculated based on the difference between a reference pixel (P0) and a measured pixel (P1), and the sign and magnitude can be reflected in the ascent or descent control, the autonomous flying drone (100) can fly while stably maintaining the reference distance (H) even in a narrow environment such as inside an underground power conduit (10) where there is a risk of collision with the ceiling surface (11).

[0126] Next, we examine an embodiment in which a left-right correction value (Lc) is calculated using two lines (L1, L2) captured in an identification image in the present invention, and the left-right position of an autonomous flight drone (100) is controlled. FIG. 5 is a diagram for explaining the concept of correcting the left-right position of an autonomous flight drone (100) using two lines (L1, L2), a center point (Cp1), a virtual center point (Cp2), a virtual center line (C2), and a deviation distance (d1) in an identification image.

[0127] Referring to FIG. 5(a), when a marker camera (130) captures a marker line (200) marked on the ceiling surface (11) of an underground power conduit (10), two lines (L1, L2) with a certain distance (D) between them may appear in the identification image. At this time, the center point (Cp1) located at the center of the identification image may represent the shooting center of the marker camera (130) or the current position reference point of the autonomous flight drone (100). When the autonomous flight drone (100) is located exactly below the center between the two lines (L1, L2), the center point (Cp1) of the identification image may coincide with the center position between the two lines (L1, L2) or be located within a predetermined allowable range.

[0128] The control calculation unit (140) can calculate a virtual center point (Cp2) by analyzing two lines (L1, L2) captured in the identification image. Specifically, the control calculation unit (140) can calculate a center point (Lm1, Lm2) located at a point that bisects each of the two lines (L1, L2) captured in the identification image. Here, the center point (Lm1) may be the center point located at a point that bisects one of the lines (L1) captured in the identification image, and the center point (Lm2) may be the center point located at a point that bisects the other line (L2).

[0129] The control calculation unit (140) can set a virtual line segment connecting the center point (Lm1) and the center point (Lm2) to each other, and calculate the center of the virtual line segment as a virtual center point (Cp2). The virtual center point (Cp2) may be a point representing the central position between two lines (L1, L2) in the identification image. Therefore, the relative position between the center point (Cp1) and the virtual center point (Cp2) can be used as information indicating how far the autonomous flying drone (100) is deviated in the left and right directions relative to the center between the two lines (L1, L2).

[0130] Referring to FIG. 5(b), the direction of the central vertical line (C1) in the identification image can be set as the y-axis, and the direction perpendicular to the y-axis can be set as the x-axis. In this case, the center point (Cp1) can be set as the coordinate origin (0,0), and the relative position of the virtual center point (Cp2) in the x-axis direction can be expressed as an x-coordinate value (P2) based on the number of pixels. Here, the x-coordinate value (P2) can indicate how far the virtual center point (Cp2) is deviated to the left or right relative to the center point (Cp1) of the identification image.

[0131] When the autonomous flying drone (100) is located at the center below the two lines (L1, L2), the virtual center point (Cp2) appears to coincide with or be close to the center point (Cp1), so the x-coordinate value (P2) can be 0 or close to 0. Conversely, when the autonomous flying drone (100) deviates to the left or right, the virtual center point (Cp2) in the identification image may appear to have moved in the opposite direction relative to the center point (Cp1), and accordingly, the absolute value of the x-coordinate value (P2) may increase.

[0132] In this embodiment, the left-right correction value (Lc) may be the deviation distance (d1) from the center between two lines (L1, L2) of the autonomous flying drone (100), or a value proportional to the deviation distance (d1). The deviation distance (d1) can be calculated as shown in the following equation using the x-coordinate value (P2) calculated from the identification image, the actual distance between the two lines (L1, L2) (D), and the actual pixel (P1) between the two lines (L1, L2) in the identification image.

[0133]

[0134] Here, D is the actual distance between two lines (L1, L2) marked on the ceiling surface (11), P1 is the actual pixel between two lines (L1, L2) captured in the identification image, and P2 may be the number of pixels relative to the x-axis direction of the virtual center point (Cp2) when the center point (Cp1) in the identification image is set as the coordinate origin.

[0135] The above formula is intended to convert the relative position of a virtual center point (Cp2) measured in pixel units in an identification image into a deviation distance (d1) in actual distance units. Since the actual pixel (P1) between two lines (L1, L2) in the identification image corresponds to the actual distance between lines (D), the actual distance corresponding to one pixel can be converted to D / P1. Therefore, by multiplying the number of relative pixels (P2) in the x-axis direction of the virtual center point (Cp2) by D / P1, the actual distance that the autonomous flying drone (100) has deviated from in the left and right directions from the center between two lines (L1, L2) or a corresponding correction value can be calculated.

[0136] The control calculation unit (140) can generate a left-right correction value (Lc) based on the calculated deviation distance (d1) or a value proportional thereto. The left-right correction value (Lc) may be a value indicating how far and in which direction the autonomous flying drone (100) has deviated from the center between two lines (L1, L2). For example, the sign of the left-right correction value (Lc) may indicate the direction of deviation of the autonomous flying drone (100), and the absolute value of the left-right correction value (Lc) may indicate the degree of deviation.

[0137] The flight control unit (110) can receive a left-right correction value (Lc) from the control calculation unit (140) and perform left-right horizontal movement control of the autonomous flight drone (100). Specifically, when the left-right correction value (Lc) is within a predetermined allowable range, it can be determined that the autonomous flight drone (100) is stably positioned within the vertical downward projection area between two lines (L1, L2), so the flight control unit (110) can maintain the current left-right position of the autonomous flight drone (100).

[0138] Conversely, if the left-right correction value (Lc) deviates from a predetermined allowable range, it can be determined that the autonomous flight drone (100) has deviated in the left-right direction from the center between the two lines (L1, L2). In this case, the flight control unit (110) can perform left-right horizontal movement control for the autonomous flight drone (100) so that the x-coordinate value (P2) or the deviation distance (d1) approaches 0. That is, the flight control unit (110) can move the autonomous flight drone (100) to the left or right so that the center point (Cp1) of the identification image and the virtual center point (Cp2) coincide with each other or fall within a predetermined allowable range.

[0139] Additionally, the flight control unit (110) can increase the amount of control for horizontal movement control in the left and right directions as the absolute value of the left and right correction value (Lc) increases. For example, if the difference between the center point (Cp1) and the virtual center point (Cp2) is large, the autonomous flight drone (100) can be seen as being significantly deviated from the center between the two lines (L1, L2), so the flight control unit (110) can apply a relatively large amount of left and right movement control. Conversely, if the difference between the center point (Cp1) and the virtual center point (Cp2) is small, a relatively small amount of control can be applied to smoothly correct the left and right position of the autonomous flight drone (100).

[0140] According to this configuration, the present invention can determine the left and right positions of an autonomous flight drone (100) using only two lines (L1, L2) marked on the ceiling surface (11). In particular, since the relative position of a virtual center point (Cp2) calculated between the center point (Cp1) of the identification image and the two lines (L1, L2) is used, the autonomous flight drone (100) can be controlled to fly along the central lower side between the two lines (L1, L2) even without marking a separate physical center line on the ceiling surface (11).

[0141] In addition, in this embodiment, the positional difference in pixel units within the identification image can be converted into an actual distance or a corresponding control value using the distance between lines (D) and the actual pixel (P1). Therefore, even when the altitude of the autonomous flight drone (100) changes and the pixel spacing between two lines (L1, L2) within the identification image changes, the degree of left and right deviation can be calculated relatively stably. Accordingly, the autonomous flight drone (100) can fly forward stably along the marker line (200) while reducing the risk of collision with the cable hanger (13), underground power line (14), wall or ceiling structure in the narrow internal space of the underground power conduit (10).

[0142] Next, we examine an embodiment in which a direction correction value (Dc) is calculated using two lines (L1, L2) captured in an identification image in the present invention, and the direction of travel of an autonomous flight drone (100) is controlled. FIG. 5(c) is a diagram for explaining the concept of calculating an intersection angle (θ) using the relationship between the center vertical line (C1) of the identification image and a virtual center line (C2) calculated between two lines (L1, L2), and correcting the horizontal angle (yaw) of the autonomous flight drone (100) based thereon.

[0143] Referring to FIG. 5(c), when the marker camera (130) captures the marker line (200) marked on the ceiling surface (11) of the underground power conduit (10), two lines (L1, L2) may appear in the identification image. The control calculation unit (140) can analyze the two lines (L1, L2) captured in the identification image and calculate a virtual center line (C2) in the longitudinal direction along the center between the two lines (L1, L2). The virtual center line (C2) may not be a physical line actually marked on the ceiling surface (11), but may be a reference line in image processing calculated by connecting the center position between the two lines (L1, L2) within the identification image.

[0144] Additionally, the control calculation unit (140) can set a center vertical line (C1) connecting the center point of the upper edge and the center point of the lower edge of the identification image. The center vertical line (C1) serves as a vertical reference line of the identification image itself and can correspond to the current direction of travel of the autonomous flight drone (100) based on the shooting center of the marker camera (130). That is, when the autonomous flight drone (100) flies forward normally parallel to the length direction of the marker line (200), the center vertical line (C1) and the virtual center line (C2) in the identification image may coincide with each other or at least appear parallel within a predetermined allowable range.

[0145] Conversely, if the direction of travel of the autonomous flight drone (100) is tilted with respect to the length direction of the marker line (200), an angle difference may occur between the center vertical line (C1) and the virtual center line (C2) in the identification image. For example, if the nose of the autonomous flight drone (100) moves forward while tilted to the right or left with respect to the length direction of the marker line (200), the virtual center line (C2), calculated along the center between the two lines (L1, L2) in the identification image, may appear tilted clockwise or counterclockwise with respect to the center vertical line (C1).

[0146] The control calculation unit (140) can calculate the intersection angle (θ) formed by the virtual center line (C2) based on the center vertical line (C1). At this time, the direction correction value (Dc) may be the intersection angle (θ) or a value proportional to the intersection angle (θ). The direction correction value (Dc) can be used as a control value indicating how far the autonomous flight drone (100) is deviated in which direction from the length direction of the marker line (200).

[0147] In this embodiment, the direction correction value (Dc) may be set to have a positive value when the virtual centerline (C2) is tilted clockwise relative to the center vertical line (C1), and a negative value when it is tilted counterclockwise. However, this is merely one embodiment, and the positive and negative directions may be defined in reverse depending on the control coordinate system settings of the control calculation unit (140) and the flight control unit (110). Importantly, the sign of the direction correction value (Dc) indicates the direction of correction for the autonomous flight drone (100), and the magnitude of the direction correction value (Dc) is set to indicate the degree of deviation from the direction of travel.

[0148] In order to calculate the intersection angle (θ), the control calculation unit (140) may set the intersection point of the center vertical line (C1) and the virtual center line (C2) as the coordinate origin (0,0). Then, any point other than the intersection point among the virtual center lines (C2) may be selected, and the relative coordinates of that point may be defined as x and y. In this case, the intersection angle (θ) can be calculated as shown in the following equation.

[0149]

[0150] Here, x is a relative coordinate indicating the degree to which an arbitrary point on the virtual centerline (C2) is separated from the center vertical line (C1) in the left-right direction, and y is a relative coordinate indicating the degree to which the arbitrary point is separated from the intersection point in the vertical direction of the identification image. Accordingly, x / y can correspond to the slope of the virtual centerline (C2) with respect to the center vertical line (C1), and the control calculation unit (140) can calculate the intersection angle (θ) by applying this value to an inverse tangent function.

[0151] Meanwhile, even if the center vertical line (C1) and the virtual center line (C2) do not intersect each other as actual line segments within the identification image, the control calculation unit (140) can calculate the intersection angle (θ) by extending the center vertical line (C1) and the virtual center line (C2) into virtual straight lines having directionality. That is, in this embodiment, the intersection angle (θ) is not necessarily calculated only at the point where the actual displayed line segments within the identification image physically intersect, but can be calculated as a value representing the difference in direction between the center vertical line (C1) and the virtual center line (C2) in image processing.

[0152] The flight control unit (110) can receive a direction correction value (Dc) from the control calculation unit (140) and perform horizontal angle (yaw) control of the autonomous flight drone (100). When the direction correction value (Dc) is within a predetermined allowable range, the flight control unit (110) can maintain the current yaw of the autonomous flight drone (100) because the direction of travel of the autonomous flight drone (100) can be seen as substantially parallel to the length direction of the marker line (200).

[0153] Conversely, if the direction correction value (Dc) deviates from a predetermined allowable range, the direction of travel of the autonomous flight drone (100) may be determined to be misaligned with respect to the length direction of the marker line (200). In this case, the flight control unit (110) can perform horizontal angle (yaw) control for the autonomous flight drone (100) so that the intersection angle (θ) approaches 0. That is, the flight control unit (110) can rotate the nose direction of the autonomous flight drone (100) to the left or right so that the center vertical line (C1) and the virtual center line (C2) coincide with each other or become close to parallel.

[0154] Additionally, the flight control unit (110) can increase the amount of control for horizontal angle (yaw) control as the absolute value of the direction correction value (Dc) increases. For example, when the intersection angle (θ) between the center vertical line (C1) and the virtual center line (C2) is large, the flight control unit (110) can apply a relatively large amount of yaw control because the direction of travel of the autonomous flight drone (100) can be seen as being significantly deviated from the length direction of the marker line (200). Conversely, when the intersection angle (θ) is small, a relatively small amount of yaw control can be applied to smoothly correct the direction of travel.

[0155] According to this configuration, the autonomous flying drone (100) can determine whether its direction of travel is parallel to the length direction of the marker line (200) by using only two lines (L1, L2) marked on the ceiling surface (11) of the underground power conduit (10). In particular, even without additionally marking a separate direction of travel or a physical center line on the ceiling surface (11), a direction correction value (Dc) can be generated by using the angle relationship between the virtual center line (C2) and the center vertical line (C1) calculated from the identification image.

[0156] In addition, in this embodiment, the horizontal angle (yaw) of the autonomous flying drone (100) is directly corrected using a direction correction value (Dc), so that the autonomous flying drone (100) can be prevented from shaking significantly in the left and right directions or advancing diagonally inside the underground power conduit (10). Accordingly, the autonomous flying drone (100) can fly forward stably along the space below between two lines (L1, L2) while reducing the risk of collision with the cable hanger (13), underground power line (14), wall surface, or ceiling structure.

[0157] Next, we will examine an embodiment of controlling the curved flight of an autonomous flight drone (100) using a curve marker (210) placed in a curved section in the present invention. FIG. 6 is a diagram illustrating an example in which, when an underground power conduit (10) includes a curved section, a curve marker (210) is placed at each of the starting and ending positions of the curved section, and the autonomous flight drone (100) generates curve start information or curve end information according to the order in which the curve marker (210) is identified to control flight in the curved section.

[0158] Referring to FIG. 6, a marker line (200) consisting of two lines (L1, L2) can be marked on the ceiling surface (11) of the underground power conduit (10). The marker line (200) can be formed continuously along the straight section as well as the curved section of the underground power conduit (10), and the two lines (L1, L2) can be marked to maintain a constant distance (D) between the lines even in the curved section. Accordingly, the autonomous flying drone (100) can fly in a straight direction along the space below the two lines (L1, L2) in the straight section, and fly in a curved trajectory along the direction in which the two lines (L1, L2) bend in the curved section.

[0159] A curve marker (210) may be placed at each of the starting and ending positions of the curved section. The curve marker (210) may be placed between two lines (L1, L2) and may be displayed on the ceiling surface (11) so that it can be identified by the marker camera (130). The curve marker (210) may include an identification ID, a radius of curvature (R) of the curved section, and a direction of curvature when entering the curved section based on the curve marker (210). The curve marker (210) may be implemented, for example, as a QR code, a barcode, a character and number pattern, a shape pattern, a color pattern, or a combination thereof.

[0160] Here, the identification ID may be information for distinguishing the curve marker (210) from markers at other locations. The radius of curvature (R) may be information for determining the curvature of the flight path that the autonomous flying drone (100) must follow when passing through the curved section. The bending direction may be information indicating which direction the autonomous flying drone (100) must turn or rotate to the left or right when entering the curved section relative to the corresponding curve marker (210).

[0161] The control calculation unit (140) can determine whether a curve marker (210) is included in the identification image received from the marker camera (130). If the curve marker (210) is included in the identification image, the control calculation unit (140) can identify the identification ID, radius of curvature (R), and direction of curvature included in the curve marker (210). Additionally, the control calculation unit (140) can accumulate and manage the order in which the curve marker (210) is identified after the autonomous flight drone (100) takes off from the docking station (300).

[0162] In this embodiment, based on the order in which curve markers (210) are identified, curve start information can be generated when the curve marker (210) is identified in an odd-numbered order, and curve end information can be generated when it is identified in an even-numbered order. For example, when an autonomous flying drone (100) takes off from a docking station (300) and first enters a curved section, it identifies one of the curve markers (210). The control calculation unit (140) can determine that the curve marker (210) is the curve marker identified in an odd-numbered order and generate curve start information. Subsequently, when the autonomous flying drone (100) passes through the curved section and identifies another curve marker (210), the control calculation unit (140) can determine that the curve marker (210) is the curve marker identified in an even-numbered order and generate curve end information.

[0163] The curve start information may include the radius of curvature (R) identified from the curve marker (210) and the direction of curvature. The control calculation unit (140) may transmit the generated curve start information to the flight control unit (110), and upon receiving the curve start information, the flight control unit (110) may control the autonomous flight drone (100) to fly along a trajectory having a radius of curvature (R) toward the direction of curvature. In this case, the flight control unit (110) may adjust the forward speed, horizontal angle (yaw), horizontal movement amount in the left and right directions, and turning radius of the autonomous flight drone (100) so that the autonomous flight drone (100) moves along a flight trajectory corresponding to the shape of the curved section of the underground power conduit (10).

[0164] Meanwhile, when the control calculation unit (140) generates curve termination information and transmits it to the flight control unit (110), the flight control unit (110) determines that the autonomous flight drone (100) has passed through the curve section, terminates the curve flight control, and can switch to straight-direction flight. At this time, straight-direction flight can be performed by generating an altitude correction value (Hc), a left / right correction value (Lc), and a direction correction value (Dc) using the actual pixel (P1), virtual center point (Cp2), virtual center line (C2), and center vertical line (C1) between two lines (L1, L2), as described above.

[0165] In this way, by distinguishing between curve start information and curve end information based on the order in which curve markers (210) are identified, the same curve markers (210) can be used to control the curve section not only when the autonomous flight drone (100) flies from the inspection start point to the inspection end point, but also when it flies in the opposite direction to return to the docking station (300) after the inspection is finished. That is, depending on which of the curve markers (210) placed at both ends of the curve section is identified first, the curve marker (210) identified first can be treated as indicating the start of the curve section, and the curve marker (210) identified later can be treated as indicating the end of the curve section. Therefore, curve flight control can be performed in correspondence with the actual flight direction of the autonomous flight drone (100) without separately fixing the absolute start and end points of the curve section.

[0166] In addition, in this embodiment, when the autonomous flight drone (100) enters a curved section, the control calculation unit (140) can identify the point closest to the center point (Cp1) of the identification image on one of the two lines (L1, L2) captured in the identification image. Here, the center point (Cp1) is a point located at the exact center of the identification image and may correspond to the shooting center of the marker camera (130) or the current position reference point of the autonomous flight drone (100). Therefore, the point closest to the center point (Cp1) may represent the local position of the marker line (200) closest to the current position of the autonomous flight drone (100) within the identification image.

[0167] The control calculation unit (140) can calculate the tangent direction of the point closest to the center point (Cp1) on one of the two lines (L1, L2). Since the two lines (L1, L2) may be captured in a curved shape rather than a straight line in a curved section, if the direction of travel of the autonomous flight drone (100) is determined based only on the direction of the entire line, an error may occur compared to the actual direction of travel at the current location. Accordingly, in this embodiment, the tangent direction at the local point closest to the center point (Cp1) is calculated so that the momentary direction of travel of the marker line (200) that the autonomous flight drone (100) must follow at the current location can be determined.

[0168] The control calculation unit (140) can generate a direction correction value (Dc) based on the angle formed by the calculated tangent direction and the center vertical line (C1). The center vertical line (C1) is a line connecting the midpoint of the upper edge and the midpoint of the lower edge of the identification image, and can correspond to the current direction of travel of the autonomous flight drone (100). Therefore, the angle between the tangent direction and the center vertical line (C1) can indicate how much the current direction of travel of the autonomous flight drone (100) deviates from the local direction of travel of the curved section.

[0169] The flight control unit (110) can control the horizontal angle (yaw) of the autonomous flight drone (100) using the direction correction value (Dc) received from the control calculation unit (140). For example, if the center vertical line (C1) is tilted clockwise or counterclockwise with respect to the tangential direction, the flight control unit (110) can correct the heading direction of the autonomous flight drone (100) according to the direction and magnitude of the tilt. Accordingly, the autonomous flight drone (100) can be controlled to proceed along the local tangential direction of the marker line (200) at the current position even in curved sections.

[0170] According to this configuration, the present invention can clearly determine the start and end of a curved flight of an autonomous flying drone (100) by using curve markers (210) placed at both ends of the curved section. In addition, since the autonomous flying drone (100) can fly along a trajectory corresponding to the shape of the curved section by using the radius of curvature (R) and the bending direction included in the curve markers (210), stable curved flight is possible compared to a method of simply following the curved section by recognizing a front obstacle or wall.

[0171] In addition, in this embodiment, even after entering a curved section, the tangent direction of the point closest to the center point (Cp1) on one of the two lines (L1, L2) in the identification image is calculated, and a direction correction value (Dc) is generated by comparing this with the center vertical line (C1), so that the autonomous flight drone (100) can fly while continuously correcting the local path direction in the curved section. Accordingly, the autonomous flight drone (100) can stably follow the space below between the two lines (L1, L2) while reducing the risk of collision with the cable hanger (13), underground power line (14), wall surface, or ceiling structure in the curved section.

[0172] Next, we examine an embodiment in which a fisheye lens of an equidistant projection method is used as the lens of the marker camera (130) in the present invention to calculate a measured pixel (P1) and a reference pixel (P0) is calculated by reflecting the projection characteristics of the fisheye lens. FIG. 7 is a diagram illustrating the concept of calculating the number of pixels between the intersection points where the center horizontal line (C3) of the identification image and two lines (L1, L2) respectively intersect as the measured pixel (P1) when a fisheye lens of an equidistant projection method is used as the lens of the marker camera (130).

[0173] Referring to FIG. 7, the marker camera (130) may include a fisheye lens of an equidistant projection type. A fisheye lens has a wider angle of view compared to a standard lens ( Since it can have ), even when the autonomous flying drone (100) flies relatively close to the ceiling surface (11) of the underground power conduit (10), it can stably include the two lines (L1, L2) marked on the ceiling surface (11) in the identification image. Therefore, it is advantageous to stably capture the marker line (200) even in an environment where the flight space is limited, such as inside the underground power conduit (10), and the distance between the marker camera (130) and the ceiling surface (11) is short.

[0174] In particular, the configuration in this embodiment using an equidistant projection fisheye lens as the lens of the marker camera (130) is advantageous when the ceiling height of the underground power conduit (10) is low, so the autonomous flying drone (100) must fly in close proximity to the ceiling surface (11) and precise altitude control is required. When the distance (H) between the ceiling surface (11) and the marker camera (130) is short, the two lines (L1, L2) occupy a relatively large angle range within the field of view of the marker camera (130). In this state, even if the altitude of the autonomous flying drone (100) changes only slightly, the field of view between the two lines (L1, L2) can change relatively significantly, and the equidistant projection fisheye lens can reflect this change in field of view as a change in distance on the image sensor. Accordingly, the control calculation unit (140) can sensitively detect changes in the actual pixel (P1) between the intersection point of the center horizontal line (C3) and the two lines (L1, L2) in the identification image, and can quickly determine the minute changes in altitude of the autonomous flight drone (100) by comparing it with the reference pixel (P0).

[0175] However, unlike a general linear projection lens, the relationship between the length in the image and the length in actual space may differ depending on the projection characteristics of the lens. In particular, an equidistant projection fisheye lens may have the characteristic that the distance value on the image sensor is determined in proportion to the angle of incidence. Therefore, when using an equidistant projection fisheye lens as the lens of the marker camera (130), it is preferable to use a reference pixel calculation formula that reflects the characteristics of the equidistant projection method, rather than applying the standard center projection method reference pixel calculation formula as is.

[0176] As illustrated in FIG. 7, the control calculation unit (140) can set a center horizontal line (C3) connecting the center point of the left side and the center point of the right side of the identification image. The center horizontal line (C3) can be used as a horizontal reference line in the identification image and can serve as a reference line for stably calculating the number of pixels between two lines (L1, L2) within the identification image captured by the marker camera (130).

[0177] The control calculation unit (140) can detect the intersection points where the center horizontal line (C3) and the two lines (L1, L2) intersect, respectively. Specifically, it can calculate the point where the center horizontal line (C3) intersects one line (L1) and the point where it intersects the other line (L2), and calculate the number of pixels between the two intersection points as the actual pixels (P1). When the actual pixels (P1) are calculated based on the center horizontal line (C3) in this way, the wide angle of view of the fisheye lens ( By utilizing distortion caused by ), the number of pixels between two lines (L1, L2) based on the center of the identification image can be calculated relatively stably.

[0178] For example, when the autonomous flying drone (100) is located at a reference distance (H) from the ceiling surface (11), the number of pixels between the intersection point of the center horizontal line (C3) and the two lines (L1, L2) may appear as a measured pixel (P1) corresponding to the reference pixel (P0). When the autonomous flying drone (100) approaches the ceiling surface (11), the distance between the two lines (L1, L2) in the identification image is expanded, and the measured pixel (P1a) may be calculated to be larger than the reference pixel (P0). Conversely, when the autonomous flying drone (100) moves away from the ceiling surface (11), the distance between the two lines (L1, L2) in the identification image is reduced, and the measured pixel (P1b) may be calculated to be smaller than the reference pixel (P0).

[0179] In this embodiment, the reference pixel (P0) can be calculated as shown in the following equation using the distance between lines (D), the distance between lines (H), the focal length (f) of the marker camera (130), the horizontal length (W) of the image sensor of the marker camera (130), and the number of horizontal pixels (Pw) of the image sensor.

[0180]

[0181] Here, f is the focal length of the marker camera (130), Pw is the number of horizontal pixels of the image sensor, and W is the horizontal length of the image sensor. Also, D is the actual distance between two lines (L1, L2) marked on the ceiling surface (11), and H is the reference distance from the ceiling surface (11) that the autonomous flying drone (100) intends to maintain.

[0182] The above formula may be a formula for calculating a reference pixel (P0) by reflecting the relationship of the angle of incidence formed by two lines (L1, L2) in an equal-distance projection fisheye lens. That is, when an autonomous flying drone (100) is positioned at a reference distance (H) from the ceiling surface (11) and the actual distance between two lines (L1, L2) is D, the angle difference between the two lines (L1, L2) incident on the marker camera (130) is converted into a distance on the image sensor according to the equal-distance projection method, and the reference pixel (P0) can be calculated by corresponding this to the number of horizontal pixels (Pw) of the image sensor.

[0183] The reference pixel (P0) calculated by the above formula can be stored in the storage unit (150). The control calculation unit (140) can calculate the number of pixels between the intersection point of the center horizontal line (C3) and the two lines (L1, L2) in the identification image captured by the marker camera (130) during actual flight as the actual pixel (P1), and compare the actual pixel (P1) with the reference pixel (P0) stored in the storage unit (150). As a result, the control calculation unit (140) can determine whether the autonomous flight drone (100) has moved closer to or further away from the ceiling plane (11) than the reference separation distance (H), and generate an altitude correction value (Hc) based on this.

[0184] Next, we examine an embodiment in which the curved shape of a virtual center line (C2) appearing in an identification image is used to correct the lateral deviation or misalignment of the autonomous flight drone (100) when an equidistant projection fisheye lens is used in the present invention. FIG. 8 is a diagram illustrating the concept of correcting the left and right position or direction of travel of the autonomous flight drone (100) using the curved shape of a virtual center line (C2) calculated based on two lines (L1, L2) captured in the identification image when an equidistant projection fisheye lens is used as the lens of the marker camera (130).

[0185] Referring to FIG. 8, when the lens of the marker camera (130) is a fisheye lens with an equidistant projection method, the two lines (L1, L2) or the virtual center line (C2) calculated along the center between them in the identification image may appear in a curved shape. This curved shape does not occur only when the underground power conduit (10) itself physically forms a curved section, but may also occur in sections where the marker line (200) is displayed in a straight line due to the projection characteristics of the fisheye lens, the left and right position deviation of the autonomous flying drone (100), or the deviation in the direction of travel.

[0186] In addition, this embodiment is particularly advantageous when applied to an underground power conduit (10) that has no curved sections or where most of the sections are straight sections. In an underground power conduit (10) without curved sections, the marker line (200) in actual space is connected in a straight line. Therefore, in principle, the virtual center line (C2), calculated based on two lines (L1, L2) in the identification image, appears as a straight line when the left and right positions and the angle of travel of the autonomous flying drone (100) are normal. Accordingly, if the lens of the marker camera (130) is a fisheye lens of the equidistant projection method, or if the left and right positions or the angle of travel of the autonomous flying drone (100) deviate from the reference position, and the virtual center line (C2) appears as a curve in the identification image, the control calculation unit (140) does not determine this as a curved section of the actual power conduit, but can use it as image control information indicating a lateral deviation or deviation in the angle of travel that occurred in the straight section.

[0187] In this embodiment, the control calculation unit (140) does not treat the curve shape in the image as merely a simple distortion or an error to be removed, but can utilize it as control information to determine the lateral deviation or deviation in the direction of travel of the autonomous flight drone (100). That is, when the virtual center line (C2) is calculated in a curved shape in the identification image, the control calculation unit (140) can analyze the relationship between the virtual center line (C2) and the center vertical line (C1) to distinguish whether the autonomous flight drone (100) is deviating in the left and right directions, or whether the angle of travel is misaligned with respect to the length direction of the marker line (200).

[0188] First, we examine the case where the virtual center line (C2) and the center vertical line (C1) do not intersect each other. In this case, the control calculation unit (140) can determine that the autonomous flying drone (100) has deviated laterally from the center lower position of the marker line (200). For example, if the autonomous flying drone (100) photographs the marker line (200) while deviating to the left or right from the center lower position between the two lines (L1, L2), the virtual center line (C2) may appear as a curved shape that does not intersect the center vertical line (C1) within the identification image due to the projection characteristics of the fisheye lens and the deviation of the shooting position.

[0189] In this case, the control calculation unit (140) can calculate the direction of the center of curvature of the curve included in the virtual centerline (C2). The direction of the center of curvature may correspond to the direction in which the virtual centerline (C2) is bent in the identification image or the direction in which the center of the curve shape is located. The control calculation unit (140) can identify the direction opposite to the direction of the center of curvature of the curve included in the virtual centerline (C2) as the correction direction (Xd). The control calculation unit (140) can then transmit the identified correction direction (Xd) to the flight control unit (110).

[0190] When the flight control unit (110) receives the correction direction (Xd) from the control calculation unit (140), it can perform left and right direction control so that the autonomous flight drone (100) moves horizontally in the correction direction (Xd). This horizontal movement control can be performed until the virtual centerline (C2) in the identification image becomes a straight line. That is, as the autonomous flight drone (100) is corrected in the left and right directions and approaches the central lower position of the marker line (200), the degree of curvature of the virtual centerline (C2) in the identification image can be reduced, and finally, the virtual centerline (C2) can appear as a straight line.

[0191] Next, we examine the case where the virtual centerline (C2) and the center vertical line (C1) have an intersection point where they intersect each other. In this case, the control calculation unit (140) can determine that the flight angle of the autonomous flight drone (100) is misaligned with respect to the length direction of the marker line (200). For example, even if the autonomous flight drone (100) is located below the center between two lines (L1, L2), if the heading direction is not parallel to the length direction of the marker line (200) but is tilted clockwise or counterclockwise, the virtual centerline (C2) in the identification image may appear as a curved shape intersecting the center vertical line (C1).

[0192] In this case, the control calculation unit (140) can identify a rotation direction (Xt) in which the intersection angle (θ) of the virtual center line (C2) becomes zero. Here, the intersection angle (θ) may be the angle formed by the center vertical line (C1) and the virtual center line (C2), and the fact that the intersection angle (θ) becomes zero may mean that the direction of travel of the autonomous flight drone (100) coincides with or is parallel to the direction of travel of the marker line (200) indicated by the virtual center line (C2). The control calculation unit (140) can transmit the identified rotation direction (Xt) to the flight control unit (110).

[0193] When the flight control unit (110) receives the rotation direction (Xt) from the control calculation unit (140), it can perform horizontal angle control so that the autonomous flight drone (100) rotates in the rotation direction (Xt). This horizontal angle control can be performed until the virtual centerline (C2) in the identification image becomes a straight line. That is, as the flight angle of the autonomous flight drone (100) is corrected and approaches a state parallel to the length direction of the marker line (200), the degree of curvature of the virtual centerline (C2) in the identification image and the intersection angle (θ) with the center vertical line (C1) can be reduced, and finally, the virtual centerline (C2) can appear as a straight line.

[0194] Here, the statement that the virtual centerline (C2) becomes a straight line means that the virtual centerline (C2) in the identification image is calculated in a straight line form along the center between two lines (L1, L2). For example, the control calculation unit (140) can determine whether the virtual centerline (C2) is a straight line by using the curvature, radius of curvature, or straight line approximation error of the virtual centerline (C2). However, the technical concept of the present invention is not limited to a specific straight line determination algorithm, and various image processing methods can be applied to determine that the curvature of the virtual centerline (C2) in the identification image has been resolved and that the left / right position or direction of travel correction of the autonomous flight drone (100) has been completed.

[0195] According to this configuration, the fisheye lens of the equidistant projection method has a wide angle of view ( Since it has ), even when the autonomous flight drone (100) flies close to the ceiling surface (11) in an underground power conduit (10) with a low ceiling height, it can stably include two lines (L1, L2) within the identification image. In addition, in the close flight state, even a small change in the separation distance (H) can be sensitively manifested as a change in the field of view between the two lines (L1, L2) and a change in the actual pixel (P1), so precise altitude control of the autonomous flight drone (100) is possible. However, since the fisheye lens has projection characteristics different from a general center projection lens, in this embodiment, the reference pixel (P0) is calculated by reflecting the characteristics of the equidistant projection method, and the actual pixel (P1) is calculated based on the center horizontal line (C3), thereby allowing the wide field of view ( It is possible to ensure the reliability of pixel comparison required for altitude control while utilizing ).

[0196] This fisheye lens-based altitude control can be particularly advantageously applied in small power tunnels where the inspection path is formed mainly of straight sections and the ceiling height of the underground power tunnel (10) is low, so the autonomous flying drone (100) must fly close to the ceiling surface (11). However, this is merely an example of an operating environment in which the fisheye lens embodiment is particularly suitable, and does not exclude the application of the present invention to underground power tunnels that include curved sections.

[0197] In addition, according to the present embodiment, the wide angle of view of the fisheye lens ( Image distortion caused by ) can be used as additional control information to determine the left and right position and direction of travel of the autonomous flight drone (100), rather than simply being treated as an error to be removed. Accordingly, even when the autonomous flight drone (100) flies close to the ceiling surface (11) in the narrow internal space of the underground power conduit (10), it can stably capture two lines (L1, L2) and comprehensively correct the altitude, left and right position and direction of travel.

[0198] Next, we examine an embodiment of the present invention in which, when two lines (L1, L2) cannot be identified from an identification image, the autonomous flight drone (100) is safely returned and a path absence or non-return status is indicated. FIG. 1 is a diagram illustrating the state in which the autonomous flight drone (100) flies along a marker line (200) inside an underground power conduit (10), and FIG. 2 is a configuration diagram illustrating the relationship between the autonomous flight drone (100), a docking station (300), a monitoring server (400), and a communication network (900).

[0199] Referring to FIGS. 1 and 2, an autonomous flight drone (100) can photograph two lines (L1, L2) marked on the ceiling surface (11) of an underground power conduit (10) using a marker camera (130), and a control calculation unit (140) can generate an altitude correction value (Hc), a left-right correction value (Lc), and a direction correction value (Dc) by analyzing the identification image received from the marker camera (130). A flight control unit (110) can control the autonomous flight drone (100) to fly along the space below between the two lines (L1, L2) using the altitude correction value (Hc), left-right correction value (Lc), and direction correction value (Dc).

[0200] However, inside the underground power conduit (10), there may be cases where the two lines (L1, L2) in the identification image cannot be properly identified due to dust, condensation, leakage, poor lighting, contamination of the ceiling surface (11), partial damage to the marker line (200), temporary obstruction by a worker or equipment, shaking of the marker camera (130), or communication and image processing errors. If the autonomous flying drone (100) continues to fly forward in such a state, there is a risk that the autonomous flying drone (100) will collide with the wall of the underground power conduit (10), the cable hanger (13), the underground power distribution line (14), the ceiling structure, or other equipment.

[0201] Accordingly, the control calculation unit (140) can determine whether two lines (L1, L2) can be identified in the identification image received from the marker camera (130). Here, the case where two lines (L1, L2) cannot be identified includes not only the case where neither of the two lines (L1, L2) is detected in the identification image, but also the case where only one of the two lines (L1, L2) is detected, the case where the spacing between the two lines (L1, L2) deviates from the normal range corresponding to the distance between lines (D), the case where the continuity of the two lines (L1, L2) is below a predetermined standard, or the case where the reliability in image processing is below a predetermined standard value.

[0202] However, if the path absence state is determined immediately based solely on momentary noise or temporary image shaking, unnecessary return control may occur. Therefore, the control calculation unit (140) may determine the path absence state according to the embodiment when the state in which two lines (L1, L2) cannot be identified persists for a predetermined amount of time or is repeated in a predetermined number of consecutive frames. For example, the control calculation unit (140) may generate a path absence alarm if it determines that normal marker line (200) tracking is difficult after checking the detection reliability of the two lines (L1, L2) in the identification image for a certain period of time, the pixel spacing corresponding to the distance between lines (D), the continuity of the lines, or the directionality of the lines.

[0203] When the control calculation unit (140) generates a path absence alarm, the path absence alarm may be transmitted to the flight control unit (110). When the flight control unit (110) receives the path absence alarm, it may stop or limit the continued forward flight of the autonomous flight drone (100) and control the autonomous flight drone (100) to return to the docking station (300). At this time, the flight control unit (110) may control the autonomous flight drone (100) to follow the previous flight path in the reverse direction, or control the autonomous flight drone (100) to change its direction of travel by 180 degrees and return toward the docking station (300).

[0204] Here, the previous flight path may be the path that the autonomous flight drone (100) flew until a path absence warning occurred. The flight control unit (110) or the storage unit (150) may store information regarding the previous flight path using speed information, attitude information, direction of travel information, time information, altitude correction value (Hc), left / right correction value (Lc), direction correction value (Dc), location marker identification information, or a combination thereof during the flight of the autonomous flight drone (100). The flight control unit (110) may use this previous flight path information to control the autonomous flight drone (100) to follow the flight path before the path absence occurred in the opposite direction.

[0205] Additionally, according to the embodiment, when the flight control unit (110) receives a path absence warning, it may reduce the flight speed of the autonomous flight drone (100) or attempt to re-identify the marker line (200) while performing hover flight for a certain period of time. However, if the two lines (L1, L2) are not re-identified within a predetermined time or if the path absence condition continues, it is preferable to control the autonomous flight drone (100) to return to the docking station (300).

[0206] When the autonomous flight drone (100) changes its direction of travel by 180 degrees and returns, the flight control unit (110) can control the horizontal angle (yaw) of the autonomous flight drone (100) to change the direction of the nose to the opposite direction. Afterwards, the flight control unit (110) can return the autonomous flight drone (100) to the docking station (300) using flight information stored up to just before the occurrence of a path absence alarm, sensor unit (170) information such as an inertial sensor or a gyroscope sensor, or correction values ​​based on the two re-identified lines (L1, L2) when the marker line (200) is re-identified.

[0207] The communication unit (160) can transmit to the docking station (300) that the autonomous flight drone (100) has generated a path absence warning, is in a return state, or has landed at the docking station (300). When the autonomous flight drone (100) lands at the docking station (300) while a path absence warning has occurred, the docking station (300) can confirm that a path absence state occurred during the flight.

[0208] In this embodiment, the transmission of a path absence warning after the autonomous flight drone (100) lands may include not only the case where the autonomous flight drone (100) transmits the path absence warning itself to the docking station (300) via the communication unit (160) after landing at the docking station (300), but also the case where status information indicating that a path absence warning has occurred, a flight log, the time of occurrence of the path absence, identification images before and after the occurrence of the path absence, information regarding the last normally identified marker line (200), or, in the case where a location marker (230) is identified, the last location identification ID and distance traveled information are transmitted to the docking station (300). Therefore, even if the docking station (300) does not directly receive the path absence warning itself from the autonomous flight drone (100), it can verify whether a path absence state occurred during the flight through the status information or flight log.

[0209] When the docking station (300) receives a path absence warning or corresponding status information after the autonomous flight drone (100) lands, it may transmit a path absence notification to the monitoring server (400) via the communication network (900). In this case, the path absence notification may include the time at which the path absence warning occurred, identification information of the autonomous flight drone (100), image information of the last properly identified marker line (200), monitoring images before and after the path absence occurred, flight logs, last location identification ID and distance traveled information, or a combination thereof.

[0210] When the monitoring server (400) receives a notification of a missing path from the docking station (300), it may indicate to the manager whether the marker line (200) in the section is damaged, contaminated, has lighting abnormalities, or has equipment interference or an obstacle. Accordingly, the manager can identify the cause of the missing path even after the autonomous flight drone (100) returns, and if necessary, repair the marker line (200) in the section or remove an obstacle inside the underground power conduit (10).

[0211] Additionally, the docking station (300) can send a non-return notification to the monitoring server (400) if the autonomous flight drone (100) does not return within a set scheduled return time after taking off. Here, the scheduled return time can be pre-set by considering the length of the inspection section, the average flight speed of the autonomous flight drone (100), the distance between the inspection start point and the inspection end point, the location of the docking station (300), the remaining battery level, or the time required for past inspection flights. The docking station (300) calculates the elapsed time based on the takeoff time of the autonomous flight drone (100), and if the autonomous flight drone (100) does not land within the scheduled return time, it can determine that it is in a non-return state.

[0212] When the monitoring server (400) receives a notification of non-return from the docking station (300), it may display a warning message on the administrator terminal or provide the inspection section of the underground power conduit (10), the last received video of the autonomous flight drone (100), the last communication time, the last location marker information, or the expected location. Accordingly, the administrator can quickly check whether the autonomous flight drone (100) needs to be retrieved, whether an obstacle has occurred inside the underground power conduit (10), or whether there is a communication anomaly.

[0213] According to this configuration, the present invention can control the autonomous flight drone (100) so that it does not continue flying unnecessarily when two lines (L1, L2) cannot be identified in the identification image, and returns to the docking station (300) by following the reverse direction of the previous flight path or by changing direction by 180 degrees. Therefore, even if there is a temporary failure to recognize the marker line (200), contamination, damage, or poor lighting, the loss, collision, or prolonged flight of the autonomous flight drone (100) can be prevented.

[0214] Additionally, the docking station (300) can transmit a path absence notification to the monitoring server (400) based on a path absence warning or corresponding status information transmitted after the autonomous flight drone (100) lands, and can transmit a non-return notification to the monitoring server (400) if the autonomous flight drone (100) does not return within the scheduled return time. Accordingly, the manager can remotely and quickly recognize abnormal conditions inside the underground power conduit (10), and can improve the safety and reliability of unmanned inspection of the underground power conduit (10) and the underground power distribution line (14).

[0215] Next, we examine an embodiment of the present invention in which the normal direction of travel of an autonomous flight drone (100) is determined by utilizing the difference in color, brightness, or saturation of two lines (L1, L2). The two lines (L1, L2) may have different colors, brightness, or saturation, and the control calculation unit (140) may identify each of the two lines (L1, L2) in the identification image and then analyze the left-right arrangement relationship in the identification image. For example, in an inspection flight state where the drone flies from the inspection start point to the inspection end point, an arrangement relationship in which L2 is located on the left side of the identification image and L1 is located on the right side can be set as the arrangement relationship corresponding to the normal direction of travel. Conversely, in a return flight state where the autonomous flight drone (100) rotates 180 degrees from the inspection end point and returns to the inspection start point, an arrangement relationship in which the left and right sides are opposite to the above arrangement relationship can be set as the arrangement relationship corresponding to the normal direction of travel. Accordingly, the control calculation unit (140) can determine the normal direction of travel by considering together the current flight mode of the autonomous flight drone (100), the flight plan, whether the start mark or end mark is identified, and whether a return command is issued.

[0216] Next, we examine an embodiment of the present invention in which a position marker (230) placed between two lines (L1, L2) is used to specify the shooting location of a surveillance image. FIG. 1 is a diagram showing the state in which a marker line (200) consisting of two lines (L1, L2) and a position marker (230) are placed on the ceiling surface (11) of an underground power conduit (10), FIG. 2 is a configuration diagram showing the relationship between the flight control unit (110), surveillance camera (120), marker camera (130), control calculation unit (140), storage unit (150), communication unit (160), docking station (300), and surveillance server (400) of an autonomous flight drone (100).

[0217] Referring to FIG. 1, a location marker (230) may be placed between two lines (L1, L2) marked on the ceiling surface (11) of an underground power conduit (10). The location marker (230) may be placed at regular intervals along the length of the marker line (200), and, depending on the embodiment, may be placed at a connection box, a cable branch, a ventilation facility, a drainage facility, an inspection port, a front and rear position of a curved section, a section with a high need for inspection, or a designated point where location identification is required.

[0218] The location marker (230) may include a location identification ID. The location identification ID may be information for identifying where the location marker (230) is placed in the underground power conduit (10). For example, the location identification ID may include a section number, facility number, distance indicator, coordinate information, management number, inspection port number, or a combination thereof of the underground power conduit (10). The location marker (230) may be formed in a shape that can be identified by the marker camera (130), and may be implemented, for example, as a QR code, barcode, character and number pattern, shape pattern, color pattern, or a combination thereof.

[0219] The marker camera (130) can photograph the marker line (200) marked on the ceiling surface (11) while the autonomous flying drone (100) flies inside the underground power conduit (10), and can also photograph the position marker (230) placed between two lines (L1, L2). The control calculation unit (140) can analyze the identification image received from the marker camera (130) to determine whether the position marker (230) is included in the identification image. If the position marker (230) is included in the identification image, the control calculation unit (140) can identify the position identification ID included in the position marker (230).

[0220] After identifying the location identification ID, the control calculation unit (140) may receive speed information of the autonomous flight drone (100) from the flight control unit (110). Here, the speed information may include the forward speed, flight direction, time information, acceleration information, or a combination thereof of the autonomous flight drone (100). According to an embodiment, the speed information may be a flight speed calculated by the flight control unit (110) itself, or a value calculated using information provided from an inertial sensor, accelerometer, gyroscope, barometric pressure sensor, or other flight sensor included in the sensor unit (170).

[0221] The control calculation unit (140) sets the time when the location marker (230) is identified as a reference point, and thereafter calculates the distance traveled from the location marker (230) in real time using speed information provided by the flight control unit (110). For example, the control calculation unit (140) can calculate the distance traveled from the location marker (230) to the current shooting location by accumulating the forward speed of the autonomous flight drone (100) over time from the time when the location marker (230) is identified to the current time. That is, the location identification ID of the location marker (230) represents the reference location, and the distance traveled from the reference location can secondarily represent the shooting location of the current surveillance video.

[0222] Additionally, the control calculation unit (140) can update the distance calculation based on the newly identified location identification ID when the autonomous flight drone (100) identifies the next location marker (230). Accordingly, even when flying inside a long-distance underground power conduit (10), the excessive increase in accumulated error can be reduced. According to an embodiment, the control calculation unit (140) may also correct the distance error due to velocity integration using known distance information between the previous location marker (230) and the next location marker (230).

[0223] The control calculation unit (140) can transmit the identified location identification ID and the distance traveled calculated in real time from the location marker (230) to the surveillance camera (120). While capturing surveillance images of the underground power conduit (10) or the underground power distribution line (14), the surveillance camera (120) can store the location identification ID and the distance traveled provided by the control calculation unit (140) together as metadata of the surveillance images. Here, the metadata may be stored as header information of the surveillance image file, additional information per frame, location information linked to time information, and database information linked to a separate log file or image data.

[0224] In this embodiment, the fact that the surveillance camera (120) stores the surveillance video in the storage unit (150) may include cases where the surveillance camera (120) controls the recording of the captured surveillance video into the storage unit (150) after generating or encoding the video data. Additionally, the surveillance camera (120) may store the location identification ID provided by the control calculation unit (140) and the distance traveled from the location marker (230) together as additional information per frame of the surveillance video, header information of the video file, log information or database information linked to the video data.

[0225] For example, while the surveillance camera (120) captures the condition of the underground power distribution line (14), cable hanger (13), junction box, or ceiling surface (11), location-related metadata such as “Location identification ID: A-03” and “Distance from location marker: 12.5m” may be stored together with the surveillance video. Accordingly, when the surveillance server (400) detects an abnormal sign after receiving the surveillance video through the docking station (300), it can determine how far from which location marker (230) the abnormal sign was captured.

[0226] In this embodiment, storing the location identification ID and the distance traveled together in the surveillance video is particularly useful when considering the structural characteristics inside the underground power conduit (10). Since similar types of underground power distribution lines (14), cable hangers (13), junction boxes, and other facilities may be repeatedly arranged over long distances inside the underground power conduit (10), it is often difficult to accurately determine the location where the video was taken using only the surveillance video. However, in this embodiment, since the location identification ID and the distance traveled from the location marker (230) are recorded together in the surveillance video, the actual location of the video where an abnormal sign was detected can be determined more quickly.

[0227] Additionally, since the location marker (230) is positioned between two lines (L1, L2), it can be naturally included in the identification image of the marker camera (130) while the autonomous flying drone (100) flies normally along the marker line (200). Therefore, the location marker (230) can be recognized together with the marker line (200) during the process of identifying the marker line (200) without adding a separate location recognition device or a separate shooting device for location verification.

[0228] When the location identification ID and travel distance are stored as metadata of the surveillance video, the surveillance server (400) can manage the inspection results of each section of the underground power conduit (10) by linking the time information and location information of the surveillance video. For example, the surveillance server (400) can search only for videos taken within a certain distance range before and after a specific location identification ID, or compare past inspection videos and current inspection videos based on the same location. Accordingly, it is possible to track the temporal changes of abnormal conditions such as deterioration of the underground power distribution line (14), deformation of the cable hanger (13), leakage, condensation, flooding, inflow of foreign matter, or equipment damage.

[0229] According to this configuration, the present invention controls the flight of an autonomous drone (100) using two lines (L1, L2) marked on the ceiling surface (11) of an underground power conduit (10), and additionally, can specify the shooting location of a surveillance image using a location marker (230) placed between the two lines (L1, L2). Therefore, even in an environment where identical or similar structures appear repeatedly, such as inside an underground power conduit (10), the location where an abnormal sign is detected can be identified quickly and accurately.

[0230] In addition, according to the present embodiment, since the location identification ID of the location marker (230) and the distance traveled from the location marker (230) are stored together as metadata of the surveillance video, the surveillance server (400) can easily provide information necessary for a field worker to move to the corresponding location after analyzing the abnormal video. Accordingly, the correspondence between the inspection results of the underground power conduit (10) and the underground power distribution line (14) and the actual maintenance work location becomes clear, and the speed and accuracy of the maintenance work can be improved.

[0231] Although the present invention has been described with various examples as stated above, the present invention is not necessarily limited to these examples and may be implemented with various modifications within the scope of the technical concept of the present invention. Accordingly, the examples disclosed in the present invention are intended to explain, not limit, the technical concept of the present invention, and the scope of the technical concept of the present invention is not limited by these examples. The scope of protection of the present invention shall be interpreted by the claims below, and all technical concepts within an equivalent scope shall be interpreted as being included within the scope of rights of the present invention. Explanation of the symbols

[0232] 10: Underground power conduit 11: Ceiling or ceiling surface 12: Floor or floor surface 13: Cable hanger 14: Underground power distribution lines or cables 100: Autonomous flying drones 100a, 100b: Autonomous flight drone in a state of changing separation distance 110: Flight Control Unit 120: Surveillance Camera 130: Marker Camera 131: Marker Gimbal 140: Control calculation unit 150: Storage unit 160: Communication unit 170: Sensor unit 200: Marker line 210: Curve marker 230: Location Marker 300: Docking Station 400: Monitoring server 900: Communication network L1, L2: Two lines D: Distance between lines H: Separation distance P0: Reference pixel P1, P1a, P1b: Actual pixels Cp1: Center point of the identification image Cp2: Virtual center point Lm1, Lm2: Midpoints located at the points that bisect each of the two lines C1: Center vertical line C2: Virtual center line C3: Center horizontal line d1: Deviation distance P2: Number of pixels relative to the virtual center point in the x-axis direction θ: Intersection angle R: Radius of curvature Xd: Correction direction Xt: Rotation direction : Angle of view of a marker camera Ha, Hb: Distance between the ceiling plane and the autonomous drone in a state of varying separation distance

Claims

Claim 1 An autonomous flight drone system for monitoring underground power lines, capable of monitoring underground power conduits and underground power lines by capturing and analyzing images of underground power conduits and underground power lines using a drone capable of autonomous flight inside an underground power conduit, comprising: an autonomous flight drone; one or more docking stations located within the underground power conduit, capable of downloading image data captured by the autonomous flight drone and charging the battery of the autonomous flight drone when the autonomous flight drone lands, and capable of transmitting the image data to a remote location; and a monitoring server capable of receiving and analyzing the image data transmitted by the docking station to diagnose abnormalities in the underground power conduit and underground power lines. and a marker line displayed on the ceiling of the underground power conduit, consisting of two lines (L1, L2) having a color contrasting with the color of the ceiling surface of the underground power conduit and having a certain distance (D) between them, extending from the inspection start point to the inspection end point of the underground power conduit; wherein the autonomous flying drone includes a flight control unit, a surveillance camera, a marker camera, a marker gimbal, a control calculation unit, a storage unit, and a communication unit; wherein the surveillance camera captures surveillance images of the underground power conduit or the underground power distribution line while the autonomous flying drone is flying and stores them in the storage unit; wherein the marker camera captures identification images of the marker line while the autonomous flying drone is flying and transmits them in real time to the control calculation unit; wherein the marker gimbal controls the attitude of the marker camera so that the lens optical axis of the marker camera can be in a vertical direction toward the ceiling of the underground power conduit; and wherein the storage unit contains the identification images captured when the marker camera captures the identification images at a certain distance (H) from the ceiling of the underground power conduit A reference pixel (P0), which is the number of pixels between the two lines (L1, L2) mentioned above, is stored, and the communication unit can connect to the docking station via a local area network to perform data communication, and the control calculation unit,The two lines (L1, L2) captured in the identification image are analyzed to generate an altitude correction value (Hc), a left-right correction value (Lc), and a direction correction value (Dc), which are then transmitted to the flight control unit. The flight control unit controls the autonomous flight drone to take off from the docking station at predetermined time intervals, fly autonomously along the space below the two lines (L1, L2) from the inspection start point to the inspection end point, and then return to the docking station. The flight control unit controls the autonomous flight drone to: - perform altitude control using the altitude correction value (Hc) so that the autonomous flight drone can fly forward while maintaining the separation distance (H) from the ceiling of the underground power conduit; - perform left-right horizontal movement control using the left-right correction value (Lc) so that the center of the autonomous flight drone can fly forward without deviating from the vertical downward projection area between the two lines (L1, L2); and - use the direction correction value (Dc) so that the autonomous flight drone's Horizontal angle (yaw) control is performed so that the direction of travel can fly forward while maintaining parallelism with the length direction of the marker line, the reference pixel (P0) is calculated using the distance between lines (D), the separation distance (H), and the specifications of the marker camera, and the value calculated by the number of pixels between the two lines (L1, L2) captured in the identification image is set as the actual pixel (P1), the altitude correction value (Hc) is generated based on the difference between the actual pixel (P1) and the reference pixel (P0), the left-right correction value (Lc) is generated based on the relative position between the center point (Cp1) located at the exact center of the identification image and the virtual center point (Cp2) between the two lines (L1, L2) in the identification image, and the direction correction value (Dc) is generated based on the central vertical line (C1) connecting the center point of the upper edge and the center point of the lower edge of the identification image and the virtual center point between the two lines (L1, L2) in the identification image It is generated based on the angle between the center lines (C2), and the virtual center point (Cp2) is,An autonomous flight drone system for monitoring underground power distribution lines, characterized in that it is the midpoint of a virtual line segment connecting each midpoint (Lm1, Lm2) located at the point that bisects each of the two lines (L1, L2) captured in the identification image, and the virtual centerline (C2) is a line drawn virtually in the longitudinal direction along the center between the two lines (L1, L2) captured in the identification image. Claim 2 In claim 1, the altitude correction value (Hc) is a value obtained by subtracting the actual pixel (P1) from the reference pixel (P0) (P0-P1), or a value proportional to the subtracted value (P0-P1), and the reference pixel (P0) is calculated as shown in the following formula using the line distance (D), the separation distance (H), the focal length (f) of the marker camera, the horizontal length (W) of the image sensor of the marker camera, and the number of horizontal pixels (Pw) of the image sensor. The flight control unit described above is characterized by: maintaining the current altitude of the autonomous flight drone when the altitude correction value (Hc) is within a predetermined allowable range; performing descent control to move the autonomous flight drone away from the ceiling of the underground power conduit when the altitude correction value (Hc) is a negative value outside the allowable range; and performing ascent control to move the autonomous flight drone closer to the ceiling of the underground power conduit when the altitude correction value (Hc) is a positive value outside the allowable range, wherein the amount of control for the ascent control or the descent control increases as the absolute value of the altitude correction value (Hc) increases. Claim 3 In claim 1, the left and right correction value (Lc) is a deviation distance (d1) from the center between the two lines (L1, L2) of the autonomous flight drone, or a value proportional to the deviation distance (d1); the deviation distance (d1) is calculated as shown in the following equation using the x-coordinate value (P2) of the virtual center point (Cp2) based on the number of pixels, where the center point (Cp1) is set as the coordinate origin (0,0) with the direction of the center vertical line (C1) in the identification image as the y-axis and the direction perpendicular to the y-axis as the x-axis. (D: distance between lines, P1: actual pixels, P2: number of pixels relative to the x-axis direction of a virtual center point Cp2 when center point Cp1 in the identification image is set as the coordinate origin) The flight control unit, wherein - maintains the current left-right position of the autonomous flight drone when the left-right correction value (Lc) is within a predetermined allowable range, and - performs left-right horizontal movement control for the autonomous flight drone so that the x-coordinate value (P2) or the deviation distance (d1) approaches 0 when the left-right correction value (Lc) deviates from the allowable range, and - increases the amount of control for the left-right horizontal movement control as the absolute value of the left-right correction value (Lc) increases, thereby characterizing an autonomous flight drone system for monitoring underground power distribution lines. Claim 4 In claim 1, the direction correction value (Dc) is the intersection angle (θ) formed by the virtual center line (C2) with respect to the center vertical line (C1) or a value proportional to the intersection angle (θ), having a positive value when the virtual center line (C2) is tilted clockwise and a negative value when it is tilted counterclockwise; the flight control unit maintains the current flight angle of the autonomous flight drone when the direction correction value (Dc) is within a predetermined allowable range, and performs horizontal angle (yaw) control for the autonomous flight drone so that the intersection angle (θ) approaches 0 when the direction correction value (Dc) exceeds the allowable range, wherein the amount of control for the horizontal angle (yaw) control increases as the absolute value of the direction correction value (Dc) increases, and the control calculation unit calculates the intersection angle (θ) as shown in the following equation, characterized in that the autonomous flight drone system for monitoring underground power distribution lines. (x, y are relative coordinates to an arbitrary point on the virtual center line (C2) that is not the intersection point, where the intersection point of the virtual center line (C2) and the center vertical line (C1) is set as the coordinate origin (0,0).) Claim 5 In claim 1, the underground power conduit includes a curved section and further includes a curve marker disposed between the two lines (L1, L2) at each of the starting and ending positions of the curved section; each of the curve markers includes an identification ID, a radius of curvature (R) of the curved section, and a bending direction when entering the curved section based on the corresponding curve marker; the control calculation unit generates curve start information or curve end information and transmits it to the flight control unit when the curve marker is included in the identification image, wherein, based on the order in which the curve marker is identified after the autonomous flight drone takes off from the docking station, the curve start information is generated when the curve marker is identified at an odd number, and the curve end information is generated when the curve marker is identified at an even number; the curve start information includes the radius of curvature (R) and the bending direction; and when the flight control unit receives the curve start information, it causes the autonomous flight drone to fly along a trajectory having the radius of curvature (R) toward the bending direction. An autonomous flight drone system for monitoring underground power distribution lines, characterized in that when the curve termination information is received while controlling, the drone is controlled to fly in a straight direction, and when the autonomous flight drone enters the curve section, the control calculation unit calculates the tangent direction at the point closest to the center point (Cp1) of the identification image from one of the two lines (L1, L2) captured in the identification image, and generates the direction correction value (Dc) based on the angle formed by the center vertical line (C1) and the tangent direction. Claim 6 An autonomous flight drone system for monitoring underground power distribution lines, characterized in that, in claim 1, the lens of the marker camera is a fisheye lens of an equal-distance projection type, the control calculation unit calculates the number of pixels between the intersection points where the center horizontal line (C3) connecting the center point of the left side and the center point of the right side of the identification image and the two lines (L1, L2) respectively intersect as the actual pixel (P1), and the reference pixel (P0) is calculated as shown in the following equation using the distance between lines (D), the separation distance (H), the focal length (f) of the marker camera, the horizontal length (W) of the image sensor of the marker camera, and the number of horizontal pixels (Pw) of the image sensor. Claim 7 In claim 6, the control calculation unit, when the virtual centerline (C2) calculated based on the two lines (L1, L2) captured in the identification image is calculated in a curved form, - if the virtual centerline (C2) and the center vertical line (C1) do not intersect each other, determines that there is a lateral deviation, identifies the direction opposite to the center of curvature of the curve included in the virtual centerline (C2) as the correction direction (Xd), and transmits it to the flight control unit; the flight control unit performs left and right direction control to cause the autonomous flight drone to move horizontally in the correction direction (Xd), and performs this until the virtual centerline (C2) becomes a straight line; - if the virtual centerline (C2) and the center vertical line (C1) have an intersection point where they intersect each other, determines that the direction of travel is misaligned, identifies the rotation direction (Xt) where the intersection angle (θ) of the virtual centerline (C2) becomes 0, and transmits it to the flight control unit; and the flight control unit [causes] the autonomous flight drone to An autonomous flight drone system for monitoring underground power distribution lines, characterized by performing horizontal angle control to rotate in the rotation direction (Xt) until the virtual centerline (C2) becomes a straight line. Claim 8 An autonomous flight drone system for monitoring underground power distribution lines, characterized in that, in any one of claims 1 to 7, the control calculation unit transmits a path absence warning to the flight control unit when the two lines (L1, L2) cannot be identified in the identification image, and when the flight control unit receives the path absence warning, the autonomous flight drone controls the drone to follow the previous flight path in reverse or change its direction of travel by 180 degrees to return to the docking station, and the docking station transmits a path absence notification or a non-return notification to the monitoring server when the autonomous flight drone transmits the path absence warning after landing or when the autonomous flight drone does not return within a predetermined scheduled return time after takeoff. Claim 9 An autonomous flight drone system for monitoring underground power distribution lines, characterized in that, in any one of claims 1 to 7, the two lines (L1, L2) have different colors, brightness, or saturation, and the control calculation unit determines the normal direction of travel of the autonomous flight drone by identifying the difference in color, brightness, or saturation for each of the two lines (L1, L2) in the identification image, and if it is determined that the result of identifying the difference in color, brightness, or saturation is different from the normal direction of travel, it transmits direction error information to the flight control unit, and the flight control unit controls the horizontal angle so that the arrangement relationship of the colors, brightness, or saturation of the two lines (L1, L2) identified in the identification image matches the normal direction of travel when the direction error information is received. Claim 10 An autonomous flight drone system for monitoring underground power distribution lines, characterized in that, in any one of claims 1 to 7, it further comprises a position marker positioned between the two lines (L1, L2) at a fixed interval or at a designated point, wherein the position marker includes a position identification ID, and the control calculation unit, when the position marker is included in the identification image, identifies the position identification ID, receives speed information from the flight control unit and calculates the distance traveled from the position marker in real time, and transmits the position identification ID and the distance traveled to the surveillance camera, and the surveillance camera stores the position identification ID and the distance traveled together as metadata of the surveillance image when storing the surveillance image in the storage unit.

Citation Information

Patent Citations

  • Mobile-robot-carried camera position calibration method

    CN103020957A

  • Measurement method for determining the position of an aircraft or motor vehicle relative to the side of a runway or road from an image obtained using a camera that includes at least one edge of the runway or road

    DE10305993A1

  • Inspection device for duct inner wall and computer program

    JP2021011266A

  • Unmanned Transportation System based on linetracing of Ceiling type for interlocking with unmanned drone and Unmanned transportation service method using the same

    KR1020160056671A

  • Method and apparatus for autonomous exploring underground cavity area using intelligent unmmaned flying object

    KR1020190091714A