Flight positioning method and system of unmanned aerial vehicle in underground pipeline
Through the upper optical flow sensor and Kalman data fusion algorithm, the problem of inaccurate optical flow positioning in underground drainage pipes is solved, and the accurate measurement and positioning of the drone's flight speed in underground pipes is realized, which improves the reliability of operation.
Patent Information
- Application Number
- CN202411128939.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-16
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2044-08-16
AI Technical Summary
In underground drainage pipes, the optical flow positioning method cannot accurately estimate the horizontal flight speed of the drone due to the mirror environment of accumulated water, resulting in inaccurate positioning, affecting the normal flight and detection of the drone in the pipeline.
The upper optical flow sensor is used to obtain video data of the upper pipe wall of the drone in the pipeline, combined with the physical model and the Kalman data fusion algorithm, fuse the optical flow velocity and estimated speed, and obtain more accurate drone estimation speed to avoid accumulation. Water effects.
It improves the accuracy of positioning of the drone in underground pipelines, enhances the accuracy and robustness of flight speed measurement, and ensures the normal operation of the drone in harsh environments.
Smart Images

Figure CN118913289A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of unmanned aerial vehicle control methods, and in particular to a method and system for measuring the flight speed of a unmanned aerial vehicle in an underground pipeline. Background Art
[0002] In the city's drainage system, the health of underground drainage pipes is very important. Therefore, managers need to find problems in underground drainage pipes and propose solutions in time to achieve sustainable municipal development. Due to the long-term operation of underground pipes, many problems will arise. If the relevant staff fail to effectively maintain the pipes, a lot of sludge will appear in the drainage pipes, which will affect the smooth passage of pipe drainage. Especially on rainy days, if too much mud accumulates in the pipes, it will lead to the inability to discharge rainwater in time, which is easy to cause urban waterlogging and affect the travel and life of citizens. If the sludge in the pipes cannot be transported to the sewage treatment plant for cleaning in time, the sewage in the downstream inspection wells will overflow onto the road surface, emitting an unpleasant smell and polluting the urban environment. The core problem of drone underground pipeline detection is the positioning problem. Inaccurate positioning will prevent the drone from flying normally in the pipeline for detection.
[0003] The conventional positioning method is to use an optical flow at the bottom of the drone to estimate the horizontal speed, thereby achieving the positioning effect. However, water accumulation in underground pipes is a very common working condition, and the surface of the accumulated water is a mirror. Therefore, the optical flow cannot accurately estimate the horizontal flight speed of the drone in a mirror environment. Summary of the invention
[0004] The present invention discloses a method and system for measuring the flight speed of a UAV in an underground pipeline, so as to solve the problem that the lower end of the existing UAV in the above-mentioned background technology uses an optical flow to estimate the horizontal speed to achieve the positioning effect, and water accumulation in underground pipelines is a very common working condition, and the surface of the accumulated water is a mirror surface. Therefore, the optical flow cannot accurately estimate the horizontal flight speed of the UAV in a mirror environment.
[0005] In order to solve the above technical problems, the following technical solutions are proposed:
[0006] A method for measuring the flight speed of a drone in an underground pipeline, wherein the underground pipeline includes a transverse pipeline, the drone is controlled to fly horizontally along the transverse pipeline in the transverse pipeline, and an upper optical flow sensor is arranged above the drone, comprising:
[0007] Acquire, by means of an upper optical flow sensor, first video data of an upper pipe wall in the transverse pipe when the drone is flying in the transverse pipe; and acquire a first optical flow velocity of the drone according to the first video data;
[0008] Get the first estimated speed of the drone;
[0009] The first optical flow velocity and the first estimated velocity are fused by a Kalman data fusion algorithm to obtain a first estimated velocity of the drone.
[0010] Preferably, the method of obtaining the first estimated speed of the UAV includes: obtaining second video data of the lower pipe wall in the transverse pipe when the UAV flies in the transverse pipe through the lower optical flow sensor, and obtaining the second optical flow speed of the UAV based on the second video data; obtaining the second estimated speed of the UAV through the physical model of the UAV; and fusing the second optical flow speed and the second estimated speed through the Kalman data fusion algorithm to obtain the first estimated speed of the UAV.
[0011] Preferably, after the first estimated speed of the UAV is obtained for the first time, the first optical flow speed and the first estimated speed obtained for the first time are fused through a Kalman data fusion algorithm to obtain the first estimated speed of the UAV for the first time; the second estimated speed of the UAV is iteratively updated based on the first estimated speed of the UAV obtained for the first time to obtain the iteratively updated second estimated speed; the second optical flow speed and the iteratively updated second estimated speed are fused through a Kalman data fusion algorithm to continuously obtain the first estimated speed of the UAV.
[0012] Preferably, obtaining the first optical flow velocity of the drone according to the first video data includes:
[0013] Discretizing the first video data to obtain a plurality of continuous sets of image data;
[0014] Extracting corner points in each group of image data by using a corner detection algorithm;
[0015] The corner points in the two sets of image data in adjacent frames are brought into the optical flow algorithm to obtain the first optical flow speed of the drone.
[0016] Preferably, fusing the first optical flow speed and the first estimated speed by using a Kalman data fusion algorithm to obtain a second estimated speed of the drone comprises:
[0017] Acquiring the number of corner points in the image data, and adjusting the noise parameter of the image data according to the number of corner points;
[0018] The Kalman gain is calculated according to the noise parameter;
[0019] A weighting coefficient of the first optical flow velocity and a weighting coefficient of the first estimated velocity are obtained according to the Kalman gain, and the first optical flow velocity and the first estimated velocity are multiplied by the weighting coefficients and then added to obtain a first estimated velocity of the drone.
[0020] A system for measuring the flying speed of a drone in an underground pipeline is also disclosed, comprising:
[0021] an upper optical flow sensor, arranged above the drone, for acquiring first video data of an upper pipe wall in the transverse pipe when the drone flies in the transverse pipe; and acquiring a first optical flow velocity of the drone according to the first video data;
[0022] A control module, the control module is used to obtain a first estimated speed of the drone;
[0023] Kalman filter, the upper optical flow sensor and the Kalman filter are both electrically connected to the control module, the control module transmits the first optical flow speed and the first estimated speed to the Kalman filter, and the Kalman filter fuses the first optical flow speed and the first estimated speed according to the Kalman data fusion algorithm to obtain the first estimated speed of the drone.
[0024] As a preference, it also includes:
[0025] A lower optical flow sensor is arranged above the drone and is electrically connected to the control module, and is used to obtain second video data of the lower pipe wall in the transverse pipe when the drone flies in the transverse pipe; and obtain a second optical flow velocity of the drone according to the second video data;
[0026] In the process of the control module acquiring the first estimated speed of the drone, the control module acquires the second estimated speed of the drone through the physical model of the drone;
[0027] The control module transmits the second optical flow speed and the second estimated speed to the Kalman filter, and the Kalman filter fuses the second optical flow speed and the second estimated speed according to the Kalman data fusion algorithm to obtain the first estimated speed of the drone.
[0028] Preferably, after the first estimated speed of the UAV is obtained for the first time, the first optical flow speed and the first estimated speed obtained for the first time are fused through the Kalman filter Kalman data fusion algorithm to obtain the first estimated speed of the UAV for the first time; the second estimated speed of the UAV is iteratively updated based on the first estimated speed of the UAV obtained for the first time to obtain the iteratively updated second estimated speed; the second optical flow speed and the iteratively updated second estimated speed are fused through the Kalman data fusion algorithm to continuously obtain the first estimated speed of the UAV.
[0029] Preferably, the specific process of the upper optical flow sensor acquiring the first optical flow speed of the drone according to the first video data includes:
[0030] The upper optical flow sensor discretizes the first video data to obtain a plurality of continuous sets of image data;
[0031] Extracting corner points in each group of image data by using a corner detection algorithm;
[0032] The corner points in the two sets of image data in adjacent frames are brought into the optical flow algorithm to obtain the first optical flow speed of the drone.
[0033] Preferably, the Kalman filter fuses the first optical flow speed and the first estimated speed through a Kalman data fusion algorithm to obtain a second estimated speed of the drone, comprising:
[0034] The Kalman filter obtains the number of corner points in the image data, and adjusts the noise parameter of the image data according to the number of corner points; and calculates the Kalman gain according to the noise parameter;
[0035] A weighting coefficient of the first optical flow velocity and a weighting coefficient of the first estimated velocity are obtained according to the Kalman gain, and the first optical flow velocity and the first estimated velocity are multiplied by the weighting coefficients and then added to obtain a second estimated velocity of the UAV.
[0036] Beneficial effects: The present invention discloses a method and system for measuring the flying speed of a drone in an underground pipeline, wherein the underground pipeline includes a transverse pipeline, and the drone is controlled to fly horizontally along the transverse pipeline in the transverse pipeline. An upper optical flow sensor is arranged above the drone, including: obtaining the first video data of the upper pipe wall in the transverse pipeline when the drone flies in the transverse pipeline through the upper optical flow sensor; and obtaining the first optical flow velocity of the drone according to the first video data; the drone obtains the first estimated speed of the drone through a physical model; and the first optical flow velocity and the first estimated velocity are fused through a Kalman data fusion algorithm to obtain the first estimated speed of the drone. In this embodiment, since the accumulated water in the transverse pipeline is located on the lower pipe wall of the transverse pipeline, and the upper pipe wall of the transverse pipeline is affected by gravity and will not be affected by the accumulated water, in the embodiment, the first video data of the upper pipe wall when the drone flies in the transverse pipeline is obtained, and a more accurate first optical flow velocity can be obtained according to the first video data, thereby solving the problem that the accumulated water in the underground pipeline affects the accuracy of the optical flow estimation of the drone when the drone estimates the flying speed of the drone by obtaining the image data of the lower pipe wall of the underground pipeline. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 This is a control flow chart of the present invention;
[0038] Figure 2 It is the framework structure diagram of the present invention. DETAILED DESCRIPTION
[0039] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.
[0040] The following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0041] In the drainage system of the city, the health of the underground drainage pipes is very important. Therefore, the management personnel must find the problems in the underground drainage pipes and propose solutions in time to achieve the sustainable development of the municipality. Due to the long-term operation of the underground pipes, many problems will arise. If the relevant staff fail to effectively maintain the pipes, a lot of sludge will appear in the drainage pipes, which will affect the smooth passage of the pipe drainage. Especially on rainy days, if too much mud accumulates in the pipes, it will lead to the inability to discharge rainwater in time, which is easy to cause urban waterlogging and affect the travel and life of citizens. The silt in the pipe cannot be transmitted to the sewage treatment plant for cleaning in time, which will cause the sewage in the downstream inspection well to overflow the road surface, emit an unpleasant smell, and pollute the urban environment. However, the underground drainage pipe environment is harsh and the network is complex. It is impossible to effectively maintain the underground drainage pipe network by manual inspection. Therefore, in the present invention, a method of remote sensing detection of the pipe by remote operation of an unmanned aerial vehicle is adopted to conduct quick and efficient inspection of the underground drainage pipe.
[0042] However, the underground drainage pipe network is very changeable. Therefore, when controlling the drone to fly horizontally along the lateral pipe in the underground pipe, it is necessary to accurately locate the position of the drone to ensure that the drone can fly normally in the pipe. Inspection is the primary problem to be solved at present. At present, the conventional positioning method for drones is to use GPS or use an optical flow at the lower end of the drone to estimate the horizontal speed, so as to achieve the positioning effect. First, because the underground drainage pipe is buried deep underground, the GPS will cause inaccurate positioning signals due to occlusion, and thus cannot effectively control the drone to fly horizontally along the lateral pipe in the underground pipe. Secondly, water accumulation in the underground pipe is a very common working condition, and the surface of the accumulated water is a mirror. The lower end of the drone uses an optical flow to estimate the horizontal speed. Since the optical flow cannot estimate the accurate speed in the mirror environment, the optical flow cannot achieve a good positioning function. Therefore, in order to solve the above problems, the present invention discloses a method for measuring the flying speed of a drone in an underground pipe. Refer to the attached figure. Figure 1-2The underground pipeline includes a transverse pipeline, and a drone is controlled to fly horizontally along the transverse pipeline in the transverse pipeline. An upper optical flow sensor is arranged above the drone, including: obtaining first video data of an upper pipe wall in the transverse pipeline when the drone flies in the transverse pipeline through the upper optical flow sensor; and obtaining a first optical flow speed of the drone according to the first video data; the drone obtains a first estimated speed of the drone through a physical model; and obtains a first estimated speed of the drone by fusing the first optical flow speed and the first estimated speed through a Kalman data fusion algorithm. In the present embodiment, since the accumulated water in the transverse pipe is located on the lower pipe wall of the transverse pipe, and the upper pipe wall of the transverse pipe is affected by gravity and will not accumulate water, in the embodiment, the first video data of the upper pipe wall is obtained when the UAV flies in the transverse pipe, and a more accurate first optical flow velocity can be obtained based on the first video data, thereby solving the problem that when the UAV estimates the flight speed of the UAV by obtaining image data of the lower pipe wall of the underground pipe, the accumulated water in the underground pipe will affect the accuracy of the UAV optical flow estimation, thereby greatly increasing the accuracy of UAV positioning. Secondly, in the present embodiment, the UAV obtains the first estimated speed of the UAV through a physical model; then the first optical flow velocity and the first estimated velocity are fused through the Kalman data fusion algorithm to obtain a more accurate first estimated speed of the UAV, further improving the accuracy of UAV positioning.
[0043] Another feasible implementation scheme is also provided in this embodiment. In this embodiment, a lower optical flow sensor is provided under the UAV, and second video data of the lower pipe wall in the transverse pipe when the UAV flies in the transverse pipe is obtained through the lower optical flow sensor; and a second optical flow velocity of the UAV is obtained according to the second video data; a second estimated velocity of the UAV is obtained according to the physical model of the UAV; the second optical flow velocity and the second estimated velocity are fused through the Kalman data fusion algorithm to obtain a first estimated velocity of the UAV, and the first estimated velocity calculated by the lower optical flow sensor is fused with the first optical flow velocity obtained by the upper optical flow sensor to obtain a more accurate first estimated velocity of the UAV, thereby increasing the robustness of the UAV and further improving the accuracy of UAV positioning.
[0044] In this embodiment, when the drone flies in the transverse pipe, the drone needs to repeatedly perform the above steps to obtain the first estimated speed of the drone in real time. In the process of repeating the above steps, the drone will iteratively update the second estimated speed of the drone, thereby achieving a more accurate positioning effect. The specific method for iteratively updating the second estimated speed of the drone is as follows:
[0045] After the first estimated speed of the UAV is obtained for the first time, the first optical flow speed and the first estimated speed obtained for the first time are fused through the Kalman data fusion algorithm to obtain the first estimated speed of the UAV for the first time; the second estimated speed of the UAV is iteratively updated according to the first estimated speed of the UAV obtained for the first time to obtain the iteratively updated second estimated speed; the second optical flow speed and the iteratively updated second estimated speed are fused through the Kalman data fusion algorithm to continuously obtain the first estimated speed of the UAV.
[0046] Specifically, take the drone obtaining the first estimated speed for the first time and obtaining the first estimated speed for the second time as an example.
[0047] When the UAV first obtains the first estimated speed, the UAV obtains the first video data of the upper pipe wall in the transverse pipe when the UAV flies in the transverse pipe through the upper optical flow sensor; and obtains the first optical flow speed of the UAV based on the first video data; obtains the second video data of the lower pipe wall in the transverse pipe when the UAV flies in the transverse pipe through the lower optical flow sensor; and obtains the second optical flow speed of the UAV based on the second video data; obtains the second estimated speed of the UAV based on the physical model of the UAV; fuses the second optical flow speed and the second estimated speed through the Kalman data fusion algorithm to obtain the first estimated speed of the UAV, and finally fuses the first optical flow speed and the first estimated speed through the Kalman data fusion algorithm to obtain the first estimated speed of the UAV.
[0048] When obtaining the first estimated speed for the second time, the UAV obtains first video data of the upper pipe wall in the transverse pipe when the UAV flies in the transverse pipe through the upper optical flow sensor; and obtains the first optical flow speed of the UAV according to the first video data;
[0049] Acquire second video data of the lower pipe wall in the transverse pipe when the drone flies in the transverse pipe through the lower optical flow sensor; and acquire a second optical flow velocity of the drone based on the second video data;
[0050] The first estimated speed obtained when the UAV first obtains the first estimated speed is used as the second estimated speed of the UAV;
[0051] The second optical flow speed and the second estimated speed at this time are fused through the Kalman data fusion algorithm to obtain the first estimated speed of the UAV. Finally, the UAV fuses the first optical flow speed and the first estimated speed through the Kalman data fusion algorithm to obtain the first estimated speed of the UAV.
[0052] In this embodiment, in the process of obtaining the first optical flow speed of the drone based on the first video data, the drone discretizes the first video data and converts it into continuous image data; the corner points in each group of image data are extracted through a corner point detection algorithm; the corner points in two groups of image data of adjacent frames are brought into the optical flow algorithm to obtain the first optical flow speed of the drone, wherein the corner points are points in the image where the brightness changes significantly. In this application, the first optical flow speed of the drone is measured by obtaining the corner points in the image data, which can greatly improve the accuracy of measuring the optical flow.
[0053] In this embodiment, in the process of fusing the first optical flow velocity and the first estimated velocity through the Kalman data fusion algorithm to obtain the first estimated velocity of the UAV: the number of corner points in the image data is obtained, and the noise parameter of the image data is adjusted according to the number of corner points; the Kalman gain is calculated according to the noise parameter; the weighting coefficient of the first optical flow velocity and the weighting coefficient of the first estimated velocity are obtained according to the Kalman gain, and the first optical flow velocity and the first estimated velocity are multiplied by the weighting coefficient respectively and then added to obtain the first estimated velocity of the UAV. In this embodiment, after the first optical flow velocity and the first estimated velocity are weighted and superimposed according to the Kalman gain to obtain the first estimated velocity of the UAV, the accuracy of the UAV state estimation is greatly improved, and the accuracy of the UAV positioning is further improved.
[0054] The present invention also discloses a system for measuring the flight speed of a drone in an underground pipeline, comprising an upper optical flow sensor, a control module and a Kalman filter, wherein the upper optical flow sensor is arranged above the drone, and the upper optical flow sensor and the Kalman filter are both electrically connected to the control module. The upper optical flow sensor is used to obtain the first video data of the upper pipe wall in the transverse pipeline when the drone flies in the transverse pipeline; and obtain the first optical flow speed of the drone according to the first video data; after the control module obtains the first estimated speed of the drone; the control module transmits the first optical flow speed and the first estimated speed to the Kalman filter, and the Kalman filter fuses the first optical flow speed and the first estimated speed according to the Kalman data fusion algorithm to obtain the first estimated speed of the drone. In this embodiment, since the accumulated water in the transverse pipeline is located on the lower pipe wall of the transverse pipeline, and the upper pipe wall of the transverse pipeline is affected by gravity and will not accumulate water, in the embodiment, by obtaining the first video data of the upper pipe wall when the drone flies in the transverse pipeline, and according to the first video data, a more accurate first optical flow speed can be obtained, thereby greatly increasing the accuracy of the drone positioning.
[0055] In this embodiment, the system for measuring the flying speed of a UAV in an underground pipeline also includes a lower optical flow sensor, which is arranged above the UAV and electrically connected to the control module. The lower optical flow sensor is used to obtain second video data of the lower pipe wall in the transverse pipeline when the UAV flies in the transverse pipeline; and obtain the second optical flow velocity of the UAV based on the second video data; in the process of the control module obtaining the first estimated speed of the UAV, the control module obtains the second estimated speed of the UAV through the physical model of the UAV; the control module transmits the second optical flow velocity and the second estimated speed to the Kalman filter, and the Kalman filter fuses the second optical flow velocity and the second estimated speed according to the Kalman data fusion algorithm to obtain the first estimated speed of the UAV. In this embodiment, the first estimated speed calculated by the lower optical flow sensor is fused with the first optical flow velocity obtained by the upper optical flow sensor to obtain a more accurate first estimated speed of the UAV, thereby increasing the robustness of the UAV and further improving the accuracy of UAV positioning.
[0056] In this embodiment, when the UAV flies in a transverse pipe, the control module of the UAV needs to obtain the first estimated speed of the UAV in real time. In the process of obtaining the first estimated speed of the UAV in real time, the control module of the UAV will iteratively update the second estimated speed of the UAV, thereby achieving a more accurate positioning effect.
[0057] When the control module first obtains the first estimated speed, it calculates the current second estimated speed of the drone through the physical model of the drone. The drone fuses the second optical flow speed and the second estimated speed through the Kalman data fusion algorithm to obtain the first estimated speed of the drone, and fuses the first estimated speed calculated by the lower optical flow sensor with the first optical flow speed obtained by the upper optical flow sensor to obtain a more accurate first estimated speed of the drone.
[0058] When the control module is not acquiring the first estimated speed for the first time, the control module uses the first estimated speed acquired last time as the second estimated speed required for acquiring the first estimated speed this time, and calculates a more accurate first estimated speed using the second estimated speed required for acquiring the first estimated speed this time, thereby greatly improving the accuracy of measuring optical flow.
[0059] In this embodiment, the upper optical flow sensor obtains the first optical flow speed of the drone based on the first video data: the upper optical flow sensor discretizes the first video data and converts it into continuous image data; the corner points in each group of image data are extracted through a corner point detection algorithm; the upper optical flow sensor brings the corner points in two groups of image data of adjacent frames into the optical flow algorithm to obtain the first optical flow speed of the drone. In this application, the accuracy of measuring the optical flow can be greatly improved by obtaining the corner points in the image data to measure the first optical flow speed of the drone.
[0060] In this embodiment, the Kalman filter fuses the first optical flow velocity and the first estimated velocity through the Kalman data fusion algorithm to obtain the second estimated velocity of the UAV: the Kalman filter obtains the number of corner points in the image data, and adjusts the noise parameter of the image data according to the number of corner points; the Kalman gain is calculated according to the noise parameter; the weighting coefficient of the first optical flow velocity and the weighting coefficient of the first estimated velocity are obtained according to the Kalman gain, the first optical flow velocity and the first estimated velocity are multiplied by the weighting coefficient respectively and then added to obtain the second estimated velocity of the UAV. In this embodiment, after the first optical flow velocity and the first estimated velocity are weighted and superimposed according to the Kalman gain to obtain the first estimated velocity of the UAV, the accuracy of the UAV state estimation is greatly improved, and the accuracy of the UAV positioning is further improved.
[0061] The above disclosures are only several specific embodiments of the present invention, but the present invention is not limited thereto, and any changes that can be conceived by those skilled in the art should fall within the protection scope of the present invention.
Claims
1. A method for measuring the flight speed of a drone in an underground pipeline, wherein the underground pipeline includes a transverse pipeline, the drone is controlled to fly horizontally along the transverse pipeline, and an upper optical flow sensor is arranged above the drone, characterized in that: include: Acquire, by means of an upper optical flow sensor, first video data of an upper pipe wall in the transverse pipe when the drone flies in the transverse pipe; and obtaining a first optical flow velocity of the drone according to the first video data; Get the first estimated speed of the drone; The first optical flow velocity and the first estimated velocity are fused by a Kalman data fusion algorithm to obtain a first estimated velocity of the drone.
2. The method for measuring the flying speed of a drone in an underground pipeline according to claim 1, wherein a lower optical flow sensor is provided below the drone, and the characteristics are: The method of obtaining the first estimated speed of the UAV includes: obtaining second video data of the lower pipe wall in the transverse pipe when the UAV flies in the transverse pipe through the lower optical flow sensor, and obtaining the second optical flow speed of the UAV based on the second video data; obtaining the second estimated speed of the UAV through the physical model of the UAV; and fusing the second optical flow speed and the second estimated speed through the Kalman data fusion algorithm to obtain the first estimated speed of the UAV.
3. The method for measuring the flying speed of a drone in an underground pipeline according to claim 1, wherein a lower optical flow sensor is provided below the drone, and the characteristics are: After the first estimated speed of the drone is first acquired, the first optical flow speed and the first estimated speed acquired for the first time are fused by a Kalman data fusion algorithm to obtain a first estimated speed of the drone for the first time; Iteratively updating the second estimated speed of the drone according to the first estimated speed of the drone, so as to obtain an iteratively updated second estimated speed; The second optical flow velocity and the iteratively updated second estimated velocity are fused through a Kalman data fusion algorithm to continuously obtain a first estimated velocity of the drone.
4. The method for measuring the flight speed of a drone in an underground pipeline according to claim 1, characterized in that: The obtaining of the first optical flow velocity of the drone according to the first video data comprises: Discretizing the first video data to obtain a plurality of continuous sets of image data; Extracting corner points in each group of image data by using a corner detection algorithm; The corner points in the two sets of image data in adjacent frames are brought into the optical flow algorithm to obtain the first optical flow speed of the drone.
5. The method for measuring the flight speed of a drone in an underground pipeline according to claim 4, characterized in that: The fusing the first optical flow speed and the first estimated speed by using the Kalman data fusion algorithm to obtain the second estimated speed of the drone includes: Acquiring the number of corner points in the image data, and adjusting the noise parameter of the image data according to the number of corner points; The Kalman gain is calculated according to the noise parameter; A weighting coefficient of the first optical flow velocity and a weighting coefficient of the first estimated velocity are obtained according to the Kalman gain, and the first optical flow velocity and the first estimated velocity are multiplied by the weighting coefficients and then added to obtain a first estimated velocity of the drone.
6. A system for measuring the flight speed of a drone in an underground pipeline, characterized in that: include: an upper optical flow sensor, disposed above the drone, for acquiring first video data of an upper pipe wall in the transverse pipe when the drone flies in the transverse pipe; and obtaining a first optical flow velocity of the drone according to the first video data; A control module, the control module is used to obtain a first estimated speed of the drone; Kalman filter, the upper optical flow sensor and the Kalman filter are both electrically connected to the control module, the control module transmits the first optical flow speed and the first estimated speed to the Kalman filter, and the Kalman filter fuses the first optical flow speed and the first estimated speed according to the Kalman data fusion algorithm to obtain the first estimated speed of the drone.
7. The system for measuring the flying speed of a drone in an underground pipeline according to claim 6, characterized in that: Also includes: A lower optical flow sensor is arranged above the drone and is electrically connected to the control module, and is used to obtain second video data of the lower pipe wall in the transverse pipe when the drone flies in the transverse pipe; and obtain a second optical flow velocity of the drone according to the second video data; In the process of the control module acquiring the first estimated speed of the drone, the control module acquires the second estimated speed of the drone through the physical model of the drone; The control module transmits the second optical flow speed and the second estimated speed to the Kalman filter, and the Kalman filter fuses the second optical flow speed and the second estimated speed according to the Kalman data fusion algorithm to obtain the first estimated speed of the drone.
8. The system for measuring the flying speed of a drone in an underground pipeline according to claim 7, characterized in that: After the first estimated speed of the drone is first acquired, the first optical flow speed and the first estimated speed acquired for the first time are fused by the Kalman filter Kalman data fusion algorithm to obtain the first estimated speed of the drone for the first time; Iteratively updating the second estimated speed of the drone according to the first estimated speed of the drone, so as to obtain an iteratively updated second estimated speed; The second optical flow velocity and the iteratively updated second estimated velocity are fused through a Kalman data fusion algorithm to continuously obtain a first estimated velocity of the drone.
9. The system for measuring the flying speed of a drone in an underground pipeline according to claim 6, characterized in that: The specific process of the upper optical flow sensor acquiring the first optical flow speed of the drone according to the first video data includes: The upper optical flow sensor discretizes the first video data to obtain a plurality of continuous sets of image data; Extracting corner points in each group of image data by using a corner detection algorithm; The corner points in the two sets of image data in adjacent frames are brought into the optical flow algorithm to obtain the first optical flow speed of the drone.
10. The system for measuring the flying speed of a drone in an underground pipeline according to claim 9, characterized in that: The Kalman filter fuses the first optical flow velocity and the first estimated velocity through a Kalman data fusion algorithm to obtain a second estimated velocity of the drone, which includes: The Kalman filter obtains the number of corner points in the image data, and adjusts the noise parameter of the image data according to the number of corner points; and calculates the Kalman gain according to the noise parameter; A weighting coefficient of the first optical flow velocity and a weighting coefficient of the first estimated velocity are obtained according to the Kalman gain, and the first optical flow velocity and the first estimated velocity are multiplied by the weighting coefficients and then added to obtain a second estimated velocity of the UAV.
Citation Information
Patent Citations
Methods for estimating the horizontal speed of drones, especially those capable of hovering under autopilot.
CN102298070A
Unmanned aerial vehicle position estimation system and estimation method based on visual sensor
CN113110556A
Power transmission line unmanned aerial vehicle infrared autonomous inspection method based on optical flow and Kalman filtering
CN115018883A
Unmanned aerial vehicle for pipeline detection and pipeline detection system
CN116906735A
Drone for surface defects inspection
WO2020139195A1
