Underground unmanned aerial vehicle positioning system and method

Through the combination of IMU, UWB tags and lidar, a three-dimensional coordinate system for underground drones was established, which solved the problem of low positioning accuracy of underground drones in mines, achieved more accurate position acquisition and control, and supported coal mine inspections Safe and efficient management.

CN119012125APending Publication Date: 2024-11-22NINGXIA IND & INFORMATION TECHNOLOGY RESEARCH INSTITUTE CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411055428.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-02
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The positioning of underground drones in mines faces satellite positioning signal attenuation, complex geological conditions and electromagnetic interference, resulting in low positioning accuracy. The existing UWB technology can only realize one-dimensional linear maps and lack the ability to locate other dimensions of the drone.

Method used

UWB positioning system using IMU, UWB tags and lidar, establish underground drone coordinate systems including world coordinate systems and aircraft coordinate systems, obtain their own posture information through IMU, and obtain one-dimensional position information of UWB tags and base stations. Lidar Obtain height information and combine the depth distance information between the monocular camera and the tunnel light to achieve the establishment of a three-dimensional coordinate system.

Benefits of technology

It realizes more accurate positioning of drones under the mine, improves positioning accuracy and control reliability, can obtain accurate position information of drones in real time, and supports safer and more efficient coal mine inspections.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119012125A_ABST
    Figure CN119012125A_ABST
Patent Text Reader

Abstract

The invention provides an underground unmanned aerial vehicle positioning system and method, and relates to the technical field of unmanned aerial vehicle positioning. The system comprises an unmanned aerial vehicle for flight operation under a mine, a controller for performing flight motion control on the unmanned aerial vehicle according to information of a UWB positioning system, an IMU for acquiring attitude information of the unmanned aerial vehicle, and a laser radar for acquiring flight height information of the unmanned aerial vehicle in a roadway, the UWB base stations are arranged in a mine at intervals and used for allowing the unmanned aerial vehicle to fly through, and the UWB labels are used for communicating with the UWB base stations to obtain one-dimensional position information of the unmanned aerial vehicle in the roadway. By means of the unmanned aerial vehicle positioning system, the underground unmanned aerial vehicle coordinate system including the world coordinate system and the aircraft coordinate system is established, the displacement information of the unmanned aerial vehicle and the one-dimensional position information and height information of the unmanned aerial vehicle in the roadway are obtained, and more accurate positioning of the unmanned aerial vehicle under the mine is achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of unmanned aerial vehicle positioning, and in particular to a system and method for positioning an unmanned aerial vehicle in a mine. Background Art

[0002] At present, the inspection tasks in coal mines still face many challenges. Although many domestic coal mines still rely on traditional manual inspection methods, this method is easily affected by human factors, such as the experience, skills, work attitude and health status of the inspectors, which may reduce the reliability of the inspection. In addition, the underground environment of coal mines is complex and dangerous, filled with harmful gases, which poses a serious threat to the safety of inspectors. When an emergency occurs in a coal mine, especially in remote or unmanned areas, the response and emergency handling capabilities of manual inspections are relatively weak, and remote command and dispatch are also difficult. Therefore, from the perspective of improving the reliability, efficiency, safety and controllability of inspections, the use of drones for automatic inspections in coal mines is gradually becoming a development trend. Inspection drones can not only perform inspection tasks stably and continuously, but also work in dangerous environments, reduce personnel safety risks, and improve inspection efficiency and accuracy through intelligent means. With the continuous advancement of technology and the gradual reduction of costs, drones are expected to be more widely used in the coal mining industry, providing strong support for safe production and efficient management of coal mines.

[0003] The precise positioning of drones in mines is the basis for reliable inspections. At present, the positioning of drones in mines faces several major difficulties. First, since the satellite positioning signal has been severely attenuated when it passes through the coal mine layer and reaches the underground, satellite positioning cannot be applied to the positioning of drones in mines. Secondly, the geological conditions in coal mines are complex and changeable. Obstacles and rough tunnel walls will have a serious impact on the transmission and reception, reflection and scattering of signals, forming a multipath effect of underground signals. Finally, the complex electromagnetic environment will cause serious interference to the propagation of signals, resulting in large positioning accuracy errors or even failure, and high power consumption. Considering the above difficulties, ultra-wideband (UWB) technology has become the mainstream method for positioning in mines at this stage. UWB does not use traditional carriers to transmit data, but uses impulse pulses with a width of nanoseconds (ns) or even picoseconds (ps) to transmit information. In the frequency domain, the bandwidth of UWB far exceeds the general narrowband and broadband, which enables UWB to transmit information in a very wide frequency band, thereby achieving high data transmission rate and lower power spectrum density in mines, as well as centimeter-level or even millimeter-level positioning accuracy. However, due to the high cost of underground wiring in mines, the current coverage of UWB in mines can only establish a one-dimensional linear map of the mine, and lacks the ability to locate drones in other dimensions.

[0004] Based on this, the present invention is proposed. Summary of the invention

[0005] The purpose of the present invention is to provide a system and method for positioning an underground UAV in a mine. Through a UWB positioning system including an IMU, a UWB tag, and a laser radar, a coordinate system of an underground UAV in a mine including a world coordinate system and an aircraft coordinate system is established to obtain the displacement information of the UAV itself, the one-dimensional position information and the height information of the UAV in the tunnel, so as to achieve more accurate positioning.

[0006] To achieve the above object, the present invention provides the following technical solutions:

[0007] In a first aspect, the present invention provides a mine underground UAV positioning system, comprising: a UAV hardware system and a UWB positioning system; wherein the UAV hardware system comprises:

[0008] Drones, used for flying operations underground in mines;

[0009] A controller, used to control the flight motion of the UAV according to the information of the UWB positioning system;

[0010] IMU, mounted on the drone, is used to obtain the drone’s own attitude information;

[0011] The laser radar is mounted on the top of the drone and is used to obtain the drone's flight altitude information in the tunnel.

[0012] Wherein, the UWB positioning system includes:

[0013] Multiple UWB base stations are deployed at intervals in the mine tunnels through which drones fly;

[0014] The UWB tag is installed on the UAV and is used to communicate with the multiple UWB base stations to obtain the one-dimensional position information of the UAV in the lane.

[0015] In a second aspect, the present invention provides a method for positioning an underground UAV in a mine, which utilizes the above-mentioned underground UAV positioning system, including: establishing an underground UAV coordinate system; the underground UAV coordinate system includes a world coordinate system and an aircraft coordinate system; obtaining the UAV's own displacement information in the aircraft coordinate system through an IMU installed on the UAV; obtaining the one-dimensional position information of the UAV in the tunnel in the aircraft coordinate system through a UWB base station deployed in the tunnel and a UWB tag installed on the UAV, thereby obtaining the x-axis coordinate information of the UAV in the world coordinate system; and obtaining the y-axis coordinate of the UAV in the world coordinate system through a laser radar installed on the UAV.

[0016] Compared with the prior art, the above technical solution has the following advantages:

[0017] (1) The present invention establishes a UWB positioning system in a mine including a world coordinate system and an aircraft coordinate system through a UWB positioning system including an IMU, a UWB tag, and a laser radar, obtains the displacement information of the UAV itself, the one-dimensional position information and the height information of the UAV in the tunnel, and realizes more accurate positioning of the UAV in the mine.

[0018] (2) The present invention also deploys multiple tunnel lights at intervals in the tunnel, and estimates the depth distance information between the drone and the tunnel lights through a monocular camera installed on the drone, and also establishes a camera coordinate system and a tunnel light coordinate system. First, the drone's own displacement information in the aircraft coordinate system is obtained through the IMU, and then the one-dimensional position information of the drone in the tunnel is obtained through the UWB base station deployed in the tunnel and the UWB tag installed on the drone, thereby obtaining the x-axis coordinate information of the drone in the world coordinate system; the y-axis coordinate of the drone in the world coordinate system is obtained through the laser radar, and the depth distance information between the monocular camera and the tunnel light is estimated through the monocular camera set on the drone, and the z-axis coordinate of the drone in the world coordinate system is obtained. Finally, the three-dimensional coordinate information of the drone in the world coordinate system is obtained, so as to better realize real-time and accurate acquisition of the precise position information of the drone when it flies in the mine, so as to better control the flight movement of the drone. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0020] Figure 1 A schematic diagram of a UAV positioning system for an underground mine provided by a specific embodiment of the present invention;

[0021] Figure 2 A schematic diagram of a mine system provided for a specific implementation of the present invention;

[0022] Figure 3 A control block diagram of an underground UAV provided in a specific embodiment of the present invention;

[0023] Figure 4 A schematic diagram of a lane map definition provided by a specific implementation method of the present invention;

[0024] Figure 5 A schematic diagram of the coordinate system definition of an underground UAV in a mine provided by a specific implementation method of the present invention.

[0025] Figure numerals: ① is UWB base station, ② is drone, ③ is lane light, ④ is ground support cabin, ⑤ is lidar, ⑥ is IMU, ⑦ is monocular camera, ⑧ is UWB tag, and ⑨ is controller. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] Example 1

[0028] This embodiment provides a mine underground drone positioning system, including a drone hardware system and a UWB positioning system; wherein the drone hardware system mainly includes the following devices: drone ②, used for flying operations in the mine; controller ⑨, used to control the flight motion of the drone according to the information of the UWB positioning system; IMU (inertial sensor) ⑥, mounted on the drone, used to obtain the drone's own attitude information; laser radar ⑤, mounted on the top of the drone, used to obtain the flight altitude information of the drone in the tunnel. Among them, the UWB positioning system mainly includes the following devices: UWB tag ⑧, installed on the drone, used to communicate with multiple UWB base stations to obtain the one-dimensional position information of the drone in the tunnel, and the controller ⑨ controls the flight motion of the drone according to the information; multiple UWB base stations ①, deployed at intervals in the mine for the drone to fly through the tunnel.

[0029] This embodiment also provides a method for positioning a UAV in a mine. The UAV positioning system in a mine of this embodiment is used to determine the position information of the UAV in the mine mainly by establishing a UAV coordinate system in the mine, including the following steps:

[0030] (1) Establish the world coordinate system (O w -X w Y w Z w ) and the aircraft coordinate system (O b -X b Y b Z b ):

[0031] (2) The IMU installed on the drone is used to obtain the drone’s own attitude information in the local coordinate system of the aircraft;

[0032] (3) The one-dimensional position coordinates of the UAV in the alley are obtained through the UWB base station deployed in the alley and the UWB tag installed on the UAV. The one-dimensional coordinates use the aircraft coordinate system to represent the direction and distance. The x-axis coordinate information of the UAV in the world coordinate system is further obtained through the coordinate conversion from the aircraft coordinate system to the world coordinate system.

[0033] (4) The y-axis coordinate of the UAV in the world coordinate system is obtained by installing a laser radar on the UAV. The laser radar is installed on the UAV with its field of view facing the top of the tunnel, so as to obtain the distance between the UAV and the top of the tunnel.

[0034] Through the positioning system of this embodiment, a UAV coordinate system is established in the mine, including a world coordinate system and an aircraft coordinate system, and the UAV's own attitude information, one-dimensional position information and height information of the UAV in the tunnel are obtained, so as to achieve more accurate positioning of the UAV in the mine.

[0035] Example 2

[0036] Please refer to Figure 1 This embodiment provides a more preferred underground UAV positioning system, including a UAV hardware system and a UWB positioning system; wherein the UAV hardware system mainly includes the following devices: a UAV ②, used for flight operations in the mine; a controller ⑨, used to control the flight motion of the UAV according to the information of the UWB positioning system; an IMU (inertial sensor) ⑥, mounted on the UAV, used to obtain the UAV's own posture information; a laser radar ⑤, mounted on the UAV, used to obtain the flight altitude information of the UAV in the tunnel; a monocular camera ⑦, installed on the UAV, used to estimate the depth distance information between the UAV and the tunnel lights. Among them, the UWB positioning system mainly includes the following devices: multiple UWB base stations ①, deployed at intervals in the tunnels in the mine for the UAV to fly through; a UWB tag ⑧, installed on the UAV, used to communicate with multiple UWB base stations to obtain the one-dimensional position information of the UAV in the tunnel, and the controller ⑨ controls the flight motion of the UAV based on the information. Please refer to Figure 2 , Figure 3 In the mine tunnel of this embodiment, the following devices are also arranged: multiple tunnel lights ③, which are deployed at intervals in the tunnel; a ground support cabin ③, which is set in the tunnel under the mine and serves as a docking and energy supply station for drones.

[0037] In the mine line, a UWB base station and a tunnel light are placed at intervals. The drone communicates with the UWB base station during flight, continuously updates the distance information, and determines its own location by identifying the tunnel lights. Figure 3As shown in the control block diagram of the drone in the mine, various sensors in the drone hardware system obtain various environmental information of the drone through lidar, IMU, monocular camera and UWB. The precise positioning of the drone in the mine can be obtained by fusing the UWB positioning information with the obtained environmental information.

[0038] This embodiment also provides a more preferred method for positioning a UAV in a mine. The UAV positioning system in a mine in this embodiment is mainly used to determine the location information of the UAV in the mine by establishing a UAV coordinate system in the mine. The UWB positioning system can obtain the one-dimensional location information of the UAV in the mine through the UWB base station deployed in the tunnel and the tag installed on the UAV body. The mine tunnel map is defined as follows: Figure 4 As shown, Figure 4 The world coordinate system is defined in the figure, where the flight direction toward the front of the tunnel is the x-axis, the direction from the drone to the top of the mine tunnel is the y-axis, and the z-axis direction can be expressed by the right-hand rule; and the position relationship and direction definition of the drone and UWB base station in the tunnel are described.

[0039] Specifically, the steps include:

[0040] (1) Establish the world coordinate system (O w -X w Y w Z w ), aircraft coordinate system (O b -X b Y b Z b ), camera coordinate system (O c -X c Y c Z c ), Lane Light Coordinate System (O l -X l Y l Z l ), ground handling module coordinate system (O g -X g Y g Z g )like Figure 5 As shown: The drone obtains displacement information in the aircraft coordinate system based on its own sensors, such as the depth distance z from the target object e , and the distance y from the top of the tunnel e etc. e is the depth distance to the roadway light measured by the monocular camera, y e It is the depth distance to the top of the tunnel measured by lidar.

[0041] (2) The UAV’s own displacement information in the aircraft coordinate system is obtained through the IMU installed on the UAV. (3) The one-dimensional position information of the UAV in the alley in the aircraft coordinate system is obtained through the UWB base station deployed in the alley and the UWB tag installed on the UAV, thereby obtaining the x-axis coordinate information of the UAV in the world coordinate system.

[0042] (4) The y-axis coordinate of the UAV in the world coordinate system is obtained by installing a laser radar on the UAV. The laser radar is installed on the UAV with its field of view facing the top of the tunnel, so as to obtain the distance between the UAV and the top of the tunnel.

[0043] (5) The depth distance information between the monocular camera and the roadway light is estimated by using the monocular camera installed on the UAV. Since the relative position of the aircraft coordinate system and the camera coordinate system is known, the z-axis coordinate of the UAV in the world coordinate system can be obtained based on the depth distance information between the monocular camera and the roadway light, and finally the three-dimensional coordinate information of the UAV in the world coordinate system can be obtained.

[0044] The coordinate system of the UAV in the mine also includes the coordinate system of the ground cabin. The coordinate system of the ground cabin is set as fixed coordinate information according to the world coordinate system. The UAV is controlled to return to the ground cabin accurately according to the coordinate information of the ground cabin.

[0045] In summary, the difference between Example 2 and Example 1 is that this embodiment also deploys multiple tunnel lights at intervals in the tunnel, and estimates the depth distance information between the drone and the tunnel lights through a monocular camera installed on the drone, and also establishes a camera coordinate system and a tunnel light coordinate system. First, the drone's own displacement information in the aircraft coordinate system is obtained through the IMU, and then the one-dimensional position information of the drone in the tunnel is obtained through the UWB base station deployed in the tunnel and the UWB tag installed on the drone, thereby obtaining the x-axis coordinate information of the drone in the world coordinate system; the y-axis coordinate of the drone in the world coordinate system is obtained through the laser radar, and the depth distance information between the monocular camera and the tunnel light is estimated through the monocular camera set on the drone, and the z-axis coordinate of the drone in the world coordinate system is obtained, and finally the three-dimensional coordinate information of the drone in the world coordinate system is obtained, so as to better realize real-time and accurate acquisition of precise position information of the drone when it flies in the mine, so as to better control the flight movement of the drone.

[0046] The above is a detailed introduction to a mine drone positioning system and method provided by the present application. This article uses specific examples to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the scope of protection of the claims of the present application.

Claims

1. A mine drone positioning system, characterized in that: include: UAV hardware system and UWB positioning system; wherein the UAV hardware system includes: Drones, used for flying operations underground in mines; A controller, used to control the flight motion of the UAV according to the information of the UWB positioning system; Sensors, including IMU and LiDAR, are used to obtain the drone’s own position information and environmental map information; Among them, the IMU sensor is mounted on the drone to obtain the drone's own posture information; The laser radar sensor is mounted on the top of the drone to obtain the flight altitude information of the drone in the tunnel; Wherein, the UWB positioning system includes: Multiple UWB base stations are deployed at intervals in the mine tunnels through which drones fly; The UWB tag is installed on the UAV and is used to communicate with the multiple UWB base stations to obtain the one-dimensional position information of the UAV in the lane.

2. The underground mine drone positioning system according to claim 1, characterized in that: The drone hardware system also includes: a plurality of lane lights, which are deployed at intervals in the lane; the drone hardware system also includes: a monocular camera, which is installed on the drone and is used to estimate the depth distance information between the drone and the lane lights.

3. The underground mine drone positioning system according to claim 2, characterized in that: Also includes: The ground support cabin is set up in the tunnel under the mine and serves as a docking and energy supply station for drones.

4. A method for positioning an underground UAV in a mine, using the underground UAV positioning system in a mine as described in any one of claims 1 to 3, characterized in that: include: Establishing a coordinate system of an unmanned aerial vehicle in a mine; the coordinate system of the unmanned aerial vehicle in a mine includes a world coordinate system and an aircraft coordinate system; The IMU installed on the drone is used to obtain the drone's own posture information in the aircraft coordinate system. The UWB base station deployed in the tunnel and the UWB tag installed on the drone are used to obtain the one-dimensional position information of the drone in the tunnel in the aircraft coordinate system, thereby obtaining the x-axis coordinate information of the drone in the world coordinate system. The y-axis coordinate of the drone in the world coordinate system is obtained by the laser radar installed on the drone.

5. The method for positioning an unmanned aerial vehicle in a mine according to claim 4, characterized in that: The laser radar field of view is installed on the drone toward the top of the tunnel, so as to obtain the distance between the drone and the top of the tunnel.

6. The method for positioning an unmanned aerial vehicle in a mine according to claim 4 or 5, characterized in that: The coordinate system of the underground UAV in the mine also includes a camera coordinate system and a tunnel light coordinate system: the depth distance information between the monocular camera and the tunnel light is estimated by using a monocular camera arranged on the UAV. Since the relative position of the local coordinate system of the aircraft itself and the camera coordinate system is known, the z-axis coordinate of the UAV in the world coordinate system can be obtained according to the depth distance information between the monocular camera and the tunnel light, and finally the three-dimensional coordinate information of the UAV in the world coordinate system is obtained.

7. The method for positioning an unmanned aerial vehicle in a mine according to claim 6, characterized in that: The underground UAV coordinate system also includes a ground cabin coordinate system, which is set as fixed coordinate information according to the world coordinate system, and controls the UAV to accurately return to the ground cabin according to the coordinate information of the ground cabin.