The invention discloses a POS prior assisted heterogeneous unmanned aerial vehicle fine
thermal infrared color
point cloud generation method, which comprises the following steps: 1) based on a conventional
photogrammetry method,
processing a visible light image and POS data thereof, and generating a dense
point cloud with geographic reference information; 2) selecting homonymy points in the
thermal infrared image and the dense
point cloud, and solving exterior orientation elements of the
thermal infrared camera in a point cloud coordinate
system by adopting a resection
algorithm; 3) completing geometric calibration between the thermal
infrared camera and the GNSS / IMU
system in combination with POS data of the thermal
infrared image; 4) establishing a
spatial mapping relation based on the calibration parameters and the POS information, mapping the thermal
infrared image to the visible light point cloud, and generating a preliminary thermal infrared color point cloud; 5) constructing a
virtual camera consistent with the thermal infrared camera in parameter, and projecting the point cloud to generate a two-dimensional image; 6) performing different-
source image registration on the
projection image and the thermal
infrared image by using a
deep learning network with phase consistency and dense
feature matching to obtain a relative orientation parameter; and 7) performing spatial correction on the initial thermal infrared color point cloud according to the relative orientation parameter to obtain a fine thermal infrared color point cloud. The fusion of the thermal
infrared image and the visible light point cloud of the heterogeneous unmanned aerial vehicle platform is realized under the limiting conditions of missing pre-calibration information,
low resolution of the thermal
infrared image, load separation of the visible light camera and the thermal infrared camera and the like, and the method has the advantages of high spatial precision and good adaptability.