The invention discloses an unmanned aerial vehicle
visual navigation method based on
deep learning, and belongs to the field of navigation, and the method comprises the steps: collecting image information, including a
color image and a depth image, of a surrounding environment through a high-resolution visual sensor carried by an unmanned aerial vehicle; meanwhile,
inertial measurement unit data of the unmanned aerial vehicle is collected for assisting attitude
estimation and motion compensation; preprocessing the collected
color image, including but not limited to denoising,
contrast enhancement and
color balance operations; according to the method, through multi-
modal feature extraction and fusion, the advantages of a
color image, a depth image and IMU data are fully utilized, the
perception ability to the environment is improved, through constructing an adaptive mixed learning model,
deep learning and
reinforcement learning are combined, autonomous navigation decision of the unmanned aerial vehicle is realized, and the method is suitable for being popularized and applied. According to the invention, scene identification and segmentation are carried out on the color image by using the semantic segmentation network, the unmanned aerial vehicle can be helped to identify passable areas and obstacles, and the
navigation safety is improved.