The application relates to the field of
aviation display and
augmented reality technology, in particular to a head-mounted HUD perspective display and
control system based on multi-source fusion, which is suitable for aircrafts and comprises a multi-
source data acquisition module, a unified space-time calibration module, a positioning and attitude sensing module, an
image registration and perspective view generation module, a display imaging module and a mode triggering and management module. The
system supports
multiple modes such as extravehicular perspective mode, cargo cabin perspective mode and passenger cabin perspective mode, can fuse visible light data and thermal
imaging data, is suitable for rapid
situation awareness and safety decision in flight operation and ground operation, and through combination of multi-source camera acquisition, AI position and attitude registration, space registration and perspective mapping, multi-mode intelligent switching and
delay fault tolerance mechanism, the perspective display of extravehicular, cargo cabin and passenger cabin in the flight operation scene and the ground operation scene is well realized, and the
situation awareness and emergency disposal capability of pilots and
ground staff is significantly improved.