The invention discloses an incomplete multi-mode learning method based on graph routing and prompt
distillation, which comprises the following steps of: firstly, constructing a mode sensing routing and element self-adaptive prompt
distillation framework oriented to incomplete multi-mode learning, capturing a dependency relationship between condition
modes through a mode sensing graph to obtain fusion representation, and then activating a special path by sparse routing to obtain a fusion representation; according to the method, a low-rank adapter and a meta-adaptive prompt are generated, flexible fusion aiming at various missing
modes is realized, finally, uncertainty
perception distillation is adopted to carry out final cross-
modal reasoning and robust learning, and incomplete multi-
modal learning is realized. According to the method, a mode
perception element prompt framework is provided, uncertainty
perception prompt distillation is designed, the problem that a multi-mode learning model faces mode deficiency uncertainty and the problem that the multi-mode learning model faces mode deficiency performance suboptimum are solved, instance self-adaptive reasoning is achieved, and the method has the advantages of being simple in structure, convenient to operate and high in practicability. Reliable cross-
modal knowledge migration and coherent representation learning can be realized in various missing scenes.