The invention relates to the technical field of
natural language processing, in particular to a multi-
modal interactive intelligent NPC dialogue intention matching method and
system. The method comprises the following steps: collecting multi-
modal data in real time, and generating multi-
modal semantic features through sub-modal preprocessing; a cross-modal fusion module based on
semantic association is adopted to integrate each modal
semantic feature, and an intention candidate set is generated based on
semantic context representation and in combination with a semantic analysis module and a predefined intention template; through a continuous
semantic learning mechanism and an interactive
memory module, in combination with a Bayesian updating method, tracking user intention change in real time, dynamically adjusting the confidence of each intention in the intention candidate set, and screening a final intention; constructing an NPC semantic
cognition model, and performing semantic check on
user input and an NPC dialogue state through
semantic consistency analysis; generating a dialogue strategy in combination with the final intention and a decision engine, and outputting synchronous response content; according to the invention, the precision of intelligent dialogue intention dynamic matching is improved.