The invention relates to the technical field of multi-
modal interaction, in particular to a multi-
modal interaction control method and
system for a sweeping
robot, and the method comprises the following steps: collecting voice and gesture input, extracting voice trigger information and action features, generating a
modal frequency mark and an
instruction list, matching a task path, and generating a modal identification table. The method comprises the following steps: extracting and comparing action sequences to recognize a master
control mode, analyzing continuity to generate a response mark, and screening consistent input to generate an interaction instruction result. In the method, through extracting time, quantity and confidence characteristics of voice and gesture input, establishing frequency and trigger marks of multi-mode input, realizing accurate recognition of an input state; a task path and semantic content are combined to carry out space and
semantic matching, the task relevance judgment capability is improved, based on
action code comparison, dominant
modes are identified, conflict instructions are eliminated, the master control status of each mode in continuous tasks is dynamically balanced, the control response accuracy is improved, and an interaction mechanism with intelligent judgment capability is constructed.