The invention belongs to the technical field of digital
surgery, and particularly relates to a hysteroscope
surgical robot control method and
system based on multi-
modal perception. The method comprises the steps of collecting multi-
modal input signals such as visual, auditory, tactile, force sense and
pose signals, uniformly performing
time synchronization and
perception track construction, and combining semantic behavior intention
inference and tactile opportunity judgment to realize multi-dimensional consistency
verification of operation instructions. And after the judgment result is valid, extracting control execution parameters, driving the mechanical arm to perform accurate operation, recording an execution process and updating a control threshold value to optimize feedback performance. The
system comprises an input
signal acquisition module, a six-dimensional
force sensor module, a semantic
inference module, a
modal fusion module and the like, a closed-loop structure from sensing to control is constructed, and the operation precision, the interaction stability and the safety response capability of the hysteroscope
robot in an operation are remarkably improved.