The invention discloses a multi-
modal sensing and self-adaptive decision-making intelligent instrument
robot system and method. The
system comprises a central decision-making and control module, a man-
machine interaction module, a multi-
modal sensing module, a mechanical execution and management module, a mechanical arm module, an instrument storage module and a sterile barrier module. The method comprises the following steps: step 1, preoperative preparation and
habit file loading; step 2, acquiring and fusing multi-
modal data; step 3, performing real-time recognition on the operation scene; step 4, conventional
decision making and instrument transmission; step 5, risk monitoring and
emergency plan triggering; step 6, performing
postoperative treatment and systematic learning; according to the intelligent instrument
robot system with multi-modal sensing and self-
adaptive decision making, real-time and accurate recognition of the operation process is achieved by integrating the multi-modal sensing technology, the
robot can surpass simple instruction response, prejudge operation requirements in advance and actively prepare needed instruments, and therefore the
waiting time in an operation is remarkably shortened, and the operation efficiency is improved. And the operation process is optimized.