The invention discloses a puncture tissue recognition and transmembrane event control method and
system based on force sense and
image fusion, and the method comprises the steps: collecting a force
signal at the
tail end of a puncture needle, a real-time ultrasonic
image sequence and the
pose data of a mechanical arm, and carrying out the
timestamp alignment to construct a synchronous
data set; on the basis, tissue stiffness, a force change rate, extreme value features, texture features, envelope boundary features and
optical flow displacement features are extracted, the
tissue level where the puncture needle is located is recognized through multi-
modal fusion, and a membrane penetrating event is detected in combination with the force sense extreme value features and envelope boundary fracture; according to the
tissue level and the transmembrane event, event driving control strategies such as constant-speed propulsion, deceleration early warning, rotation assistance, transmembrane braking and path compensation are automatically triggered, so that the puncture process is accurately regulated and controlled. The accuracy of puncture tissue recognition and the reliability of transmembrane event judgment can be remarkably improved, and the safety and stability of puncture operation are improved.