Image-guided puncture positioning system and method based on compliance control of mechanical arm

Through the robotic arm flexibility control system, the problem of disengagement caused by the body surface feedback contact force during ultrasonic detection is solved, and the precise puncture positioning of the target object of the lesion is achieved, reducing the system calculation volume and development cost.

CN119014951AInactive Publication Date: 2024-11-26HEFEI ZHIZI MEDICAL TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411112593.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-14
Publication Date
2024-11-26
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

During ultrasound detection, the ultrasound probe is prone to break away from the patient's skin due to the feedback contact force on the body surface, resulting in discontinuous image scanning. In the prior art, the identification of lesions target objects is difficult, and the system calculation amount and development cost are relatively large.

Method used

Using an image-guided puncture positioning system based on robotic arm compliant control, including a six-axis robotic arm, end effector and six-dimensional force sensor, the scanning probe is stable and secured by switching between zero-force drag and flexible control modes through the compliant controller. The target angle of the puncture frame is calculated through the positioning control module to achieve accurate guidance of the puncture needle.

Benefits of technology

It improves the puncture positioning accuracy of the target object of the lesion, reduces the system calculation volume and development cost, ensures that the scanning probe is stable to suppress pressure, avoids the loss of the target object of the lesion in the scanning image, and facilitates subsequent puncture operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119014951A_ABST
    Figure CN119014951A_ABST
Patent Text Reader

Abstract

The invention discloses an image-guided puncture positioning system and method based on compliance control of a mechanical arm, and the system comprises a medical imaging device which comprises a device host, a scanning probe, an input module and a display module, and the display module is used for displaying a scanning image scanned by the scanning probe. The input module is used for selecting a target point position on a focus target object in a scanned image, and the mechanical arm compliance control system comprises a six-axis mechanical arm and an end effector installed at the tail end of the six-axis mechanical arm; the end effector comprises an installation support, a puncture frame and a puncture frame rotation driving assembly. The application of the invention can ensure that the scanning probe can stably abut against the skin of the body surface of a patient, so that the stability of a scanned image is ensured; and the puncture positioning precision of the focus target object can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of medical devices, and in particular to an image-guided puncture positioning system and method based on compliant control of a robotic arm. Background Art

[0002] At present, it is often necessary to puncture the lesion site of the patient in medical treatment in order to take samples and examine the lesion site. Traditional puncture surgery is guided by ultrasound, CT, MRI and other image scanning equipment. The doctor manually inserts small surgical instruments (such as biopsy puncture needles, etc.) into the patient's body to detect or treat the lesion site. The doctor determines the appropriate needle insertion point and direction through the two-dimensional or three-dimensional scanning images near the lesion, and then manually completes the puncture operation based on experience. In order to reduce the difficulty of puncture operations, puncture robots guided by computer navigation technology came into being.

[0003] For example, the invention patent with application number 202011610690.4 discloses an ultrasound positioning puncture system and a storage medium, which locates the first position information of the target in the ultrasound detection plane projected by the ultrasound detection device; obtains the first posture information of the ultrasound detection plane and the second posture information of the first serial mechanical arm; determines the position conversion relationship between the reference coordinate system of the ultrasound positioning puncture system and the coordinate system where the ultrasound detection plane is located according to the first posture information and the second posture information; determines the second position information of the target in the reference coordinate system according to the position conversion relationship and the first position information. The above scheme improves the accuracy of puncture surgery.

[0004] However, when performing ultrasonic detection of lesions deeper inside the body, it is often necessary to press the ultrasonic probe against the patient's skin and move the ultrasonic probe back and forth to find an ultrasonic image that best presents the lesion. During this detection process, the ultrasonic probe is often subjected to contact force feedback from the body surface. Under the combined action of the driving force of the robotic arm and the contact force feedback from the body surface, the ultrasonic probe is prone to posture changes, thereby detaching from the patient's skin, causing the ultrasonic probe to be unable to continuously scan images.

[0005] In addition, the image recognition of the lesion target is directly performed on the scanned image detected by the ultrasound probe through processing methods such as scanning image filtering and enhancement, and then the puncture guidance positioning is performed. This not only makes the recognition difficult and prone to false detection, but also inevitably increases the system's computing power and system development costs.

[0006] In order to solve the above problems, the present application proposes an image-guided puncture positioning system and method based on flexible control of a robotic arm. Summary of the invention

[0007] The object of the present invention is to provide an image-guided puncture positioning system and method based on flexible control of a robotic arm to solve the problems raised in the above-mentioned background technology.

[0008] To achieve the above object, the present invention provides the following technical solutions:

[0009] The image-guided puncture positioning system based on the flexible control of a mechanical arm comprises a medical imaging device, the medical imaging device comprises a device host, a scanning probe, an input module and a display module, the display module is used to display a scanned image scanned by the scanning probe, the input module is used to select a target point on a lesion target object in the scanned image, and also comprises a mechanical arm flexible control system and a positioning control module, the mechanical arm flexible control system comprises a six-axis mechanical arm and an end effector mounted at the end of the six-axis mechanical arm, the end of the six-axis mechanical arm is also equipped with a six-dimensional force sensor for detecting the contact external force of the end effector, the end effector comprises: a mounting bracket, docked and mounted at the end of the six-axis mechanical arm, the scanning probe is rotatably mounted at the lower end of the mounting bracket;

[0010] The puncture frame is used to guide the puncture needle, and the puncture needle installed on the puncture frame is located on the plane where the scan image is located;

[0011] The puncture frame rotation drive assembly is used to drive the puncture needle on the puncture frame to rotate on the plane where the scan image is located;

[0012] The positioning control module is used to calculate the target rotation angle of the puncture frame according to the scanned image, the position information of the target point in the scanned image, the position information of the scanning probe in the scanned image, and the position information of the puncture frame in the scanned image, and control the operation of the puncture frame rotation drive assembly so that the puncture needle is directed toward the target point of the lesion target object.

[0013] As a further solution of the present invention, the robotic arm compliance control system further includes:

[0014] The robot arm controller is configured with a compliant controller. The robot arm controller switches between a compliant control mode and a zero-force drag mode based on a trigger signal. In the compliant control mode, the compliant controller is used to control the various joint servos of the robot arm so that the end effector has flexible behavior in the free motion direction and explicit force tracking behavior in the constraint direction; in the zero-force drag mode, the robot arm controller is used to cut off the compliant controller and control the output torque of the various joint servos of the robot arm to be zero.

[0015] As a further solution of the present invention, the specific design of the compliant controller is as follows:

[0016]

[0017] in, is the generalized interaction torque, i.e., the control output, is the gravity vector, J(q) is the Jacobian matrix, is the task control force in the unconstrained space corresponding to the end effector, The mission control capability of zero space, To constrain the task control of space, the task control of zero space Set by the user;

[0018] Mission control in unconstrained space The expression is:

[0019]

[0020] in, is the inertia matrix of the unconstrained space, is the Coriolis and centrifugal matrix of the unconstrained space, and the desired spatial coordinates of the unconstrained space corresponding to the end effector are The corresponding error is described by express, is the stiffness matrix, is the damping matrix;

[0021] Mission control in constrained spaces The expression is:

[0022]

[0023] Among them, F des To expect external force, is the generalized external joint force in unconstrained space, is the generalized external joint force in null space, is a symmetric positive definite inertia matrix, For the Coriolis and centrifugal matrices, is the Jacobian matrix of the constraint space, is the transposed matrix of the unconstrained spatial Jacobian matrix, is the transposed matrix of the null-space Jacobian matrix.

[0024] As a further solution of the present invention, an additional proportional integral term F is added PI , whose expression is:

[0025]

[0026] Among them, k P is the proportional control gain, k I is the integral control gain, is the generalized external joint force in the constraint space;

[0027] Based on the additional proportional-integral term F PI , will constrain the task control of space The expression is rewritten as:

[0028]

[0029] As a further solution of the present invention, the input module adopts a mouse.

[0030] As a further solution of the present invention, the input module and the display module specifically adopt a touch display screen.

[0031] As a further solution of the present invention, a control button for inputting a trigger signal to the compliance controller is also provided on the mounting bracket.

[0032] An image-guided puncture positioning method based on flexible control of a robotic arm, including an image-guided puncture positioning system based on flexible control of a robotic arm, comprising the following steps:

[0033] S1. Based on the trigger signal, the robot arm controller enters the zero-force drag mode, cuts off the compliance controller, controls the output torque of each joint servo of the robot arm to be zero, and the scanning probe scans the patient's body surface under the dragging of the medical staff;

[0034] S2. The scanning probe is dragged by the medical staff to detect and search for the lesion target, and stays at the position where the lesion target is displayed on the display module;

[0035] S3, based on the trigger signal, the robot controller enters the compliant control mode, and the compliant controller controls the various joint servos of the robot arm, so that the end effector has a flexible behavior in the free motion direction and an explicit force tracking behavior in the constraint direction;

[0036] S4, selecting a target point on the lesion target object in the scanned image through the input module;

[0037] S5, the positioning control module calculates the target rotation angle of the puncture frame according to the current scan image, the position information of the target point in the scan image, the position information of the scanning probe in the scan image, and the position information of the puncture frame in the scan image;

[0038] S6. Based on the target rotation angle of the puncture frame, the positioning control module controls the rotation drive assembly of the puncture frame to operate so that the puncture needle faces the target point of the lesion target object.

[0039] As a further solution of the present invention, the lesion target object presented by the display module is located directly below the scanning probe, or is located on a side close to the puncture frame.

[0040] As a further solution of the present invention, in step S2, each joint servo of the robotic arm records the passive motion trajectory of the end effector during the dragging process;

[0041] In step S3, based on the trigger signal, the device host saves the scanned image of the current frame;

[0042] Repeat steps S1-S3 until the device host saves a preset number of scanned images;

[0043] Selecting a scan image that presents the best morphology of the lesion target through an input module and using it as a scan image for puncture positioning;

[0044] Based on the recorded passive motion trajectory, the robot arm controller controls the various joint servos of the robot arm to make the end effector return to the position of the scanned image of the puncture positioning along the free motion direction, and then executes steps S4-S6 in sequence to complete the puncture positioning.

[0045] Compared with the prior art, the present invention has the following beneficial effects:

[0046] 1. In the present invention, based on the trigger signal, the robot arm controller enters the zero-force drag mode, cuts off the compliance controller, and controls the output torque of each joint servo of the robot arm to be zero, so that medical staff can drag the scanning probe with "zero force", which is easy to operate and use;

[0047] 2. In the present invention, when the scanning probe detects the lesion target object under the dragging of the medical staff, the medical staff can release the scanning probe and control the mechanical arm through the flexible controller of the present invention. Each joint servo gives a torque that cooperates with each other, so that the mechanical arm remains in a stable state, ensuring that the scanning probe can be stably pressed against the patient's body surface skin, avoiding the loss of the lesion target object in the scanned image, and facilitating the subsequent puncture positioning operation of the lesion target object;

[0048] 3. In the present invention, medical staff directly select a target point on the lesion target in the scanned image through the input module. Based on the target point and other known parameter information, the positioning control module can calculate the target rotation angle of the puncture frame and control the operation of the puncture frame rotation drive assembly to make the puncture needle point to the target point of the lesion target. Compared with the prior art, it not only improves the accuracy of puncture positioning of the lesion target, but also reduces the system calculation amount and system development cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 Control block diagram for implementing explicit force tracking behavior for a compliant control system of a robotic arm;

[0050] Figure 2 Schematic diagram of the end effector being constrained by the environment in the normal direction.

[0051] Figure 3 Schematic diagram of the structure of the image-guided puncture positioning system based on the compliant control of the robotic arm.

[0052] Figure 4 Schematic diagram of the three-dimensional structure of the end effector in the image-guided puncture positioning system based on flexible control of the robotic arm.

[0053] Figure 5 Schematic diagram of the planar structure of the end effector in the image-guided puncture positioning system based on compliant control of the robotic arm.

[0054] Figure 6 Image-guided puncture positioning system based on flexible control of robotic arm Figure 4 Schematic diagram of the structure enlarged at point A in the middle.

[0055] Figure 7 This is an ultrasound scanning guidance image for lesion positioning in the image-guided puncture positioning method based on flexible control of the robotic arm. DETAILED DESCRIPTION

[0056] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0057] See also Figures 1-2 , a robot arm compliance control system includes a six-axis robot arm and an end effector installed at the end of the six-axis robot arm, a six-dimensional force sensor for detecting the contact external force of the end effector is also installed at the end of the six-axis robot arm, and also includes a robot arm controller, wherein the robot arm controller is configured with a compliance controller, and the robot arm controller switches between a compliance control mode and a zero-force drag mode based on a trigger signal. In the compliance control mode, the compliance controller is used to control each joint servo of the robot arm so that the end effector has a flexible behavior in the free motion direction and an explicit force tracking behavior in the constraint direction; in the zero-force drag mode, the robot arm controller is used to cut off the compliance controller and control the output torque of each joint servo of the robot arm to be zero.

[0058] As a specific solution, the specific construction method of the compliant controller is:

[0059] Step 1: Building a dynamic model

[0060] The dynamic model of a robotic arm with n degrees of freedom is expressed as:

[0061]

[0062] in, are generalized coordinates, is a symmetric positive definite inertia matrix, are the Coriolis and centrifugal matrices, is the gravity vector, is the generalized interaction torque, is the generalized external joint torque.

[0063] Step 2: Standard Cartesian Impedance and Force Control

[0064] Assuming that the generalized interaction torque τ is the control input of the Cartesian impedance, the applied external joint force is mapped to the generalized external joint torque through the Jacobian matrix, which is specifically expressed as:

[0065] τ ext =-J(q) T F ext (2)

[0066] The dimension of the complete Cartesian space is m = 6, and the speed of the operating space is Use mapping To describe, in general, including the translation speed and rotation speed of the end effector of the robot arm, the compliant behavior of the end effector is realized by classical impedance control, which is specifically expressed as:

[0067] T imp =J(q) T F imp +g(q) (3)

[0068]

[0069] Among them, τ imp The torque required to achieve the desired spring-damper behavior, F imp The mission space forces to achieve the desired spring-damper behavior are: is the virtual spring deflection, where y∈R m is the actual task space coordinate, y des ∈R m is the desired task space coordinate, is the positive potential function of the virtual spring deflection, is a positive definite damping matrix, from which critical damping can be obtained under different configurations and different Cartesian stiffness settings.

[0070] Direct control of the interaction torque is beneficial and desirable in many applications under environmental constraints. The required interaction torque is expressed as:

[0071] τ=τimp +τ f (5)

[0072] τ f = J(q) T F des (6)

[0073] Furthermore, by using an explicit force feedback loop, τ f is expressed as:

[0074]

[0075] where F ext is the actual external force, F des is the desired external force, is the force error of the end effector of the robotic arm, K fp is a positive definite proportional gain matrix, K fd is a positive definite derivative gain matrix, K fi is a positive definite integral gain matrix, τ f is the joint torque generated by actively achieving the required torque.

[0076] Step 3: Compliant Controller Design

[0077] When only considering force control in the constrained direction, the dimension of the task space of the end effector is m ≤ n, and the dimension of the complete Cartesian space is m = 6, which includes three translations and three rotations; in addition, a kinematic constraint of c (c < m) dimensions is imposed on this operating space. Since the considered system is kinematically redundant with respect to the end effector, there is an additional null space with a dimension of p = n - m, and it can be used to perform complementary subtasks simultaneously. The kinematic integrity constraint Φ(q) ∈ R c is expressed as:

[0078] Φ(q) = 0 (8)

[0079] Assume that Φ(q) is a continuous gradient function and is twice differentiable. Without loss of generality, considering a rigid environment, the kinematic integrity constraint is expressed as:

[0080]

[0081] where Let represent the remaining unconstrained space coordinates, and there is Thus, using the standard task hierarchy framework, the local null space velocity is obtained through the Jacobian matrix and its expression is:

[0082]

[0083] Assuming that the Jacobian matrix is ​​invertible in the considered workspace, due to the kinematic holonomic constraint Φ(q) = 0, the solution is Its expression is:

[0084]

[0085] in, Its rank is nc, so the dynamic model of the system is rewritten as shown below:

[0086]

[0087] in, is the inertia matrix of the constrained system, are the Coriolis and centrifugal matrices for the constrained system, is the gravity vector of the constrained system, is the generalized external joint force in unconstrained space, is the generalized external joint force in the null space.

[0088] Next, the external joint torque τ ext Rewrite it as The relevant interaction torques, which are generated by the respective coordination generalized forces, are expressed as follows:

[0089]

[0090] in, is the generalized external joint force in the constraint space, is the generalized external joint force in unconstrained space, is the generalized external joint force in the null space.

[0091] There is no motion in the direction of the constraint, but dynamic couplings still exist because they affect the contact behavior. Consider the constraints The second-order form of is acceleration, which is expressed as:

[0092]

[0093] Substituting into formula (1) and formula (13), the model-based prediction force in the constraint direction is calculated as As shown below:

[0094]

[0095] In the formula, is a symmetric positive definite inertia matrix, For the Coriolis and centrifugal matrices, is the Jacobian matrix of the constraint space, is the transposed matrix of the unconstrained spatial Jacobian matrix, is the transposed matrix of the null-space Jacobian matrix;

[0096] The design expression of the compliant controller is given as follows:

[0097]

[0098] It includes gravity compensation and task control force of unconstrained space corresponding to the end effector Mission control in zero space And the task control capability of constrained space Among them, the mission control capability of zero space Can be set by the user, which does not affect the control operation of the compliant controller, such as: the task control force of the zero space can be designed as: k is the system stiffness, d is the damping, q v is the joint space impedance, q v,d is the desired equilibrium position.

[0099] The task control force generated in the free motion direction (i.e. unconstrained space) As shown below:

[0100]

[0101] in, is the inertia matrix of the unconstrained space, is the Coriolis and centrifugal matrix of the unconstrained space, and the desired spatial coordinates of the unconstrained space corresponding to the end effector are The corresponding error is described by express, is the stiffness matrix, is the damping matrix and the gravity vector is retained in the compliant controller formula (16).

[0102] Next, the rewritten dynamic model formula (12) is substituted into the compliant controller formula (16), so that the interaction torque is expressed as:

[0103]

[0104] For the force trace, the model-based predicted force has been calculated in the constraint direction. Must be equal to the expected external force To cancel each other out, the expression is:

[0105]

[0106] The predictive power Substituting formula (15) into formula (19) and then inserting it into the compliant controller formula (16), we get:

[0107]

[0108] In frictionless contact and in the direction of free motion (i.e. unconstrained space direction) and null space (i.e., v direction), the generalized external joint force in the unconstrained space in the second term of the above control law is and the generalized external joint force in the null space disappears, which greatly simplifies the calculation of control feedback. The third term of the above control law compensates for the external force existing in the free motion direction and null space under dynamic coupling.

[0109] To help reduce the steady-state error of the contact force, an additional proportional-integral term F is added to the above control law. PI , whose expression is:

[0110]

[0111] Among them, k P is the proportional control gain, k I is the integral control gain.

[0112] Based on the additional proportional-integral term formula (21), the above control law formula (20) is rewritten as:

[0113]

[0114] Generalized external joint forces in constraint space The feedback can be detected by the six-dimensional force sensor. The control law formula (20) has no gain in the contact force direction. Figure 2 In the scenario, the motion constraints are active in the normal direction of the end effector, and the unconstrained task is performed by the end effector in The movement in the direction is given, and the local zero space velocity v represents the movement behavior of the one-dimensional zero space; if the control cannot provide dynamic coupling, such as formula (7), contact force deviation will often occur in highly dynamic and moving conditions, and the contact force deviation may produce higher joint torque and speed, causing the robot arm to reach the saturation limit. In contrast, the control law proposed in formula (16) of the present invention can effectively avoid the above problems.

[0115] In the present invention, the end effector may specifically include a scanning probe of a medical imaging device. When the medical staff needs to drag the scanning probe under the robotic arm for scanning and detection, based on the trigger signal, the robotic arm controller enters a zero-force dragging mode, cuts off the compliant controller, and controls the output torque of each joint servo of the robotic arm to be zero, thereby enabling the medical staff to drag the scanning probe with "zero force", which is easy to operate and use. In addition, when the scanning probe detects a lesion target object under the dragging of the medical staff, the medical staff can release the scanning probe and control the robotic arm through the compliant controller of the present invention. Each joint servo gives a mutually coordinated torque, so that the robotic arm remains in a stable state, ensuring that the scanning probe can be stably pressed against the patient's skin, avoiding the loss of the lesion target object in the scanned image, and facilitating subsequent puncture positioning operations on the lesion target object.

[0116] See also Figures 3 to 6 The present invention also provides a technical solution: an image-guided puncture positioning system based on flexible control of a robotic arm, comprising a medical imaging device, the medical imaging device comprising a device host, a scanning probe 2, an input module and a display module, the display module being used to display a scanned image scanned by the scanning probe 2, the input module being used to select a target point on a lesion target object in the scanned image, and also comprising the aforementioned flexible control system of the robotic arm and the positioning control module, the end effector 200 comprising a mounting bracket 1, a probe rotation drive assembly 21, a puncture stand 3 and a puncture stand rotation drive assembly 31, wherein the mounting bracket 1 is specifically mounted at the end of the six-axis robotic arm 100 by docking with its own fixed base 11, the scanning The probe 2 is specifically installed in the probe mounting sleeve 12, and the scanning probe 2 is rotatably mounted on the lower end of the mounting bracket 1 through the probe mounting sleeve 12; the probe rotation driving assembly 21 is specifically installed at the lower end of the mounting bracket 1, and the probe rotation driving assembly 21 is used to drive the probe mounting sleeve 12 and the scanning probe 2 to rotate and swing, and adjust the posture of the scanning probe 2 relative to the mounting bracket 1; the end of the probe mounting sleeve 12 away from the mounting bracket 1 is installed with a fixed bracket 13, and the puncture frame 3 is rotatably mounted in the fixed bracket 13, which is used to guide the puncture needle, and the puncture needle 4 installed on the puncture frame 3 is located in the plane where the scan image is located; the puncture frame rotation driving assembly 31 is used to drive the puncture frame 3 and the puncture needle 4 to rotate on the plane where the scan image is located;

[0117] The positioning control module is used to calculate the target rotation angle of the puncture frame 3 according to the scanned image, the position information of the target point in the scanned image, the position information of the scanning probe 2 in the scanned image, and the position information of the puncture frame 3 in the scanned image, and control the operation of the puncture frame rotation drive assembly 31 so that the puncture needle 4 is directed toward the target point of the lesion target object.

[0118] In the present invention, medical personnel directly select a target point on the lesion target in the scanned image through the input module. Based on the target point and other known parameter information, the positioning control module can calculate the target rotation angle of the puncture frame 3 and control the operation of the puncture frame rotation drive component 31 so that the puncture needle 3 faces the target point of the lesion target. In practical applications, there are often large differences in the frame-by-frame images of the lesion target scanned and detected. If the image recognition of the lesion target is performed by scanning image filtering, enhancement and other processing methods, and then puncture guidance positioning is performed, not only is the recognition difficult and prone to false detection, but it is also bound to increase the system calculation amount and system development cost. Compared with the prior art, the present invention allows medical personnel to directly select the target point of the lesion target in the scanned image without performing image recognition operations, which not only improves the accuracy of lesion target puncture positioning, but also reduces the system calculation amount and system development cost.

[0119] As a specific solution, the input module may use a mouse, and the medical staff uses the mouse to select a target point on the lesion target object in the scanned image presented by the display module.

[0120] Of course, as another solution, the input module and the display module may also use a touch screen together, and the medical staff uses a stylus to select a target point on the lesion target object in the scan image presented on the touch screen.

[0121] In order to facilitate the control of switching the robot arm mode, a control button 5 for inputting a trigger signal to the compliance controller is also provided on the mounting bracket 1. When the control button 5 is pressed, the robot arm controller enters the zero-force drag mode based on the pressing trigger signal, which cuts off the compliance controller and controls the output torque of each joint servo of the robot arm to be zero, so that the end effector 200 can be dragged freely, which is convenient for medical staff to drag the scanning probe 2 to detect and find the lesion target object; when the control button 5 is released, the robot arm controller enters the compliant control mode based on the release trigger signal. The compliant controller is used to control the various joint servos of the robot arm, so that the end effector 200 has flexible behavior in the free movement direction and explicit force tracking behavior in the constraint direction, so that the scanning probe 2 can maintain a stable pressing posture on the patient's skin, avoiding the loss of the image of the lesion target object due to the change of the posture of the scanning probe 2.

[0122] The present invention also provides a technical solution: an image-guided puncture positioning method based on flexible control of a robotic arm, based on the aforementioned image-guided puncture positioning system based on flexible control of a robotic arm, comprising the following steps:

[0123] S1. Based on the trigger signal, the robot arm controller enters the zero-force drag mode, cuts off the compliance controller, controls the output torque of each joint servo of the robot arm to be zero, and the scanning probe 2 scans the patient's body surface under the dragging of the medical staff;

[0124] S2, the scanning probe 2 is dragged by the medical staff to detect and search for the lesion target, and stays at the position where the lesion target is displayed on the display module;

[0125] S3, based on the trigger signal, the robot arm controller enters the compliant control mode, and the compliant controller controls the various joint servos of the robot arm, so that the end effector 200 has a flexible behavior in the free movement direction and an explicit force tracking behavior in the constraint direction, so that the scanning probe 2 can maintain a stable pressing posture on the patient's body surface skin;

[0126] In order to facilitate the puncture needle 4 to accurately puncture the lesion target, as a specific solution, the lesion target presented by the display module is specifically located directly below the scanning probe 2, or on a side close to the puncture frame 13;

[0127] S4, selecting a target point on the lesion target object in the scanned image through the input module;

[0128] S5, the positioning control module calculates the target rotation angle of the puncture frame 13 according to the current scan image, the position information of the target point in the scan image, the position information of the scanning probe 2 in the scan image, and the position information of the puncture frame 13 in the scan image;

[0129] S6. Based on the target rotation angle of the puncture frame 13, the positioning control module controls the puncture frame rotation drive assembly 31 to operate so that the puncture needle 4 faces the target point of the lesion target object.

[0130] As a further specific solution, in order to enable the scanning image detected by the scanning probe 2 to present the best form of the lesion target, in step S2, each joint servo of the robotic arm records the passive motion trajectory of the end effector 200 during the dragging process;

[0131] In step S3, based on the trigger signal of the control button 5 being released, the device host saves the scanned image of the current frame;

[0132] Repeat steps S1-S3 until the device host saves a preset number of scanned images;

[0133] Selecting a scan image that presents the best morphology of the lesion target through an input module and using it as a scan image for puncture positioning;

[0134] Based on the recorded passive motion trajectory, the robot arm controller controls the joint servos of the robot arm to make the end effector 200 return to the position of the scanned image of the puncture positioning along the free motion direction, and then executes steps S4-S6 in sequence to complete the puncture positioning.

[0135] The robotic arm is controlled by the compliant controller of the present invention, and the end effector 200 has flexible behavior in the free movement direction. During the execution of the moving subtask in the free movement direction, the scanning probe 2 can be controlled to always maintain a stable pressing posture on the patient's skin, so that the scanning probe 2 can scan and reproduce the scanned image saved at the historical moment.

[0136] As a specific application solution, the medical imaging device can specifically adopt a medical ultrasonic imaging device, and the scanning probe 2 is specifically a corresponding ultrasonic scanning probe, such as Figure 7 As shown, the ultrasonic scanning probe detects the lesion target under the dragging of the medical staff, and stays at the position where the display module presents the best form of the lesion target. The yellow line represents the center line of the ultrasonic image, the orange dot represents the lesion target, the purple dot in the orange dot represents the selected target point, and the red line is the virtual navigation line generated after the target point is connected with the rotation point of the puncture frame. The lateral distance between the target point and the rotation point of the puncture frame is L, and the longitudinal distance between the target point and the rotation point of the puncture frame is H. Based on the lateral distance L and the longitudinal distance H, the angle between the virtual navigation line and the center line of the ultrasonic image can be calculated, that is, the target rotation angle of the puncture frame 3. Based on the target rotation angle of the puncture frame 3, the positioning control module controls the rotation drive assembly 31 of the puncture frame to operate, so that the puncture needle 4 faces the target point of the lesion target, thereby completing the puncture positioning. Subsequently, the medical staff can perform the puncture needle 4 needle insertion operation to achieve sampling of the lesion target.

[0137] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the equivalent elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

Claims

1. An image-guided puncture positioning system based on flexible control of a robotic arm, comprising a medical imaging device, the medical imaging device comprising a device host, a scanning probe, an input module and a display module, the display module being used to display a scanned image scanned by the scanning probe, characterized in that: The input module is used to select a target point on the lesion target object in the scanned image, and also includes a mechanical arm compliance control system and a positioning control module. The mechanical arm compliance control system includes a six-axis mechanical arm and an end effector installed at the end of the six-axis mechanical arm. The end of the six-axis mechanical arm is also equipped with a six-dimensional force sensor for detecting the contact external force of the end effector. The end effector includes: a mounting bracket, which is docked and installed at the end of the six-axis mechanical arm, and the scanning probe is rotatably installed at the lower end of the mounting bracket; The puncture frame is used to guide the puncture needle, and the puncture needle installed on the puncture frame is located on the plane where the scan image is located; The puncture frame rotation drive assembly is used to drive the puncture needle on the puncture frame to rotate on the plane where the scan image is located; The positioning control module is used to calculate the target rotation angle of the puncture frame according to the scanned image, the position information of the target point in the scanned image, the position information of the scanning probe in the scanned image, and the position information of the puncture frame in the scanned image, and control the operation of the puncture frame rotation drive assembly so that the puncture needle is directed toward the target point of the lesion target object.

2. The image-guided puncture positioning system based on flexible control of a robotic arm according to claim 1, characterized in that: The mechanical arm compliance control system also includes: The robot arm controller is configured with a compliant controller. The robot arm controller switches between a compliant control mode and a zero-force drag mode based on a trigger signal. In the compliant control mode, the compliant controller is used to control the various joint servos of the robot arm so that the end effector has flexible behavior in the free motion direction and explicit force tracking behavior in the constraint direction; in the zero-force drag mode, the robot arm controller is used to cut off the compliant controller and control the output torque of the various joint servos of the robot arm to be zero.

3. The image-guided puncture positioning system based on flexible control of a robotic arm according to claim 2, characterized in that: The specific design of the compliant controller is as follows: in, is the generalized interaction torque, i.e., the control output, is the gravity vector, J(q) is the Jacobian matrix, is the task control force in the unconstrained space corresponding to the end effector, The mission control capability of zero space, To constrain the task control of space, the task control of zero space Set by the user; Mission control in unconstrained space The expression is: in, is the inertia matrix of the unconstrained space, is the Coriolis and centrifugal matrix of the unconstrained space, and the desired spatial coordinates of the unconstrained space corresponding to the end effector are The corresponding error is described by express, is the stiffness matrix, is the damping matrix; Mission control in constrained spaces The expression is: Among them, F des To expect external force, is the generalized external joint force in unconstrained space, is the generalized external joint force in null space, is a symmetric positive definite inertia matrix, For the Coriolis and centrifugal matrices, is the Jacobian matrix of the constraint space, is the transposed matrix of the unconstrained spatial Jacobian matrix, is the transposed matrix of the null-space Jacobian matrix.

4. The image-guided puncture positioning system based on flexible control of a robotic arm according to claim 3, characterized in that: Add an additional proportional integral term F PI , whose expression is: Among them, k P is the proportional control gain, k I is the integral control gain, is the generalized external joint force in the constraint space; Based on the additional proportional-integral term F PI , will constrain the task control of space The expression is rewritten as:

5. The image-guided puncture positioning system based on flexible control of a robotic arm according to claim 4, characterized in that: The input module adopts a mouse.

6. The image-guided puncture positioning system based on flexible control of a robotic arm according to claim 4, characterized in that: The input module and the display module specifically adopt a touch display screen.

7. The image-guided puncture positioning system based on flexible control of a robotic arm according to claim 4, characterized in that: The mounting bracket is also provided with a control button for inputting a trigger signal to the compliance controller.

8. Image-guided puncture positioning method based on flexible control of robotic arm, characterized in that: The image-guided puncture positioning system based on flexible control of a robotic arm according to any one of claims 3 to 7 comprises the following steps: S1. Based on the trigger signal, the robot arm controller enters the zero-force drag mode, cuts off the compliance controller, controls the output torque of each joint servo of the robot arm to be zero, and the scanning probe scans the patient's body surface under the dragging of the medical staff; S2. The scanning probe is dragged by the medical staff to detect and search for the lesion target, and stays at the position where the lesion target is displayed on the display module; S3, based on the trigger signal, the robot controller enters the compliant control mode, and the compliant controller controls the various joint servos of the robot arm, so that the end effector has a flexible behavior in the free motion direction and an explicit force tracking behavior in the constraint direction; S4, selecting a target point on the lesion target object in the scanned image through the input module; S5, the positioning control module calculates the target rotation angle of the puncture frame according to the current scan image, the position information of the target point in the scan image, the position information of the scanning probe in the scan image, and the position information of the puncture frame in the scan image; S6. Based on the target rotation angle of the puncture frame, the positioning control module controls the rotation drive assembly of the puncture frame to operate so that the puncture needle faces the target point of the lesion target object.

9. The image-guided puncture positioning method based on flexible control of a robotic arm according to claim 8, characterized in that: The lesion target object presented by the display module is located directly below the scanning probe, or is located on a side close to the puncture frame.

10. The image-guided puncture positioning method based on flexible control of a robotic arm according to claim 8, characterized in that: In step S2, each joint servo of the robot arm records the passive motion trajectory of the end effector during the dragging process; In step S3, based on the trigger signal, the device host saves the scanned image of the current frame; Repeat steps S1-S3 until the device host saves a preset number of scanned images; Selecting a scan image that presents the best morphology of the lesion target through an input module and using it as a scan image for puncture positioning; Based on the recorded passive motion trajectory, the robot arm controller controls the various joint servos of the robot arm to make the end effector return to the position of the scanned image of the puncture positioning along the free motion direction, and then executes steps S4-S6 in sequence to complete the puncture positioning.