A robot admittance control method, device, electronic device and medium
The virtual boundary and admission control model are generated through the three-dimensional navigation and tracking system, and combined with the mass spring damping system, the accuracy and safety of admission control in robot-assisted surgery are solved, achieving accurate and stable movement in the surgery.
Patent Information
- Application Number
- CN202311803606.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-26
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2043-12-26
AI Technical Summary
In existing robot-assisted surgery, impedance control has problems such as deviation angle and high cost of operation tools, while the admission control lacks effective reference and application solutions, resulting in insufficient accuracy.
A virtual boundary is generated through a three-dimensional navigation tracking system, the expected pose is obtained based on the admission control model, and the virtual boundary is compared in real time to generate a robot's motion response method to ensure that the power tool moves within the safe boundary, and the mass spring damping system is used to obtain contact force , adjust the desired posture and speed to maintain control accuracy.
The precise motion trajectory analysis and operation within the safety boundary of the robot in the admission control are realized, which improves the accuracy and stability of the robot's admission control and reduces uncertainty in the operation.
Smart Images

Figure CN117901089B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of robot control, and relates to a robot admittance control method, device, electronic equipment and medium. Background Art
[0002] In recent years, medical technology has made tremendous progress and has gradually entered the stage of precision and minimally invasive surgery. Robots are used to assist doctors in their operations, improving the stability and precision of their operations.
[0003] The existing robot-assisted methods are mainly impedance control and admittance control. Although impedance control is flexible, the robotic arm is too soft in this control mode, and the operating tool may still deviate from the angle and exceed the limit. Impedance control requires the installation of force sensors at each joint of the robot, which is costly. As for admittance control, although it is more accurate than impedance by providing feedback correction to the posture, speed, and acceleration during movement, this accuracy is based on sufficient reference. In the working environment of existing surgical robots, there is no good reference standard, let alone a solution that combines it with admittance control. Summary of the invention
[0004] In order to overcome the deficiencies of the prior art, the present invention provides a robot admittance control method, device, electronic equipment and medium.
[0005] In order to achieve the above object, the present invention adopts the following technical solutions:
[0006] A robot admittance control method comprises the following steps:
[0007] S1, generate virtual boundary;
[0008] S2, responding to the external force applied by the user to the robot to obtain the contact force, and obtaining the desired posture in the current control cycle based on the robot's admittance control model;
[0009] S3. Compare the desired posture and virtual boundary in the current control cycle, and generate a corresponding robot action response method to control the robot movement.
[0010] Furthermore, in step S3, the robot action response mode includes:
[0011] In the current control cycle, if the desired posture is within the virtual boundary, the control quantity is directly generated and sent to the robot arm to control the robot arm to move;
[0012] In the current control cycle, if the expected posture exceeds the virtual boundary, the new expected posture is recalculated so that the new expected posture can be within the virtual boundary. The control amount of the robot arm is generated according to the new expected posture to control the robot arm to move.
[0013] Furthermore, if the desired posture exceeds the virtual boundary, the current desired acceleration and desired velocity are constrained to calculate a new desired posture.
[0014] Further, in step S2, the admittance control model of the robot is:
[0015]
[0016] Among them, is the contact force at the tip of the power tool; M is the virtual inertia matrix of the robot, B is the virtual damping matrix of the robot, K is the virtual stiffness matrix of the robot; is the expected posture of the robot, is the expected speed of the robot, is the expected acceleration of the robot, is the actual posture of the robot, is the actual speed of the robot, and is the actual acceleration of the robot.
[0017] Furthermore, in step S2, the contact force is obtained by a mass spring damping system provided on the robot, and the contact force includes force and torque in the XYZ directions.
[0018] Furthermore, in step S1, a virtual boundary is generated based on the three-dimensional navigation and tracking system. Before generating the virtual boundary, the three-dimensional navigation and tracking system is used to determine whether the positioning tracer is visible. If it is not visible, the robot admittance control method is terminated. If it is visible, a virtual boundary is generated.
[0019] A robot admittance control device comprises a three-dimensional navigation tracking system and a robotic arm patient tracer. The robotic arm comprises a base and an end. The end of the robotic arm is provided with a power tool and a mass spring damping system. The power tool is provided with a positioning tracer. The three-dimensional navigation tracking system is used for visually capturing and determining the positions and postures of the patient tracer and the positioning tracer.
[0020] Furthermore, it also includes:
[0021] A generation module, used for generating a virtual boundary based on a three-dimensional navigation and tracking system;
[0022] A force analysis module is used to obtain the external force on the robot in real time based on the mass spring damping system at the end of the robot arm, and generate the contact force at the end of the power tool;
[0023] A calculation module, used for calculating the desired posture of the current control cycle based on the admittance control module and the contact force;
[0024] The control module is used to obtain the desired posture of the computing module, generate control variables to input into the robotic arm, and control the movement of the robotic arm.
[0025] An electronic device comprises a processor and a memory, wherein the memory stores computer executable instructions, and the instructions are used to implement the above-mentioned robot admittance control method when executed by the processor.
[0026] A readable storage medium stores a computer program, and when the computer program is executed on a processor, the robot admittance control method described above is implemented.
[0027] In summary, the present invention is beneficial in that:
[0028] The present invention establishes the virtual boundary of the working area based on vision through the three-dimensional navigation and tracking system, which forms a very accurate reference for the robot's admittance control. In the admittance control process, the robot can clearly contrast the expected posture calculated by real-time analysis with the virtual boundary, so as to intuitively obtain the motion trajectory of the robot under the action of external force of the user, and then realize accurate admittance control action, ensure that the robot moves within a safe boundary, and effectively improve the accuracy of the robot's admittance control. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1 It is a schematic diagram of the structure of a robot navigation closed-loop control system of the present invention.
[0030] Figure 2 The figure is a flowchart of a robot admittance control method of the present invention.
[0031] Figure 3 The figure is a schematic structural diagram of a robot admittance control device of the present invention. DETAILED DESCRIPTION
[0032] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.
[0033] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.
[0034] All directional indications in the embodiments of the present invention (such as up, down, left, right, front, back, horizontal, vertical...) are only used to explain the relative position relationship, movement status, etc. between the components in a certain specific posture. If the specific posture changes, the directional indication will also change accordingly.
[0035] This embodiment discloses a robot navigation closed-loop control system, referring to Figure 1 , including a three-dimensional navigation and tracking system, a robotic arm 102, a C-arm machine 105, a host computer 101, and a patient tracer.
[0036] The robot arm 102 includes a base and an end, and a plurality of movable joints are provided between the base and the end. The base of the robot arm 102 is installed on a trolley, and the base and the end of the robot arm 102 may be provided with tracers.
[0037] The host computer 101 is in communication connection with the robot arm 102 , and the host computer 101 can obtain the real-time coordinate conversion relationship between the base coordinate system and the end coordinate system of the robot arm 102 in real time, and drive the robot arm 102 to move through instructions.
[0038] The three-dimensional navigation and tracking system can be a three-dimensional navigation system based on physical principles, such as an infrared optical navigation system, a visible light optical navigation system, a magnetic navigation system, and an electric navigation system; the three-dimensional navigation and tracking system is communicatively connected with the host computer 101 to capture the position and posture of the tracer.
[0039] The C-arm machine 105 is used to scan a patient, for example, to scan an X-ray image or a computed tomography (CT) image.
[0040] The patient tracer is installed near the patient's lesion to characterize the patient's position. The patient tracer can be captured by the three-dimensional navigation and tracking system to track the patient's position in real time.
[0041] The three-dimensional navigation and tracking system in this embodiment is preferably an optical navigation system, including a camera.
[0042] A power tool 103 is installed at the end of the robotic arm 102 for power control of surgery. The end of the power tool 103 is a power component, which can be placed in various medical surgical instruments. The rear end is fixedly connected to the flange at the end of the robotic arm 102.
[0043] The power tool 103 is equipped with a positioning tracer, which can be captured by the three-dimensional navigation tracking system in real time to determine the position and posture of the power tool 103. The coordinate transformation relationship between the power tool 103 and the end of the robotic arm 102, and the coordinate transformation relationship between the base coordinate system and the end coordinate system are used to obtain the coordinate transformation relationship between the power tool 103 and the base coordinate system, so that the robotic arm 102 can accurately control the movement of the power tool 103. The number of positioning tracers can be set to multiple.
[0044] A virtual mass-spring-damping system is also provided at the end of the robotic arm 102, which is used to analyze the external force applied by the user to the end of the robotic arm 102 to obtain Fext of the tip position of the power tool 103, wherein Fext includes the force and torque in the XYZ directions; the mass-spring-damping system used in this embodiment and the method for obtaining Fext by analyzing the mass-spring-damping system both adopt existing technologies, so they will not be elaborated here.
[0045] Based on the above robot navigation closed-loop control system, this embodiment also provides a robot admittance control method, which generates virtual boundaries of a specific prosthesis and control parameters related to admittance control through vision, performs admittance control under human collaboration, ensures that the surgery is performed under safe boundary conditions, and completely ensures that the planned posture is achieved, so as to help doctors achieve stable and safe operation of the robot arm during joint surgery, reduce the exposure time of the patient's surgical area, and provide doctors with precise control, thereby improving the doctor's experience of robot arm collaboration during surgery; specifically, the following steps are included:
[0046] S1. Generate a virtual boundary of a power tool working area.
[0047] The virtual boundary is the spatial area where the power tool itself and its range of motion should be located and not exceed when working during a complete operation. In hip reaming surgery, the virtual boundary can be the boundary of the prosthesis when the lesion is subsequently installed. The virtual boundary is generated by a virtual boundary generation algorithm in the prior art based on the three-dimensional navigation and tracking system that captures the patient's posture in real time through vision, combined with the scanning image coordinate system generated in the X-ray image or CT image. The virtual boundary includes the boundary shape, equilibrium position, and the virtual inertia matrix, virtual damping matrix, and virtual stiffness matrix of the power tool in the virtual boundary.
[0048] The generation of the virtual boundary and its algorithm may adopt a variety of generation methods in the prior art, which are directly cited from the prior art and will not be described in detail here.
[0049] Among them, before generating the virtual boundary, the positioning tracer is also included in the calibration. The three-dimensional navigation tracking system is used to determine whether the positioning tracer is visible. If it is not visible, the admittance control method is terminated. If it is visible, a virtual boundary is generated. The visibility of the positioning tracer is an important factor in the robot arm's ability to accurately control the movement of the power tool. By calibrating the positioning tracer before generating the virtual boundary, the control process is rationalized to ensure the stability and safety of the robotic surgery.
[0050] S2. Generate the robot's admittance control model.
[0051] The admittance control model is expressed as:
[0052]
[0053] Among them, F ext is the contact force at the tip of the power tool, which includes the force and moment in the XYZ direction, F ext The generation of is obtained by using the mass spring damping system at the end of the robot arm to analyze the external force applied by the user in real time; M is the virtual inertia matrix of the robot, B is the virtual damping matrix of the robot, and K is the virtual stiffness matrix of the robot. M, B, and K are all sixth-order matrices and can be set; is the desired posture of the robot, is the desired speed of the robot, x d is the expected acceleration of the robot, is the actual position of the robot, is the actual velocity of the robot, and x is the actual acceleration of the robot.
[0054] S3, responding to the external force applied by the user to the robot, obtaining the contact force in real time, and combining the admittance control model to obtain the desired posture parameters;
[0055] The process of combining the admittance control model with the contact force to obtain the desired posture also includes discretizing the admittance control model to obtain the corresponding desired posture, desired velocity, and desired acceleration model:
[0056]
[0057]
[0058]
[0059] Among them, t is the set control period.
[0060] S4, generating a corresponding robot action response by comparing the expected posture with the virtual boundary;
[0061] The robot action response modes include:
[0062] Response method 1: In any current control cycle, if the desired posture is within the virtual boundary, the control quantity is directly generated and sent to the robot arm, and the robot arm is controlled to drive the power tool to perform mobile following;
[0063] Response method two: In any current control cycle, if the desired posture exceeds the virtual boundary, the current desired acceleration and desired speed are constrained and a new desired posture is calculated so that the new desired posture can be within the virtual boundary. The control amount of the robot arm is generated according to the new desired posture, so that the robot arm drives the power tool to move.
[0064] By analyzing the positional relationship between the desired posture and the virtual boundary in real time, while accurately controlling the robot to follow the user's external force movement, it can effectively form feedback and constraints for external forces that exceed the limit, always maintaining the power tool within the virtual boundary, thereby ensuring the stability and safety of the entire robotic surgery.
[0065] The constraint method and calculation method for the expected acceleration and the expected speed are directly referenced from the prior art and will not be elaborated here.
[0066] It should be supplemented that the virtual boundary also includes an equilibrium position. When the robot stops being subjected to external force from the user, the power tool can be controlled by the robotic arm to return to the equilibrium position, and the equilibrium position is a settable parameter. Whether to set the equilibrium position is selected according to the needs of the user; specifically, when setting the equilibrium position, when the robot is subjected to external force from the user, the elements of the virtual stiffness matrix are set to zero, so that no restoring force based on the equilibrium position occurs during the user's dragging of the power tool.
[0067] Based on the admittance control method in the above embodiment, this embodiment further proposes a robot admittance control device, including:
[0068] The generation module 201 is used to generate a virtual boundary at the lesion based on the visual feedback of the three-dimensional navigation and tracking system. A patient tracer that can be captured in real time by the three-dimensional navigation and tracking system is installed at the lesion to characterize the position of the lesion and further generate a virtual boundary. The device and method for generating a virtual boundary based on vision in this embodiment are direct references to the prior art, so they will not be described in detail.
[0069] The force analysis module 202 is used to obtain the external force exerted on the robot in real time based on the mass spring damping system at the end of the robot arm 102 , and generate the contact force at the end of the power tool 103 .
[0070] The calculation module 203 is used to calculate the expected posture of the current control cycle based on the admittance control model and the contact force generated by the force analysis module 202.
[0071] The control module 204 is used to obtain the desired posture generated by the calculation module 203 and generate a control variable to be input to the robot arm 102 to control the movement of the power tool 103 .
[0072] The generating module 201 is further used to calibrate the positioning tracer based on the three-dimensional navigation tracking system, and to determine whether the positioning tracer is visible based on vision, and if so, to generate a virtual boundary.
[0073] The calculation module 203 is also used to compare the expected posture and the virtual boundary in any control cycle. If the expected posture is within the virtual boundary, the expected posture is directly sent to the control module 204; if the expected posture exceeds the virtual boundary, the current expected acceleration and expected speed are constrained to recalculate the new expected posture within the virtual boundary and send it to the control module 204.
[0074] The present application also provides an electronic device, including a processor and a memory, wherein the memory stores a computer program, and the processor runs the computer program to enable the electronic device to execute the functions of each module in the above-mentioned admittance control method or the above-mentioned admittance control device.
[0075] The present application also provides a readable storage medium for storing the computer program used in the above electronic device.
[0076] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and structure diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in an alternative implementation, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the structure diagram and / or the flow diagram, and the combination of boxes in the structure diagram and / or the flow diagram, can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.
[0077] In addition, the functional modules or units in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
[0078] If the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art, and the computer software product is stored in a storage medium, including several instructions for a computer device (which can be a smart phone, a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk.
[0079] Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
Claims
1. A robot admittance control method, characterized in that: The following steps are involved: S1, generate virtual boundary; S2, responding to the external force applied by the user to the robot to obtain the contact force, and obtaining the desired posture in the current control cycle based on the robot's admittance control model; S3, comparing the desired posture and virtual boundary in the current control cycle, generating a corresponding robot action response mode to control the robot movement; In the current control cycle, if the desired posture is within the virtual boundary, the control amount is directly generated and sent to the robot arm to control the robot arm to move; In the current control cycle, if the desired posture exceeds the virtual boundary, the current desired acceleration and desired velocity are constrained to calculate the new desired posture so that the new desired posture can be within the virtual boundary. The control amount of the robot arm is generated according to the new desired posture to control the robot arm to move.
2. A robot admittance control method according to claim 1, characterized in that: In step S2, the admittance control model of the robot is: Among them, F ext is the contact force at the tip of the power tool; M is the virtual inertia matrix of the robot, B is the virtual damping matrix of the robot, and K is the virtual stiffness matrix of the robot; is the desired posture of the robot, is the desired speed of the robot, x d is the expected acceleration of the robot, is the actual position of the robot, is the actual velocity of the robot, and x is the actual acceleration of the robot.
3. A robot admittance control method according to claim 2, characterized in that: In step S2, the contact force is obtained through a mass spring damping system arranged on the robot, and the contact force includes force and torque in the XYZ directions.
4. A robot admittance control method according to claim 1, characterized in that: In step S1, a virtual boundary is generated based on a three-dimensional navigation and tracking system. Before generating the virtual boundary, the three-dimensional navigation and tracking system is used to determine whether the positioning tracer is visible. If it is not visible, the robot admittance control method is terminated. If it is visible, a virtual boundary is generated.
5. A robot admittance control device, used to execute the robot admittance control method according to any one of claims 1 to 4, characterized in that: It includes a three-dimensional navigation and tracking system and a robotic arm patient tracer. The robotic arm includes a base and an end. The end of the robotic arm is provided with a power tool and a mass spring damping system. The power tool is provided with a positioning tracer. The three-dimensional navigation and tracking system is used for visually capturing and determining the positions and postures of the patient tracer and the positioning tracer.
6. A robot admittance control device according to claim 5, characterized in that: Also includes: A generation module, used for generating a virtual boundary based on a three-dimensional navigation and tracking system; A force analysis module is used to obtain the external force on the robot in real time based on the mass spring damping system at the end of the robot arm, and generate the contact force at the end of the power tool; A calculation module, used for calculating the desired posture of the current control cycle based on the admittance control module and the contact force; The control module is used to obtain the desired posture of the computing module, generate control variables to input into the robotic arm, and control the movement of the robotic arm.
7. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer executable instructions, and when the instructions are executed by the processor, they are used to implement the robot admittance control method according to any one of claims 1 to 4.
8. A readable storage medium, characterized in that: The computer program is stored therein, and when the computer program is executed on a processor, the robot admittance control method according to any one of claims 1 to 4 is implemented.
Citation Information
Patent Citations
Robot safety protection method, device and system
CN111055276A
Virtual fixture control method and system with high auxiliary precision for robot operation
CN111660307A
System and method for guiding movement of handheld medical robotic instrument
CN115916093A
Method and device for determining target attitude of mechanical arm and storage medium
CN117084788A
Control method and equipment for interventional pose adjustment joint and storage medium
CN117159143A
