Compliant force control method based on fuzzy reinforced learning for mechanical arm

A technology of reinforcement learning and control methods, applied to manipulators, program-controlled manipulators, manufacturing tools, etc., can solve the problem of ensuring smooth and smooth human-computer interaction operations, difficulty in taking into account control accuracy and operating experience, and inapplicable robot active positioning requirements and other issues, to achieve the effect of smooth and natural human-computer interaction experience, good adaptive ability, and improved positioning accuracy

Active Publication Date: 2017-08-18
SUZHOU KANGDUO ROBOT
View PDF4 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current active compliance control method uses the method of installing a force sensor at the end of the manipulator to control the position movement of the end effector of the manipulator in the Cartesian space. It often focuses on the position trajectory of the end tool rather than the attitude adjustment, coupled with the fixed force interaction. The position is not convenient for the independent adjustment of the posture of the connecting rod of the manipulator, so it is not suitable for the active positioning requirements of minimally invasive surgical robots
In addition, this type of method also has certain problems. If a fixed control parameter model is used, it is difficult to take into account the control accuracy and operating experience. If a variable control parameter model is used, it is difficult to ensure the suppleness and smoothness of human-computer interaction.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Compliant force control method based on fuzzy reinforced learning for mechanical arm
  • Compliant force control method based on fuzzy reinforced learning for mechanical arm
  • Compliant force control method based on fuzzy reinforced learning for mechanical arm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] Such as figure 1 As shown, a method for controlling compliance of a robotic arm based on fuzzy reinforcement learning of the present invention includes the following steps:

[0032] S1: Establish an admittance control model.

[0033] S2: Obtain the motion state of the robotic arm, the external torque applied by the operator, and the environmental return value. The motion state of the robot arm includes the speed and acceleration of each active rotating joint of the robot arm.

[0034] S3: In order to obtain the admittance model parameter adjustment strategy adapted to the current environment, according to the relevant information obtained in step S2, perform online training of the admittance model parameter adjustment strategy through fuzzy reinforcement learning until the algorithm converges, in order to obtain the current Variable admittance control model adapted to the environment. The fuzzy reinforcement learning in step S3 specifically includes the following steps:

[00...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a compliant force control method based on fuzzy reinforced learning for a mechanical arm. A fuzzy reinforced learning algorithm is adopted, a real-time adjustment strategy for admittance parameters is trained in a manner of online learning, and a motor is controlled by the converged variable-admittance control strategy according to an external moment applied by an operator, and the current joint speed and acceleration to actively comply with a control intention of the operator, so as to complete an active following task of the mechanical arm, without the need of establishing corresponding task and environment model, so that a higher convergence speed and a stable actual effect are achieved. The method is capable of remarkably lowering the working intensity of the operator and improving the location accuracy, and conducive to reduce the structural dimension and the dead weight of the mechanical arm; a haptic human-machine interaction model is capable of greatly responding to the control intention of the operator, and high in self-adaptive capacity, so that haptic human-machine interaction experience is smoother and more natural, and more similar to haptic interaction experience during operation for an actual object in daily life.

Description

Technical field: [0001] The invention belongs to the technical field of man-machine interactive control, and specifically relates to a method for controlling compliance of a mechanical arm based on fuzzy reinforcement learning. Background technique: [0002] Before performing robot-assisted minimally invasive surgery, medical staff need to formulate a corresponding surgical plan according to the individual characteristics of the patient, select the incision position for minimally invasive surgery, and set the initial posture of each robotic arm accordingly. During the execution, it is necessary to drag each manipulator to the minimally invasive incision position and manually adjust the joint angle of the surgical arm, that is, the operator directly applies external force to the manipulator, and adjusts the position and posture of each link of the manipulator according to the operation intention . Generally, a manipulator uses a reducer as the transmission link of the joint power...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): B25J9/16B25J13/08
CPCB25J9/163B25J13/085
Inventor 杨文龙王伟庞海峰
Owner SUZHOU KANGDUO ROBOT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products