A human-machine interactive control method and system for a serpentine flexible robotic arm

By installing a camera at the end of the snake-shaped flexible robot arm and performing specific actions, the problem of low navigation efficiency of multi-degree-of-freedom robot arm in unknown environments is solved, and efficient navigation and obstacle avoidance is achieved, with the characteristics of simple operation and high efficiency.

CN113843786BActive Publication Date: 2024-11-05HANGZHOU YOURONG INTELLIGENT CONTROL TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010599374.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-06-28
Publication Date
2024-11-05
Estimated Expiration
2040-06-28

AI Technical Summary

Technical Problem

The multiple degrees of freedom of the snake-shaped flexible robot arm lead to the inapplicability of the traditional teaching control method, manual control is inefficient in navigation efficiency and poor flexibility in unknown environments, and lacks efficient control methods.

Method used

By installing a camera at the end of the robotic arm, perform four actions: "end bend", " snake forward", " snake backward", and " end translation", and use visual feedback to achieve navigation and obstacle avoidance, only the end direction and progress need to be controlled Back, the remaining joints automatically follow the path.

Benefits of technology

It realizes efficient navigation and obstacle avoidance in a small environment, is simple to operate and efficient, and is suitable for robot control in unknown spaces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113843786B_ABST
    Figure CN113843786B_ABST
Patent Text Reader

Abstract

The present invention provides a human-machine interactive control method and system for a serpentine flexible robotic arm, which relates to the technical field of robotic arm control. The robotic arm includes a horizontal slide, a drive module and a plurality of joints; the plurality of joints are arranged in series on the drive module, and the drive module is slidably arranged on the horizontal slide; the human-machine interactive control method of the robotic arm includes step 1: sending a motion command to the robotic arm through an operating handle; step 2: the robotic arm recognizes the motion command and performs four actions of "end bending", "snaking forward", "snaking backward" and "end translation". The present invention crosses obstacles to reach the target position through the end following motion method, and only needs to control the direction of the end and the overall forward and backward movement, and the remaining joints follow the path of the end, so the main end joint does not contact the obstacle, and the remaining joints can achieve automatic obstacle avoidance, which is particularly suitable for manual control based on visual feedback, and has the advantages of simple operation and high efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of robot arm control, and in particular to a human-machine interactive control method and system for a serpentine flexible robot arm. Background Art

[0002] Most robotic arms have more than ten degrees of freedom, which are suitable for use in small environments. Compared with traditional articulated industrial robots, they can flexibly avoid obstacles and cross holes. However, due to the large number of degrees of freedom, the control process is relatively cumbersome, especially in manual control. The simple teaching control method is no longer applicable, and a control method with less control and high efficiency is needed. Therefore, it is of great significance to study the motion control method of robotic arms.

[0003] The navigation methods of the robot arm can be divided into two categories: automatic navigation and manual control navigation. Automatic navigation performs path planning in a known environment, so it is necessary to model the environment first, which is not suitable in many scenarios; automatic navigation in an unknown environment requires sensors to detect environmental obstacles and achieve obstacle avoidance. However, the current automatic navigation strategy is not perfect, with shortcomings such as poor fault tolerance, low efficiency, and poor flexibility, and has not been put into practical use. In contrast, manual control is more flexible, efficient, and can be adapted to more occasions, such as: dangerous environment surveys, underwater operations, special equipment maintenance, etc.; however, since the serpentine flexible robot arm usually has more than ten degrees of freedom, the traditional seven-degree-of-freedom robot arm teaching control method is no longer applicable, and a control method with less control and high efficiency is needed. Summary of the invention

[0004] In view of the shortcomings of the prior art mentioned above, the purpose of the present invention is to provide a human-computer interaction control method and system for a serpentine flexible robotic arm, which observes obstacles and target positions in the environment through a camera installed at the end of the robotic arm, and traverses obstacles to reach the target position through an end-following motion method. It only needs to control the direction of the end and the overall forward and backward movement, and the remaining joints follow the path of the end. Therefore, the main end joints do not contact obstacles, and the remaining joints can achieve automatic obstacle avoidance. It is particularly suitable for manual control based on visual feedback, and has the advantages of simple operation and high efficiency.

[0005] The present invention provides a human-machine interactive control method for a serpentine flexible robotic arm, wherein the robotic arm comprises a horizontal slide, a driving module and a plurality of joints; the plurality of joints are arranged in series on the driving module, and the driving module is slidably arranged on the horizontal slide; the human-machine interactive control method for the robotic arm comprises the following steps:

[0006] Step 1: Send motion instructions to the robotic arm through the operating handle;

[0007] Step 2: The robot recognizes the motion command and executes four actions: "end bending", "snaking forward", "snaking backward", and "end translation" to achieve navigation and obstacle avoidance in a narrow environment. In one embodiment of the present invention, when executing the "end bending" action, the end joint axis direction is adjusted, and the axis direction is used as the forward direction of the robot.

[0008] In one embodiment of the present invention, when performing a "snaking forward" action, the end joint point moves forward along the axial direction of the end joint, and the remaining joint points move forward along the current path in turn, and the forward trajectory is recorded; wherein, the current path is the line connecting several joints when performing the action.

[0009] In one embodiment of the present invention, when the "snaking backward" action is executed, all related nodes reversely execute the recorded forward trajectory.

[0010] In one embodiment of the present invention, when the “terminal translation” action is performed, the axial direction of the terminal joint remains unchanged, and the rotation angles of the terminal joint and one or two joints close to the terminal joint are changed.

[0011] In an embodiment of the present invention, the plurality of joints are respectively a first joint, a second joint, ..., and a terminal joint according to the distances between the joints and the driving module.

[0012] In one embodiment of the present invention, a camera is provided on the terminal joint, and the camera is used to collect an image of the external environment of the terminal joint and display it through a display screen.

[0013] In one embodiment of the present invention, the connection point between the first joint and the driving module, the connection point between the first joint and the second joint, ..., and the connection point of the terminal joint are respectively the first joint point, the second joint point, ..., and the terminal joint point.

[0014] The present invention provides a human-machine interactive control system for a serpentine flexible robotic arm, the control system comprising an operating handle and a robotic arm, the operating handle sends motion instructions to the robotic arm, the robotic arm receives the motion instructions and performs four actions of "end bending", "serpentine forward", "serpentine backward" and "end translation" to achieve navigation and obstacle avoidance in a confined environment.

[0015] As described above, a human-computer interaction control method and system for a serpentine flexible robotic arm of the present invention has the following beneficial effects: the present invention adopts four actions of "end bending", "serpentine forward", "serpentine backward" and "end translation", and adopts a combination of an operating handle and a display screen to solve the control and navigation problems of a serpentine multi-degree-of-freedom robotic arm in an unknown space under machine vision, and has the characteristics of simple operation, easy to use, high efficiency and simple overall structure. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 Shown is a schematic diagram of the structure of the robotic arm disclosed in an embodiment of the present invention.

[0017] Figure 2 Shown is a flow chart of the end-following motion control disclosed in an embodiment of the present invention.

[0018] Figure 3 It is a schematic diagram showing an embodiment of “snaking forward” and “end bending” disclosed in an embodiment of the present invention.

[0019] Figure 4 It is a schematic diagram showing another embodiment of the “snaking advancement” and “end bending” disclosed in the embodiments of the present invention.

[0020] Figure 5 It is a schematic diagram of a “snaking retreat” embodiment disclosed in an embodiment of the present invention.

[0021] Figure 6 Shown is a schematic diagram of a “terminal translation” embodiment disclosed in an embodiment of the present invention.

[0022] Figure 7 Shown is a schematic diagram of the control interface disclosed in an embodiment of the present invention.

[0023] Figure 8 Shown is a schematic diagram of an operating handle embodiment disclosed in an embodiment of the present invention.

[0024] Fig. 9 Shown is a schematic diagram of an embodiment of the complete operation of the robotic arm disclosed in an embodiment of the present invention.

[0025] Markings in the figure: 101-horizontal slide, 102-driving module, 103-joint, 104-first joint point, 105-end joint, 106-end joint point. DETAILED DESCRIPTION

[0026] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0027] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0028] The present invention provides a human-machine interactive control method for a serpentine flexible robotic arm. Figure 1 The robotic arm includes a horizontal slide 101, a driving module 102, and a plurality of joints 103; the plurality of joints 103 are arranged in series on the driving module 102, and the driving module 102 is horizontally slidably arranged on the horizontal slide 101; wherein, the specific structure and connection relationship of the robotic arm refer to the patent application document: a high-redundancy flexible robotic arm device capable of detecting joint posture, application publication number: CN107363820A.

[0029] Among them, the driving module 102 and several joints 103 can move forward and backward on the horizontal slide 101. Each joint 103 has two orthogonal bending degrees of freedom. The four actions of "end bending", "snaking forward", "snaking backward" and "end translation" can be realized by coordinating the actions of several joints 103.

[0030] Specifically, the joints 103 are respectively called the first joint, the second joint, ..., the terminal joint 105 according to the distance between them and the driving module 102; the connection points between the first joint and the driving module 102 and between the first joint and the second joint are respectively named the first joint point 104, ..., the terminal joint point 106.

[0031] In order to solve the problem of human-computer interaction of a multi-degree-of-freedom robotic arm, the present invention uses four actions, namely, "end bending", "snaking forward", "snaking backward", and "end translation", to realize the navigation and obstacle avoidance of the robotic arm in a narrow environment.

[0032] Among them, the four actions of "terminal bending", "snaking forward", "snaking backward" and "terminal translation" are all realized by combining the two basic actions of bending and translation; among them, bending means that each joint 103 can realize independent bending action; translation means that several joints 103 together with the driving module 102 can move forward and backward along the horizontal direction as a whole;

[0033] Specifically, the human-machine interactive control method of the serpentine flexible robotic arm comprises the following steps:

[0034] Step 1: Send control instructions to the robotic arm through the operating handle;

[0035] See also Figure 8When LS is pushed forward, the operating handle sends a "snake forward" motion command to the robot arm; when LS is pushed backward, the operating handle sends a "snake forward" motion command to the robot arm; when RS is pushed forward, the operating handle sends a "end bend" motion command to the robot arm; when RS and LS are pushed forward at the same time, the operating handle sends both "snake forward" and "end bend" motion commands to the robot arm;

[0036] RB is the function switching button. When RB is pressed and LS is pushed forward or backward, the base of the robotic arm moves forward or backward accordingly, and the bending angle of the robotic arm remains unchanged. When RB is pressed and RS is pushed forward, the operating handle sends the "end translation" motion command to the robotic arm at the same time. LB is used to temporarily lock the robotic arm. When LB is pressed, the robotic arm is locked and does not receive control commands, keeping the current posture unchanged. It is unlocked when LB is pressed again.

[0037] Step 2: The robot arm recognizes the motion command and performs four actions: "end bending", "snaking forward", "snaking backward", and "end translation" to achieve navigation and obstacle avoidance in a narrow environment;

[0038] (1) When performing the "end bending" action, adjust the axis direction of the end joint and use the axis direction as the forward direction of the robot arm;

[0039] (2) When executing the "snaking forward" action, the end joint point moves forward along the axial direction of the end joint, and the remaining joint points move forward along the current path in turn, that is, the end following process is realized, and the forward trajectory is recorded; wherein the current path is the connection line of several joints when executing the action command;

[0040] See also Figure 2 , assuming that the robot arm includes three joints, point a0 is the first joint point, a3 is the end joint point, a0-a1-a2-a3 is the current path, and the distance between two adjacent joint points is L. As the robot arm moves toward the end joint point, a3 translates a distance L to reach the target G; this process is divided into several steps. If the step size is set to 0.1L, it takes 10 steps to reach the target G;

[0041] Assuming the step length is Δtip, a0-a1-a2-a3 moves along the current path to b0-b1-b2-b3 to form a new path; b0-b1-b2-b3 and a0-a1-a2-a3 form two triangles, represented as △b0a1b1 and △b1a2b2 respectively. Since the current joint parameters are known, the coordinates of points a0 a1 a2 a3 are obtained according to forward kinematics. In △b0a1b1 and △b1a2b2, the cosine theorem can be used to obtain equations (1) and (2):

[0042] la2 2 =l2 2 +l t2 2 -2·l2·l t2 ·cos a2 (1);

[0043] l t2 +l1=L (2)

[0044] Since the distance between adjacent joints is L, a3 moves toward the end joint axis, so l1+l t2 =L, l2 = Δp;

[0045] Starting from the end, solving each triangle, l1 can be calculated by formula (3):

[0046]

[0047] Rewrite equation (3) as equation (4):

[0048]

[0049] After solving each triangle, use the homogeneous coordinate transformation as equation (5) to get the new path b0-b1-b2-b3…. an ] is the position of the joint point in the original path, [p bn ] is the position of the joint point in the new path:

[0050]

[0051] After obtaining the coordinates of each node of the new path, the last step is to calculate the bending angle of each section. The two bending angles of each section can be solved based on the joint position and joint space kinematics. Therefore, when the robot moves a certain distance along the desired path, the new path and its corresponding arrangement can be calculated using geometric methods; since one step has been calculated, in the next step, the robot should move forward Δtip*2 until it reaches the target point G;

[0052] This process can be written as equation (6), where config represents the current path, target represents the target point G of the robot, and step size represents the step size of the robot. The bending angle θ and base displacement (α, b) of each step when reaching the target point G are calculated as follows:

[0053] f(config,target,step size)=[arrangement(θ,α,b)] (6);

[0054] Therefore, the end-following process can be written as formula (7)

[0055] f(config,target,step size)=f(config(a0,a1,a2,a3),G,Δtip) (7);

[0056] (3) When executing the “snaking backward” action, all relevant nodes execute the recorded forward trajectory in the reverse direction;

[0057] (4) When performing the “terminal translation” action, the axial direction of the terminal joint remains unchanged, and the rotation angles of the terminal joint and one or two joints close to the terminal joint are changed;

[0058] See also Figure 3 , ①~② is an implementation example of executing the "end bending" action instruction, and the end joint can bend in any specified direction in space. ②~④ is an implementation example of executing the "snaking forward" action instruction, the end joint point will move along the direction of the end joint axis, and the remaining joint points will move along the current path to achieve the end following effect. ①~④ is a way for the robot arm to first determine the bending direction and then move forward to approach the target point.

[0059] See also Figure 4 , an embodiment of executing the "snaking forward" action and the "end bending" action command at the same time, the operator first specifies a direction, and then the robot arm bends and moves forward at the same time. ① to ④ are the robot arm approaching the target point by bending and moving forward at the same time.

[0060] See also Figure 5 , is an embodiment of executing the "snake back" action instruction. Figure 4 After the action in , ① is the current posture of the robot arm. When the robot arm executes the "snake backward" action instruction, it executes the recorded forward trajectory in reverse order, as shown in ②~④.

[0061] When approaching the target point, the efficiency of using the above "snake forward" instruction to approach the target is low. In order to quickly eliminate the error, refer to Figure 6 , the "end translation" action can be used. "End translation" ensures that the direction of the end joint axis remains unchanged, and fine-tunes the position of the end joint in space by changing the rotation angle of the end joint and 1 to 2 joints close to the end joint.

[0062] Specifically, a camera is provided at the end node of the robot arm, and the camera can collect the external environment image of the end of the robot arm and display it on the display. The relative distance to the target position is judged through the image collected by the camera, and the environmental obstacles are observed; please refer to Figure 7 ,The display interface mainly displays the image captured by the camera, and there is a small window showing the current position of the robot arm.

[0063] See also Fig. 9 ,①~⑧ describe a typical working process of the robot arm. The working goal is to enter a pipe. In ①~④, the robot arm first performs the "snaking forward" action and the "end bending" action to bend upward and move forward at the same time. After reaching a certain height, ⑤~⑥ The robot arm simultaneously performs the "snaking forward" and "end bending" actions to bend downward and move forward. At this time, the end joint is close to horizontal but has a certain deviation from the target position. At this time, as shown in ⑥~⑦, the "end translation" action is performed, and the end translates downward and aligns with the target pipe mouth. Finally, as shown in ⑧, the "snaking forward" is performed, and the robot arm reaches the target position. After executing the action, the robot arm can perform the "snaking backward" to return along the original path.

[0064] The present invention discloses a human-machine interactive control system for a serpentine flexible robotic arm. The system is implemented based on the above method. The control system includes an operating handle and a robotic arm. The operating handle sends motion instructions to the robotic arm, and the robotic arm receives the motion instructions and performs four actions of "end bending", "serpentine forward", "serpentine backward" and "end translation" to achieve navigation and obstacle avoidance in a confined environment.

[0065] In summary, the camera installed at the end of the robot arm observes obstacles and target positions in the environment, and the end-following motion method is used to cross obstacles to reach the target position. It only needs to control the direction of the end and the overall forward and backward movement, and the remaining joints follow the path of the end. Therefore, the main end does not contact the obstacle, and the remaining joints can achieve automatic obstacle avoidance, which is particularly suitable for manual control based on visual feedback, and has the advantages of simple operation and high efficiency. Therefore, the present invention effectively overcomes the various shortcomings of the prior art and has a high industrial utilization value.

[0066] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A human-machine interactive control method for a serpentine flexible robotic arm, characterized in that: The robot arm includes a horizontal slide, a driving module and a plurality of joints; the plurality of joints are arranged in series on the driving module, and the driving module is slidably arranged on the horizontal slide; the plurality of joints are respectively a first joint, a second joint, ..., and a terminal joint according to the distance between the joints and the driving module; The connection point between the first joint and the driving module, the connection point between the first joint and the second joint, ..., and the connection point of the terminal joint are respectively the first joint point, the second joint point, ..., and the terminal joint point; the human-machine interaction control method of the robot arm comprises the following steps: Step 1: Send motion instructions to the robotic arm through the operating handle; Step 2: The robot arm recognizes the motion command and performs four actions: "end bending", "snaking forward", "snaking backward", and "end translation" to achieve navigation and obstacle avoidance in a narrow environment; When performing the "end bending" action, adjust the end joint axis direction and use the axis direction as the forward direction of the robot arm; When performing the "snaking forward" action, the end joint point moves forward along the axial direction of the end joint, and the remaining joint points move forward along the current path in turn, and the forward trajectory is recorded; wherein the current path is the connection line of several joints when performing the action; When executing the "snake back" action, all related nodes execute the recorded forward trajectory in reverse; When performing the "end translation" action, the axial direction of the end joint remains unchanged, and the rotation angle of the end joint and one or two joints close to the end joint is changed.

2. A human-machine interactive control system for a serpentine flexible robotic arm, characterized in that: The system is used to implement the human-machine interactive control method for a serpentine flexible robotic arm as described in claim 1, the control system includes an operating handle and a robotic arm, the operating handle sends motion instructions to the robotic arm; the robotic arm receives the motion instructions and performs four actions of "end bending", "snaking forward", "snaking backward" and "end translation" to achieve navigation and obstacle avoidance in a narrow environment; a camera is provided on the end joint, and the camera is used to collect the external environment image of the end joint and display it through a display screen.