A mobile working robot with coordinated control of hands, eyes and feet
By coordinating and controlling the moving body, robotic arm, and end effector in the same set of three-dimensional coordinate systems, the problem of discontinuous movements in existing technologies has been solved, achieving efficient and intelligent human-like operation.
Patent Information
- Application Number
- CN202210582442.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-26
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2042-05-26
AI Technical Summary
Existing mobile robot control technologies are mostly separate controls, resulting in disjointed movements between the robotic arm and the mobile body, low intelligence, poor flexibility and efficiency, and an inability to achieve human-like operation.
Using a hand-eye-foot coordinated control method, the mobile body, robotic arm and end effector move collaboratively in the same three-dimensional coordinate system. The motion control quantity of each component is determined by weighting coefficients, and vision sensors and lidar sensors are used for real-time perception and obstacle avoidance.
It achieves synchronous coordination of the mobile body, robotic arm and end effector, improves the continuity and efficiency of operation, has human-like operation characteristics, higher level of intelligence, and more continuous and coordinated movements.
Smart Images

Figure CN114952792B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of intelligent mobile working robots, and in particular relates to a mobile working robot with coordinated control of hands, eyes and feet. Background Art
[0002] At present, mobile working robots (with robotic arms installed on a mobile body) have wider and more flexible application scenarios than fixed robotic arm robots, especially in the field of industrial production lines, and are becoming a new force in the field of intelligent manufacturing.
[0003] In the prior art, the control technology for mobile working robots is mostly separated control, that is, the mobile control of the mobile body and the control of the mechanical arm are controlled separately. The advantage of this is that the control is simple to implement and can meet the requirements in most occasions, but it lacks intelligence and flexibility, and cannot perform "human-like" operations like humans, with low work efficiency and poor flexibility. In this control mode, the robot typically behaves as follows: the mobile body moves first, stops when the mobile body approaches the work object, and then the mechanical arm starts to move to operate or work; during the entire mobile operation process, the movements of the mechanical arm and the mobile body are incoherent and uncoordinated, the operating efficiency is low, and the degree of intelligence is low. Summary of the invention
[0004] In view of this, the present invention proposes a mobile working robot with coordinated control of hands, eyes and feet, including a mobile body, a terminal actuator and a mechanical arm, the motion control of which is completed in the same three-dimensional coordinate system, and the motion control amount of the mobile body, the mechanical arm and the terminal actuator is determined according to the weight coefficient. While the mobile body is in the working posture, the mechanical arm has completed driving the terminal actuator to the posture for performing the working action, and the terminal actuator completes the preparatory action for the operation. In a sense, the mobile working robot of the present invention has the characteristics of "human-like" operation. The movement of the mobile body, the adjustment of the mechanical arm posture, and the action of the terminal actuator of the mechanical arm are carried out synchronously. The working action is more coherent and coordinated, and the working efficiency is higher. The whole working process is more "human-like" and the intelligence is more fully reflected.
[0005] In order to achieve the above technical objectives, the specific technical solutions adopted by the present invention are:
[0006] A mobile working robot with hand-eye-foot coordinated control, comprising:
[0007] A mobile body, used to generate movement to a working posture;
[0008] The end effector is used to perform the operation on the operation object;
[0009] A mechanical arm, arranged on the mobile body and moving with the mobile body, for driving the end actuator to move to a position for performing the working action based on a stretching action;
[0010] Wherein: when the mobile body is in a moving state, the robot arm performs a posture adjustment action; when the mobile body is in a working posture, the end effector completes a work preparation action on the work object;
[0011] The motion control of the mobile body, the end-effector and the mechanical arm is completed in the same three-dimensional coordinate system; the mobile working robot determines the motion control amount of the mobile body, the mechanical arm and the end-effector according to the weight coefficient.
[0012] Furthermore, in the three-dimensional coordinate system, the weight coefficients include: α 1 , α 2 and α 3 ;
[0013] set up:
[0014] Ob is the operation object;
[0015] Lo(t) is the distance from the current robot position to the work object;
[0016] R bot is the maximum arm span radius of the robot;
[0017] Larm(t) is the arm span length of the robot when it moves toward the work object;
[0018] δ_move(t, Lo(t), Larm(t)) is the robot movement control quantity, which is a function of time t, Lo(t) and Larm(t);
[0019] δ_arm(t,Lo(t),Larm(t)) is the control quantity of the end motion of the robot arm, which is a function of time t, Lo(t) and Larm(t);
[0020] δ_terminal(t,Lo(t),Larm(t)): is the control quantity of the terminal actuator, which is a function of time t, Lo(t) and Larm(t);
[0021] δ_robot(t,Lo(t),Larm(t)) is the robot operation control quantity, which is a function of time t, Lo(t) and Larm(t);
[0022] but:
[0023] δ_robot(t, Lo(t), Larm(t))=α1 *δ_move(t)+α 2 *δ_arm(t)+α 3 *δ_terminal(t),α 1 +α 2 +α 3 =1.
[0024] Furthermore, when Lo(t)≥2*R bot Time α 1 =1, α 2 = 0 and α 3 =0; when Lo(t)<2*R bot When α 1 ≠0, α 2 ≠0 and α 3 ≠0.
[0025] Furthermore, the action time of the mobile body, the robot arm and the end actuator is determined based on the distance thresholds r1, r2 and r3 between the mobile body and the work object.
[0026] Furthermore, when r2≤Lo(t)≤r3, α 1 =0.5; α 2 =0.3; α 3 =0.2;
[0027] When r1≤Lo(t)≤r2, α 1 =0.3; α 2 =0.4; α 3 =0.3;
[0028] When Lo(t)≤r1, α 1 =0.1; α 2 =0.7; α 3 =0.2.
[0029] Furthermore, the reference of the three-dimensional coordinate system is established based on the coordinate identification sensed by the mobile working robot.
[0030] Furthermore, the robot obtains the absolute position reference of the robot after sensing the coordinate identifier, establishes the three-dimensional coordinate system based on the absolute position reference, introduces the mobile body into the three-dimensional coordinate system, introduces the robotic arm into the three-dimensional coordinate system based on the positional relationship between the robotic arm and the mobile body, and introduces the end effector into the three-dimensional coordinate system based on the positional relationship between the end effector and the robotic arm.
[0031] Furthermore, the coordinate identifier is a QR code identifier, which is set on the workbench where the work object is located.
[0032] Furthermore, the mobile working robot also includes a visual sensor; the visual sensor is arranged on the mechanical arm, and the two-dimensional code identification is based on scanning by the visual sensor.
[0033] Furthermore, the mobile working robot also includes a laser radar sensor and / or an ultrasonic sensor; the laser radar sensor and / or the ultrasonic sensor are used to measure the distance between the mobile working robot and external objects and perceive obstacles around the mobile working robot; the mobile working robot completes obstacle avoidance during movement based on the data from the laser radar and / or ultrasonic sensor. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0035] Figure 1 It is a schematic diagram of a setting method of a two-dimensional code mark in a specific implementation mode of the present invention;
[0036] Figure 2 It is a schematic diagram of the state of the mobile working robot in a three-dimensional coordinate system in a specific embodiment of the present invention;
[0037] Figure 3 It is a schematic diagram of the state of the mobile working robot in the XY plane coordinate system in a specific embodiment of the present invention;
[0038] Figure 4 This is a basic control flow chart of the mobile working robot in a specific embodiment of the present invention;
[0039] Figure 5 The distance relationship between the robot and the work object in the XY plane coordinate system in the specific implementation mode of the present invention;
[0040] Figure 6 A weight value selection diagram according to a curve change in a specific implementation manner of the present invention;
[0041] Figure 7 The running speed curve of the mobile body, the robot arm and the end effector during hand-eye-foot coordinated control;
[0042] Among them: 1. Workbench; 2. Work object; 3. Moving speed curve of mobile body; 4. Moving speed curve of end of robot arm; 5. Moving speed curve of end actuator. DETAILED DESCRIPTION
[0043] The embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
[0044] The following describes the embodiments of the present disclosure through specific examples, and those skilled in the art can easily understand other advantages and effects of the present disclosure from the contents disclosed in this specification. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all of the embodiments. The present disclosure can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present disclosure.
[0045] It should be noted that various aspects of the embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein may be embodied in a wide variety of forms, and any specific structures and / or functions described herein are merely illustrative. Based on this disclosure, it should be understood by those skilled in the art that an aspect described herein may be implemented independently of any other aspect, and two or more of these aspects may be combined in various ways. For example, any number of aspects described herein may be used to implement an apparatus and / or practice a method.
[0046] Additionally, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects described may be practiced without these specific details.
[0047] In one embodiment of the present invention, a mobile working robot with hand-eye-foot coordinated control is provided, comprising:
[0048] A mobile body, used to generate movement to a working posture;
[0049] The end effector is used to perform an operation on the operation object 2;
[0050] A mechanical arm, which is arranged on the mobile body and moves with the mobile body, and is used to drive the end actuator to move to a position for performing a working action based on an extension or retraction action;
[0051] Wherein: during the process of the mobile body moving to the working posture, the robot arm adjusts its posture, and the end actuator also moves. When the mobile body reaches the working posture, the end actuator completes the working preparatory action for the working object 2. The working preparatory action of this embodiment can be a process preparation action that can be performed by the end actuator, such as clamping, welding point contact, knife edge alignment, grinding operation, etc.;
[0052] The motion control of the mobile body, the end effector and the robotic arm is completed in the same three-dimensional coordinate system; the mobile working robot determines the control amount of the mobile body, the robotic arm and the end effector according to the weight coefficient.
[0053] The mobile body of this embodiment has its own integrated control system; the robot arm is installed on the mobile body through a rotating shaft or fixed installation based on the work requirements, and its rotation, extension, retraction and other movements are controlled by the above-mentioned control system; the end actuator is installed at the end of the robot arm.
[0054] The three-dimensional coordinate system of this embodiment is an absolute coordinate system established under the world coordinate system. Since the dimensions and operating dimensions of the various components of the robot itself are known, this embodiment converts the posture changes of the robot arm and the end effector during movement from traditional split-coordinate control to unified coordinate control.
[0055] Since various mobile working robots have different component sizes and movement modes, this embodiment uses a weight coefficient to determine that the mobile body stops at the working position - the robotic arm completes extension and posture adjustment - the end actuator completes the work preparatory action of performing the corresponding process on the work object 2 at the same time node as an example.
[0056] The reference of the three-dimensional coordinate system of this embodiment is established based on the coordinate identification perceived by the mobile working robot.
[0057] After the robot perceives the coordinate identification, it obtains the absolute position reference of the robot, establishes a three-dimensional coordinate system based on the absolute position reference, introduces the mobile body into the three-dimensional coordinate system, introduces the robotic arm into the three-dimensional coordinate system based on the positional relationship between the robotic arm and the mobile body, and introduces the end effector into the three-dimensional coordinate system based on the positional relationship between the end effector and the robotic arm.
[0058] In this embodiment, if Figure 1 As shown, the coordinate mark is a two-dimensional code mark, which is set on the workbench 1 where the work object 2 is located.
[0059] In this embodiment, the mobile working robot also includes a visual sensor; the visual sensor is arranged on the mechanical arm, and the QR code identification is based on the scanning of the visual sensor.
[0060] In this embodiment, the distance measurement function between the mobile working robot and external objects is completed by a laser radar sensor.
[0061] The coordinate identification is a two-dimensional code identification, which is set on the workbench 1 where the work object 2 is located.
[0062] The mobile working robot also includes a visual sensor; the visual sensor is arranged on the mechanical arm, and the QR code identification is based on the scanning of the visual sensor.
[0063] The laser radar sensor is used to measure the distance between the mobile body and the workbench 1 .
[0064] The working object 2 of this embodiment is the origin reference point of the world coordinate system established by the mobile working robot.
[0065] In this embodiment, the two-dimensional code identification includes coordinate direction information. The 3D vision sensor installed at the end of the robot arm is used to scan the two-dimensional code to obtain angle and position information, and establish the world coordinate system at the location of the two-dimensional code, such as Figure 1 shown.
[0066] like Figure 1 In the figure, Ob (operation object 2) is the operation target of the mobile operation robot located on the operation table.
[0067] The plane of the operating table is the XY axis, and the direction perpendicular to the operating table is the Z axis. This coordinate system serves as the base coordinate system for the mobile operation control system of the mobile working robot.
[0068] The 3D vision sensor at the end of the robot's mechanical arm performs 3D recognition and positioning of target objects within the visual range. This positioning is first based on the positioning in the coordinate system of the 3D vision sensor itself, and then the position coordinates of the located target object are converted to the base coordinate system based on the coordinate conversion relationship.
[0069] The robot arm body also has a coordinate system based on its first axis, that is, the installation base point. The motion control of each joint of the robot arm and the motion trajectory of the end effector of the robot arm are initially based on this coordinate system; similarly, they also need to be converted to the base coordinate system.
[0070] like Figure 2 shown.
[0071] The coordinate system transformation relationship is as follows:
[0072] The expression for converting from the 3D visual coordinate system to the base coordinate system is as follows:
[0073] C 3d_base =C 3d *T 1 ;
[0074] The expression for converting from the robot base point coordinate system to the base coordinate system is as follows:
[0075] C arm_base =C arm *T 2 ;
[0076] In the above conversion expression,
[0077] T1 ,T 2 , is the coordinate system transformation matrix;
[0078] T 1 The torque matrix for converting 3D visual coordinates to the base coordinate system;
[0079] T 2 The transformation matrix from the robot base point coordinate system to the base coordinate system;
[0080] C 3d is the position matrix of the target in the 3D visual coordinate system;
[0081] C arm is the position matrix of the end actuator of the robot arm in the robot arm base point coordinate system;
[0082] C 3d_base The position matrix after the target position in the 3D visual coordinate system is converted to the base coordinate system;
[0083] C arm_base The position matrix of the end effector of the robot arm converted to the base coordinate system;
[0084] like Figure 2 The figure shows a schematic diagram of the mobile body and the robotic arm in a unified coordinate system.
[0085] The physical meanings of the symbols in the figure are as follows:
[0086] θ is the posture angle of the mobile body;
[0087] P 0 is the center point of the two driving wheel axes; its coordinates are (x0, y0);
[0088] P bot It is the fixed point for the robot base and the mobile body; its coordinates are (xbot, ybot);
[0089] P L It is a laser sensor;
[0090] A, B, C, and D represent the joints of the robot arm respectively; at the same time, D is the end actuator of the robot arm, and its coordinates are (xd, yd, zd);
[0091] D L ,D R Represents two driving wheels of the mobile body, namely the left driving wheel and the right driving wheel;
[0092] L a is the distance from the drive wheel axis to the laser sensor;
[0093] Lb The distance between the robot arm installation fixing point and the drive wheel axis;
[0094] L 0 It is half of the distance between the two driving wheel axles;
[0095] R is the distance between the left driving wheel and the virtual rotation center O at a certain moment;
[0096] In addition, assume that the lengths of the arm segments starting from the zero joint are L1, L2, L3, and L4; and the radius of the driving hub is r0;
[0097] The position coordinates of the robot's end actuator point D are (xd, yd, zd). The derivative of the position is the velocity, and the velocity expression is as follows:
[0098]
[0099] In the above formula,
[0100] δ(θ): parameter value related to the robot posture angle;
[0101] J: Matrix constants related to the physical parameters of the robot arm (such as arm length);
[0102] θ 1 ,θ 2 ,θ 3 ,θ 4 and θ 5 They are the posture angles of each joint of the robotic arm in the base coordinate system;
[0103] It can be seen from the above formula that the speed of the end effector is not only related to the speeds of the five joint variables, but also to the posture angle of the mobile body and the speed of the mobile body (angular velocity of the two driving wheels).
[0104] Further, P 0 The speed and P bot The speeds are consistent. After unified processing, the above formula can be unified into the following expression:
[0105]
[0106] In the formula,
[0107] J L is a parameter value matrix, which is related to the physical size parameters of the mobile body and the robotic arm;
[0108] θx: represents the mobile body, the angle value matrix of each joint of the robot arm; its derivative represents the velocity value of each joint;
[0109] X: represents the position matrix of the end effector of the robot; its derivative represents the velocity matrix of the end effector;
[0110] It can be seen that the end velocity of the robot arm can be normalized as a function of the velocity of the mobile body and the velocity of each joint of the robot arm, so that the velocity of the end actuator can be decomposed into the moving velocity of the mobile body and the motion velocity of the robot arm joints, which serves as the basis for unified and coordinated control.
[0111] In one embodiment, in a three-dimensional coordinate system, the weight coefficients include: α 1 , α 2 and α 3 ; Coordinated control of mobile working robots based on fixed weights;
[0112] In a unified coordinate system, starting from the action of the end actuator, the motion is gradually decomposed into the motion of each motion joint and the robot driving wheel, thus completing the coordinated action. Figure 3 The figure shows the distance relationship between the robot and the work object 2 in the XY coordinate plane.
[0113] Figure 3 middle:
[0114] Ob is the job object 2;
[0115] Lo(t) is the value from the current robot position (laser sensor P L ) to the distance between the work object 2;
[0116] R bot is the maximum arm span range (radius) of the robot;
[0117] Assume that when the robot moves toward the work object 2, the arm span length of the robot is Larm(t);
[0118] δ_move(t, Lo(t), Larm(t)) is the robot movement control quantity, which is a function of time t, Lo(t) and Larm(t);
[0119] δ_arm(t,Lo(t),Larm(t)) is the control quantity of the end motion of the robot arm, which is a function of time t, Lo(t) and Larm(t);
[0120] δ_terminal(t,Lo(t),Larm(t)): is the control quantity of the terminal actuator, which is a function of time t, Lo(t) and Larm(t);
[0121] δ_robot(t,Lo(t),Larm(t)) is the robot operation control quantity, which is a function of time t, Lo(t) and Larm(t);
[0122] In one embodiment, δ_robot(t, Lo(t), Larm(t))=α 1 *δ_move(t)+α 2 *δ_arm(t)+α 3 *δ_terminal(t),α 1 +α 2 +α 3 =1.
[0123] When Lo(t)≥2*R bot Time α 1 =1, α 2 = 0 and α 3 =0; when Lo(t)<2*R bot Time α 3 ≠0, α 2 ≠0 and α 3 ≠0.
[0124] That is, the robot operation control quantity can be decomposed into the weighted sum of the mobile body movement control quantity, the robot end motion control quantity and the end actuator control quantity.
[0125] Specifically, the conditions are set as follows:
[0126] When the robot moves toward the work object 2, different weight coefficient values are taken when the following conditions are met respectively.
[0127] Lo(t)≥2*R bot When α 1 =1;α 2 =0; α 3 =0;
[0128] Lo(t)<2*R bot When α 1 ≠0; α 2 ≠0; α 3 ≠0;
[0129] In the formula,
[0130] α 1 +α 2 +α 3 =1
[0131] That is, the maximum arm span radius is set to 2 times as the setting value. When the robot is beyond this distance from the work object 2 (Ob), the robot arm joint will not perform the action (at this time, the control amount weight coefficient α 2 and α 3are all 0), only the movement control of the mobile body is executed; when the robot enters this range, the coordinated control takes effect, specifically the movement of the mobile body, and the joints of the robotic arm also perform corresponding actions under the control of a unified control strategy.
[0132] In this case, α 1 ,α 2 ,α 3 ,The specific value of the weight can be set appropriately according to the ,type of robot operation.
[0133] like Figure 4 The figure shows a basic control flow chart. During the robot's walking, the distance between the robot and the work object 2 is measured by the front laser radar. The control system decides whether to activate the coordination control algorithm based on this distance until the end actuator action is completed.
[0134] In one embodiment, Figure 5 The figure shows the distance between the robot and the object being operated. Three distance thresholds are set, namely r1, r2, and r3; when the distance Lo(t) between the robot and the object being operated is different, different weight coefficients are used for control.
[0135] When r2≤Lo(t)≤r3, α 1 =0.5; α 2 =0.3; α 3 =0.2;
[0136] When r1≤Lo(t)≤r2, α 1 =0.3; α 2 =0.4; α 3 =0.3;
[0137] When Lo(t)≤r1, α 1 =0.1; α 2 =0.7; α 3 =0.2.
[0138] When the robot is in the interval [r2, r3], the weights of the mobile body and the robotic arm control amount are larger, and the weights of the end effector joints are smaller. The purpose is to allow the robot to approach the operation target as quickly as possible during this period, and adjust the robotic arm posture as quickly as possible to adapt to the operation of the operation object.
[0139] When the robot is in the interval [r1, r2], the robot control amount is appropriately reduced and the terminal joint control amount is appropriately increased to further adjust the terminal joint posture.
[0140] When the robot enters the final r1 interval, the weight of the mobile body control amount is the smallest, the weight of the robotic arm control amount is the largest, and the weight of the end actuator control amount is reduced. This weight configuration reflects that in the final execution stage, the mobile body control amount is only to perform micro-movements to cooperate with the movements of the end joints, while the robotic arm focuses on further quickly adjusting the posture, and the end actuator slows down in order to perform precise operations.
[0141] In one embodiment, α 1 ,α 2 ,α 3 , the weight coefficient value can also be determined according to a certain curve. Figure 6 The weight coefficient change curve shown.
[0142] like Figure 6 As shown in the figure, the horizontal axis is Lo(t), which is the distance between the robot and the operation target, from far to near. The vertical axis is the weight value. At any Lo(t) value, the following relationship is satisfied:
[0143] α 1 +α 2 +α 3 =1
[0144] And the three weight values are all functions of Lo(t). Under this rule, only when Lo(t) is less than a certain value, the coordinated control strategy is activated, and the three-stage distance limit is no longer set.
[0145] The beneficial effect of choosing a weight control strategy that changes according to the curve is that the robot's movements can be smoother and more flexible, which is very suitable for refined and high-precision coordinated operations. However, this control strategy requires a higher computing speed of the control system and a higher servo response bandwidth of the robot's execution link.
[0146] According to the actual application scenario and requirements, the type and shape of the curve can be set, or a step-by-step weight change rule can be adopted according to the change of Lo(t), thereby reducing the requirements for the control system.
[0147] When the coordinated control algorithm is activated, the robot moves, the joints of the robotic arm and the end effector move simultaneously under the coordinated control, and finally the end effector reaches the target of the operation object and operates successfully, such as successful grasping.
[0148] like Figure 7 It is shown that under the coordinated control strategy, each action speed curve includes the following elements: a moving body moving speed curve 3, a robot end moving speed curve 4 and an end actuator moving speed curve 5.
[0149] Figure 7In the example, starting from time 0, the coordinated control strategy has been activated.
[0150] In the figure,
[0151] 0~t1: The mobile body moves toward the work object 2, and the robot arm moves at a low speed to adjust the posture; the end effector does not move.
[0152] t1~t2: The moving speed of the mobile body gradually decreases, the movement speed of the robot arm gradually decreases, and at the same time, the end effector starts to move. When it reaches time t3, the speeds of the three are simultaneously reduced to zero, indicating that the robot end effector has completed the first stage of the operation task, such as completing the grasping action.
[0153] In one embodiment of the present invention, an ultrasonic sensor is also provided on the mobile working machine; the mobile working robot completes obstacle avoidance during the movement of the mobile body based on data from the ultrasonic sensor and / or the laser radar sensor.
[0154] The above is only a specific implementation of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present disclosure should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.
Claims
1. A mobile working robot with coordinated control of hands, eyes and feet, characterized in that: include: A mobile body, used to generate movement to a working posture; The end effector is used to perform the operation on the operation object; A mechanical arm, arranged on the mobile body and moving with the mobile body, for driving the end actuator to move to a position for performing the working action based on a stretching action; Wherein: when the mobile body is in a moving state, the robot arm performs a posture adjustment action; when the mobile body is in a working posture, the end effector completes a work preparation action on the work object; The motion control of the mobile body, the end effector and the mechanical arm is completed in the same three-dimensional coordinate system; the mobile working robot determines the control amount of the mobile body, the mechanical arm and the end effector according to the weight coefficient, In the three-dimensional coordinate system, the weight coefficients include: α1, α2 and α3; set up: Ob is the operation object; Lo(t) is the distance from the current robot position to the work object; R bot is the maximum arm span radius of the robot; Larm(t) is the arm span length of the robot when it moves toward the work object; δ_move(t, Lo(t), Larm(t)) is the robot movement control quantity, which is a function of time t, Lo(t) and Larm(t); δ_arm(t, Lo(t), Larm(t)) is the control quantity of the end motion of the robot arm, which is a function of time t, Lo(t) and Larm(t); δ_terminal(t, Lo(t), Larm(t)): is the control quantity of the terminal actuator, which is a function of time t, Lo(t) and Larm(t); δ_robot(t, Lo(t), Larm(t)) is the robot operation control quantity, which is a function of time t, Lo(t) and Larm(t); but: δ_robot(t, Lo(t), Larm(t)) = α1*δ_move(t) +α2*δ_arm(t) +α3*δ_terminal(t), α1+α2+ α3=1; When Lo(t) ≥ 2*R bot When α1=1, α2=0 and α3=0; when Lo(t) < 2*R bot When α1≠0, α2≠0 and α3≠0, The specific values of α1, α2, α3, and weights are set according to the robot operation type.
2. The mobile working robot according to claim 1, characterized in that: The action time of the mobile body, the robot arm and the end effector is determined based on the distance thresholds r1, r2 and r3 between the mobile body and the work object.
3. The mobile working robot according to claim 1, characterized in that: When r2≤ Lo(t) ≤r3, α1=0.5; α2=0.3; α3=0.2; When r1≤ Lo(t) ≤r2, α1=0.3; α2=0.4; α3=0.3; When Lo(t) ≤r1, α1=0.1; α2=0.7; α3=0.
2.
4. The mobile working robot according to claim 1, characterized in that: The reference of the three-dimensional coordinate system is established based on the coordinate identification sensed by the mobile working robot.
5. The mobile working robot according to claim 4, characterized in that: After sensing the coordinate identifier, the robot obtains the absolute position reference of the robot, establishes the three-dimensional coordinate system based on the absolute position reference, introduces the mobile body into the three-dimensional coordinate system, introduces the robotic arm into the three-dimensional coordinate system based on the positional relationship between the robotic arm and the mobile body, and introduces the end effector into the three-dimensional coordinate system based on the positional relationship between the end effector and the robotic arm.
6. The mobile working robot according to claim 4, characterized in that: The coordinate mark is a two-dimensional code mark, which is set on the workbench where the work object is located.
7. The mobile working robot according to claim 6, characterized in that: The mobile working robot also includes a visual sensor; the visual sensor is arranged on the mechanical arm, and the two-dimensional code identification is based on scanning by the visual sensor.
8. The mobile working robot according to claim 1, characterized in that: The mobile working robot also includes a laser radar sensor and / or an ultrasonic sensor; the laser radar sensor and / or the ultrasonic sensor are used to measure the distance between the mobile working robot and external objects and perceive obstacles around the mobile working robot; the mobile working robot completes obstacle avoidance during movement based on the data from the laser radar and / or the ultrasonic sensor.
