Control device, special robot system and control method thereof

By using a multi-dimensional controller and display screen in a special robot control device to obtain environment and status information and send multi-dimensional posture control instructions, the problem of low safety of traditional control devices is solved, and safer and more reliable robot arm control is achieved.

CN114589680BActive Publication Date: 2024-11-26WANXUN TECH (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210232368.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-05-08
Filing Date
2022-03-09
Publication Date
2024-11-26
Estimated Expiration
2042-03-09

AI Technical Summary

Technical Problem

Traditional special robot control devices have problems with low operating safety, making it difficult for operators to effectively control the robotic arm and prone to operating errors.

Method used

Using a control device including a first display screen, a second display screen and a multi-dimensional operator, by obtaining the surrounding environment image information and working status of the special robot, the operator can input multi-dimensional data through the multi-dimensional operator, and the control system sends multi-dimensional posture control. Instructions, the controller calculates joint drive instructions to achieve safe and accurate robotic arm control.

Benefits of technology

By intuitively sensing the surrounding environment and working state, the operator can avoid the robotic arm hitting obstacles and avoid control errors caused by excessive joint load, improving handling safety and reliability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114589680B_ABST
    Figure CN114589680B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of robot control technology, and provides a control device, a special robot system and a control method thereof. The control device includes a first display screen, a second display screen, a multi-dimensional manipulator and a control system. The control system is communicatively connected to the special robot. The control system is used to obtain image information reflecting the surrounding environment of the special robot and the working status of the special robot from the special robot; the first display screen is used to display the image information, and the second display screen is used to display the working status of the special robot. The control device and the special robot system provided by the present invention can obtain the surrounding environment of the special robot through the first display screen, and the working status of the special robot through the second display screen, thereby solving the technical problem of low control safety existing in the existing control device, thereby improving the safety and reliability of the control method.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to two Chinese patents, application number 202110499300.9 (application name "Control device and special robot system") filed with the National Intellectual Property Office on May 8, 2021, and application number 202110499773.9 (application name "Special robot and its control method") filed with the National Intellectual Property Office on May 8, 2021, the entire contents of which are incorporated by reference in this application. Technical Field

[0002] The present invention relates to the field of robot control technology, and in particular to a control device, a special robot system and a control method thereof. Background Art

[0003] Special robots are a type of robot that has developed rapidly and been widely used in recent years. They are used in all industries of my country's national economy. Their application scope mainly includes: agriculture, electricity, construction, logistics, medical care, nursing, rehabilitation, security and rescue, military, nuclear industry, mining, petrochemical, municipal engineering, etc.

[0004] Traditional special robots are mainly used for inspection functions, such as power inspection, pipeline corridor inspection, park inspection and hazardous chemical plant inspection robots. Such robots do not have a mechanical arm or are only equipped with a single mechanical arm, and can perform a limited number of operations. When faced with maintenance or operation and maintenance needs in special environments, traditional inspection robots cannot effectively replace manual on-site physical operations. Such special robots are mainly used for "monitoring" functions, but cannot actually solve the problem.

[0005] Among the existing patents known to the inventor, please refer to Figure 1 , a Chinese invention patent with application number "201810739677.5", provides a technical solution for a high-degree-of-freedom bomb disposal robot and its control method. The high-degree-of-freedom bomb disposal robot includes a mobile chassis 1 and a mechanical arm 2. The mobile chassis 1 is provided with a driving wheel 10 and a longitudinal bracket 31. The global vision sensor 3 is connected to the longitudinal bracket 31. The front end of the multi-degree-of-freedom mechanical arm 2 is connected with an end effector 21 and an end vision sensor 22. The mechanical arm 2 has multiple joints. The high-degree-of-freedom bomb disposal robot requires the operator to first select the buttons of the corresponding joints of the mechanical arm 2, and control each joint separately to control the movement of the mechanical arm. However, the operator does not understand the working status of the robot during operation, which is prone to operating errors and low control safety. Therefore, the existing control device has the technical problem of low control safety. Summary of the invention

[0006] The purpose of the present application is to provide a control device, a special robot system and a control method thereof, aiming to solve the technical problem of low control safety existing in the existing control devices.

[0007] To achieve the above-mentioned purpose, the technical solution adopted in this application is: a control device, applied to a special robot, the control device includes a first display screen, a second display screen, a multi-dimensional manipulator and a control system, the control system is used to communicate with the special robot, the first display screen, the second display screen and the multi-dimensional manipulator are electrically connected to the control system respectively, the control system is used to obtain image information reflecting the surrounding environment of the special robot and the working status of the special robot from the special robot; the first display screen is used to display the image information, the second display screen is used to display the working status of the special robot, the multi-dimensional manipulator is used to send multi-dimensional data generated based on the input action of the operator to the control system, and the control system is used to send multi-dimensional posture control instructions to the special robot according to the multi-dimensional data.

[0008] In one embodiment, the multi-dimensional manipulator is a 3D mouse, and the 3D mouse generates the multi-dimensional data based on the operation actions of the operator.

[0009] In one embodiment, the control device further comprises a control panel, the second display screen is mounted on the control panel, the control panel has an arm control area, and the multi-dimensional manipulator is mounted on the arm control area;

[0010] In one embodiment, the special robot includes a controller, and the control system is specifically used to send multi-dimensional posture control instructions to the controller according to the multi-dimensional data.

[0011] In one of the embodiments, the control device also includes a motion speed adjustment switch installed in the arm control area, and the motion speed adjustment switch is used to adjust the gear of the motion speed of the mechanical arm of the special robot.

[0012] In one embodiment, the control device also includes a motion mode adjustment switch installed in the arm control area, and the motion mode adjustment switch is used to adjust the motion mode of the mechanical arm of the special robot, and the motion mode includes at least two of the global motion mode, the translational motion mode and the orbital motion mode.

[0013] In one of the embodiments, the control device also includes a reset button installed in the arm control area, and the reset button is used to control the mechanical arm of the special robot to reset to a preset working posture.

[0014] The present application also provides a special robot system, comprising a special robot and any one of the above-mentioned control devices, wherein the special robot is used to provide the control device with image information reflecting the surrounding environment of the special robot and the working status of the special robot.

[0015] The present application also provides a control method for a special robot system, which is applied to any of the special robot systems described above, comprising:

[0016] The multi-dimensional manipulator sends the multi-dimensional data generated based on the operator's input action to the control system;

[0017] The control system sends a multi-dimensional position control instruction to a controller of the special robot according to the multi-dimensional data;

[0018] The controller calculates the driving instructions of each joint driving component according to the multi-dimensional posture control instruction and the current posture of the robot arm;

[0019] The controller sends the driving instruction to the corresponding joint driving component.

[0020] In one embodiment, the multi-dimensional posture control instruction is periodically sent to the controller, and the controller completes the calculation and sending of the current drive instruction in a single cycle. After receiving the current drive instruction, the joint drive component immediately operates according to the current drive instruction.

[0021] The beneficial effects of the control device, special robot system and control method thereof provided in the present application are as follows: the operator can intuitively perceive the surrounding environment of the special robot through the first display screen, which can assist the operator in inputting some multidimensional data to avoid the robot arm from colliding with surrounding obstacles when operating the multidimensional manipulator, thereby achieving safe and accurate control of the robot arm; since the second display screen is used to display the working status of the special robot, the operator can promptly learn about the working status of the special robot, such as the load condition of the special robot, through the second display screen, so that the operator can use the multidimensional manipulator to avoid control errors caused by excessive load on the joint drive parts in advance, thereby solving the technical problem of low control safety in the existing control device, thereby improving the safety and reliability of the control method. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0023] Figure 1 It is a structural schematic diagram of an explosive disposal robot in the prior art;

[0024] Figure 2 A side view of a special robot provided in an embodiment of the present application;

[0025] Figure 3 for Figure 2 A three-dimensional image of a special robot in

[0026] Figure 4 for Figure 2 Another perspective of the special robot in the game;

[0027] Figure 5 for Figure 4 A schematic diagram of the structure of the mechanical arm of the special robot;

[0028] Figure 6 for Figure 5 A schematic structural diagram of the fourth rotation joint of the robotic arm;

[0029] Figure 7 for Figure 4 A schematic diagram of the structure of the end effector of the special robot;

[0030] Figure 8 for Figure 4 A connection diagram of the execution mounting portion of the end effector and the wrist of the robot arm;

[0031] Fig. 9 for Figure 8 Exploded view in;

[0032] Fig.10 for Figure 8 An exploded view from another perspective;

[0033] Fig.11 is a schematic diagram of the structure of the control device in the embodiment of the present application;

[0034] Fig.12 for Fig.11 A schematic diagram of a control panel of a control device in FIG.

[0035] Fig.13 for Fig.11 A schematic diagram of the robotic arm control area of ​​the control panel in FIG.

[0036] Fig.14 It is a flowchart of the control method of the special robot system in the implementation method.

[0037] Among them, the reference numerals in the figure are:

[0038] 1. Mobile chassis; 10. Driving wheels; 2. Multi-degree-of-freedom robotic arm; 21. End effector; 22. End vision sensor; 3. Global vision sensor; 31. Longitudinal bracket;

[0039] X1, first vertical axis; X2, second vertical axis; Y1, first horizontal axis; Y2, second horizontal axis;

[0040] 100, chassis; 110, cabin; 120, walking mechanism;

[0041] 200, body body; 201, support;

[0042] 300, robotic arm; 301, first rotating joint; 302, first swinging joint; 303, second rotating joint; 304, second swinging joint; 305, third rotating joint; 306, third swinging joint; 307, fourth rotating joint; 308, movable joint; 310, shoulder; 320, upper arm; 330, elbow; 340, forearm; 350, wrist; 351, wrist housing; 3511, first reset line; 352, rotating adapter; 3521, second reset line; 353, rotating mounting part; 3531, first mounting groove; 3532, second mounting hole; 354, rubber sleeve; 361, force sensor; 362, joint driving part; 363, reducer; 364, encoder; 365, brake;

[0043] 410, first camera; 411, first electric pan-tilt head; 420, second camera; 421, second electric pan-tilt head; 430, column; 440, third camera; 450, fourth camera; 460, fifth camera;

[0044] 500, end effector; 510, actuator mounting portion; 511, mounting plate; 512, first mounting hole; 513, limit plate; 520, actuator working portion; 521, first clamping finger; 522, second clamping finger;

[0045] 600, control device; 601, first display screen; 602, control panel; 610, second display screen; 620, arm control area; 621, multi-dimensional manipulator; 622, motion speed adjustment switch; 623, motion mode adjustment switch; 624, reset button; 625, actuator working button; 626, actuator rotation button; 630, visual device control area; 631, first joystick; 632, second joystick; 633, switch button; 640, switch wiring area; 650, chassis control area. DETAILED DESCRIPTION

[0046] Embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0047] In the description of the present application, it should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship, are based on the orientation or position relationship shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0048] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0049] In this application, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0050] Embodiment 1

[0051] Please refer to Figures 2 to 4 The special robot provided in this embodiment includes a chassis 100, a body 200, a mechanical arm 300, a visual device and a controller. The body 200 is installed on the chassis 100. One end of the mechanical arm 300 is installed on the body 200, and the other end of the mechanical arm 300 is installed with an end effector 500. The mechanical arm 300 has a plurality of movable joints 308, and the movable joints 308 include joint driving parts 362 (see Figure 6 ).

[0052] The visual device is used to perceive the posture and surrounding environment of the special robot. The controller is electrically connected to the visual device and multiple joint driving components 362. The visual device can be installed separately or can be installed on the chassis 100, the body 200 or the robot arm 300.

[0053] In a specific embodiment, please refer to Figure 3 , the number of the mechanical arms 300 is two. The two mechanical arms 300 are respectively installed on both sides of the body body 200.

[0054] In another specific embodiment, please refer to Figure 5 The robot arm 300 includes a shoulder 310, an upper arm 320, an elbow 330, a forearm 340 and a wrist 350 connected in sequence. There are seven active joints 308, which are respectively a first rotation joint 301 connecting the body 200 and the shoulder 310, a first swing joint 302 of the shoulder 310, a second rotation joint 303 connecting the upper arm 320 and the elbow 330, a second swing joint 304 of the elbow 330, a third rotation joint 305 connecting the forearm 340 and the wrist 350, a third swing joint 306 of the wrist 350, and a fourth rotation joint 307 at the end of the wrist 350.

[0055] The movable joint 308 includes a first rotating joint 301, a first swinging joint 302, a second rotating joint 303, a second swinging joint 304, a third rotating joint 305, a third swinging joint 306, and a fourth rotating joint 307. The upper arm 320 is fixedly mounted on the shoulder 310. The lower arm 340 is fixedly mounted on the elbow 330.

[0056] In this way, the robot arm 300 has both swing joints and rotation joints, and has greater freedom of movement, which can meet various operational needs. It can flexibly drive the end effector 500 to operate, realize complex single-arm or double-arm collaborative operations, and perform a variety of on-site operation tasks.

[0057] Optionally, the rotation axes of two adjacent movable joints 308 are perpendicular to each other.

[0058] In another specific embodiment, please refer to Figures 7 to 9 The end effector 500 is detachably mounted on the wrist 350 , so that the operator can quickly replace the end effector 500 , such as a clamp, a shear, a demolition tool, and a laser head, according to the on-site working conditions.

[0059] Specifically, please refer to Figures 7 to 10The end actuator 500 includes an actuator mounting portion 510 and an actuator working portion 520 mounted on the actuator mounting portion 510. The actuator mounting portion 510 has a mounting plate 511 extending toward the fourth rotation joint 307. The mounting plate 511 has a first mounting hole 512 passing through the mounting plate 511. The actuator mounting portion 510 also has a limiting plate 513 extending toward the fourth rotation joint 307.

[0060] The fourth rotary joint 307 includes a wrist housing 351 and a rotary mounting portion 353. The rotary mounting portion 353 is rotatably mounted on the wrist housing 351. The rotary mounting portion 353 has a first mounting groove 3531 for inserting the mounting piece 511, and a side wall of the rotary mounting portion 353 has a second mounting hole 3532 corresponding to the position of the first mounting hole 512. The rotary mounting portion 353 also has a limiting groove (not shown) for inserting the limiting piece 513.

[0061] When the end effector 500 needs to be installed on the robot arm 300, the operator inserts the mounting plate 511 of the end effector 500 into the first mounting groove 3531 of the rotating mounting portion 353, and the limiting plate 513 is inserted into the limiting groove, and then inserts the fastener from the circumferential outer side of the robot arm 300 into the first mounting hole 512 and the second mounting hole 3532.

[0062] Specifically, the wrist housing 351 is connected to the rotating mounting portion 353 via a rotating adapter 352 .

[0063] In this way, the mounting plate 511 is inserted into the first mounting groove 3531, so that the end effector 500 is limited in the circumferential direction of the rotating mounting part 353, and the limiting plate 513 limits the end effector 500 in the radial direction of the rotating mounting part 353, and the fastener is inserted into the first mounting hole 512 and the second mounting hole 3532, so that the end effector 500 is limited in the axial direction of the rotating mounting part 353, so that the end effector 500 is fastened to the rotating mounting part 353, and the end effector 500 can rotate with the rotating mounting part 353 and the rotating adapter 352 relative to the axis of the wrist shell 351.

[0064] Specifically, please refer to Fig. 9 and Fig.10 The outer surface of the wrist housing 351 has a first reset line 3511, and the outer surface of the rotation adapter 352 has a second reset line 3521, so that when the first reset line 3511 is aligned with the second reset line 3521, the rotation adapter 352 is in an initial state. The provision of the first reset line 3511 and the second reset line 3521 facilitates accurate reset of the rotation adapter 352 and the end effector 500 connected thereto.

[0065] For special robots, when the operation is completed or a certain stage of the operation is completed, the end effector 500 needs to be reset for subsequent operations. The control device 600 gives a multi-dimensional displacement control instruction to the end effector 500 based on the reset state.

[0066] In a specific embodiment of the present application, please refer to Figure 6 The fourth rotary joint 307 further includes a force sensor 361, which is connected to the output shaft of the joint driver 362 and the end effector 500 respectively. The force sensor 361 is used to detect the connection stress information between the joint driver 362 and the end effector 500. The force sensor 361 is electrically connected to the controller to send the connection stress information to the controller. The controller can adjust the posture of the robot arm 300 or replace a suitable end effector 500 in advance before the connection stress exceeds the warning stress value, so as to avoid the end effector 500 from breaking due to excessive stress during operation.

[0067] In particular, the joint driving member 362 is connected to the force sensor 361 via the reducer 363. The joint driving member 362 is electrically connected to the controller via the encoder 364.

[0068] Specifically, please combine Figure 6 The movable joint 308 further includes a brake 365 electrically connected to a driver of the joint driver 362. The driver of the joint driver 362 is connected to a controller. The controller is used to send a braking command to the driver of the joint driver 362. The braking command is used to make the brake 365 mechanically lock the joint driver 362. When the special robot is powered off or an accidental alarm occurs, the brake 365 mechanically forces the joint driver 362 to be locked.

[0069] The brake 365 may be an electromagnetic brake. In the fourth rotary joint 307 , the joint driving member 362 is installed inside the wrist housing 351 .

[0070] Optionally, the joint driving member 362 is a servo motor.

[0071] In another specific embodiment, please refer to Figures 2 to 4 The visual device includes a first camera 410, a second camera 420 and a column 430. The first camera 410 is rotatably mounted on the top of the body body 200 around a first vertical axis X1 through a first electric pan-tilt head 411. The column 430 is mounted on the chassis 100. The second camera 420 is rotatably mounted on the top of the column 430 around a second vertical axis X2 through a second electric pan-tilt head 421. The controller is electrically connected to the first camera 410, the second camera 420, the first electric pan-tilt head 411 and the second electric pan-tilt head 421, respectively.

[0072] The first camera 410 is in accordance with the human eye perspective of the operator during operation, and is used to intuitively perceive the working space in front of the special robot, and the second camera 420 is used to perceive the surrounding environment on both sides or the rear of the special robot to improve the safety of operation. The controller obtains the image information captured by the first camera 410 and the second camera 420, and can control the rotation of the first camera 410 and the second camera 420 by controlling the first electric pan-tilt head 411 and the second electric pan-tilt head 421, so as to obtain image information with a wider perspective and construct an effective working space for the special robot.

[0073] Among them, the working space refers to the set of target points that the manipulator 300 and the end effector 500 of the special robot can reach, including the working space in front of the special robot, and the working space on the side and behind the special robot. The constrained space refers to the working space of the special robot itself that is reduced due to environmental constraints (such as walls and other obstacles in the surrounding environment). The effective working space refers to the working space remaining after subtracting the constrained space from the working space. The manipulator 300 can ensure safety by moving in the effective working space.

[0074] Optionally, refer to Figure 3 The first electric pan-tilt platform 411 can also drive the first camera 410 to perform a pitch motion around the first horizontal axis Y1. The second electric pan-tilt platform 421 can also drive the second camera 420 to perform a pitch motion around the second horizontal axis Y2.

[0075] Optionally, the first camera 410 and the second camera 420 are both high-definition infrared cameras.

[0076] In another specific embodiment, please refer to Figure 7 The actuator working part 520 includes a first clamping finger 521 and a second clamping finger 522 both of which are rotatably arranged.

[0077] Optionally, the visual device further includes a third camera 440 installed on the actuator working part 520 .

[0078] Furthermore, the third camera 440 is installed obliquely on the end effector 500 so as to face the front of the end effector 500, that is, towards the motion execution part of the end effector 500, so that the working position of the end effector 500 is located at the center of the image taken by the third camera 440, which is convenient for the operator to observe closely.

[0079] In another specific embodiment, the chassis 100 includes a cabin 110 and a walking mechanism 120 for driving the cabin 110 to move, a controller is installed in the cabin 110, and the controller is electrically connected to the walking mechanism 120. The special robot also includes a fourth camera 450 and a fifth camera 460 respectively electrically connected to the controller, the fourth camera 450 is installed on the front side of the cabin 110, and the fifth camera 460 is installed on the rear side of the cabin 110.

[0080] The fourth camera 450 is used to observe the progress of the special robot and to assist in guiding near-ground operation tasks.

[0081] The fifth camera 460 is used to observe the retreat of the special robot and to assist in guiding near-ground operation tasks.

[0082] Optionally, the fourth camera 450 is an infrared night vision camera.

[0083] Optionally, the fifth camera 460 is an infrared night vision camera.

[0084] Optionally, the walking mechanism 120 is a track mechanism, a roller mechanism or a foot-leg mechanism.

[0085] In another specific embodiment, please refer to Figure 3 The body 200 is swingably mounted on the chassis 100 through the support 201. In this way, the body 200 can drive the robot arm 300 to pitch as a whole, so as to facilitate pitching operations. At the same time, when operating in a pitching scene, the first camera 410 keeps a level view, which is conducive to the operator to clearly observe the working space and guide the robot arm 300 to perform fine operations.

[0086] In another specific embodiment, reference may be made to Figure 3 The body 200 is rotatably mounted on the chassis 100 through a heading joint. In this way, the body 200 can rotate around an axis perpendicular to the chassis 100.

[0087] Specifically, the heading joint is located between the support 201 and the body 200 .

[0088] Embodiment 2

[0089] Please refer to Figures 11 to 13 This embodiment provides a control device 600, which is applied to any special robot in the first embodiment. Figures 4 to 6The special robot includes a chassis 100, a body 200, a mechanical arm 300, a visual device and a controller, wherein the body 200 is mounted on the chassis 100. One end of the mechanical arm 300 is mounted on the body 200, and the other end of the mechanical arm 300 is mounted with an end effector 500. The mechanical arm 300 has a plurality of movable joints 308, and the movable joints 308 include joint drivers 362. The controller is electrically connected to the plurality of joint drivers 362, and the controller can be used to obtain the current state of each joint driver 362, including the load condition, current position and current rotation angle of each joint driver 362, so as to obtain the working state of the special robot. The visual device is used to perceive the surrounding environment of the special robot. The controller is electrically connected to the visual device, and the controller obtains image information of the surrounding environment of the special robot through the visual device.

[0090] Specifically, the control device 600 includes a first display screen 601, a second display screen 610, a multidimensional manipulator and a control system. The control system is communicatively connected to the special robot, specifically, the control system is communicatively connected to the controller of the special robot. The first display screen 601, the second display screen 610 and the multidimensional manipulator 621 are electrically connected to the control system respectively. The control system is used to obtain image information reflecting the surrounding environment of the special robot and the working state of the special robot from the special robot. The first display screen 601 is used for image information, and the second display screen 610 is used to display the working state of the special robot. The working state of the special robot includes the current state of the joint drive 362 of the movable joint 308, such as the load condition, current position and current rotation angle of the joint drive 362, and at least one of the battery state of the special robot. When the special robot also includes a brake 365, a force sensor 361 and an electric pan-tilt platform, the working state of the special robot also includes the working state of the brake 365, the connection stress information detected by the force sensor 361, the rotation angle of the electric pan-tilt platform, etc. When the special robot also includes other joints, the working status of the special robot may also include the current status of the other joints.

[0091] The multi-dimensional manipulator 621 is used to send the multi-dimensional data generated based on the input action of the operator to the control system. The control system is used to send a multi-dimensional posture control instruction to the special robot according to the multi-dimensional data. The multi-dimensional posture control instruction includes the movement end position information of the end of the special robot. The multi-dimensional posture control instruction is used to control the end position of the movement of the end of the mechanical arm of the special robot.

[0092] The beneficial effect of the control device 600 provided in this embodiment is that the operator can intuitively perceive the posture and surrounding environment of the special robot through the first display screen 601, so that the operator can input some multi-dimensional data to prevent the robot arm 300 from colliding with surrounding obstacles when operating the multi-dimensional manipulator 621. Since the second display screen 610 is used to display the working status of the special robot, the operator can timely learn the working status of the special robot through the second display screen 610, including the load condition, alarm condition or power supply condition, and understand the working status of each active joint 308. In this way, the operator can use the multi-dimensional manipulator 621 to avoid control errors caused by excessive load, power failure or other abnormal alarms of the joint drive 362 in advance, solve the technical problem of low control safety existing in the existing control device 600, and thus improve the safety and reliability of the control method.

[0093] Among them, the multi-dimensional posture control instruction includes the movement end position information of the end of the special robot, and the controller calculates the specific movement path according to the movement end position information of the end. Specifically, the controller of the special robot can calculate the drive instructions of each joint driver 362 according to the multi-dimensional posture control instruction, and send the drive instructions to the corresponding joint driver 362. The operator does not need to send specific drive instructions corresponding to each active joint 308, and does not need to tediously control each active joint 308 separately, so the control efficiency is high and the control difficulty is small.

[0094] The multi-dimensional manipulator 621 refers to a device that can independently output spatial three-dimensional translation variables and three-dimensional rotation variables. The multi-dimensional manipulator 621 can be a 3D mouse or a three-dimensional coordinate input controller.

[0095] In a specific embodiment, please refer to Fig.11 and Fig.12 The multi-dimensional manipulator 621 is a 3D mouse, which generates multi-dimensional data based on the operator's operation actions.

[0096] Among them, the multidimensional data includes incremental multidimensional data and absolute multidimensional data. Incremental multidimensional data refers to the newly added displacement distance based on the current position of the end effector 500 according to the operation action of the operator. For example, if the operator moves the 3D mouse to the lower left by a distance S, the incremental multidimensional data indicates that the end effector 500 needs to move a distance M to the lower left based on the current position. There is a linear proportional relationship between the moving distance S and the moving distance M. In particular, the moving distance S is equal to the moving distance M.

[0097] In this way, the operator inputs multi-dimensional data through a 3D mouse, and the control system generates multi-dimensional posture control instructions based on the multi-dimensional data and sends them to the controller of the special robot. The controller automatically calculates the required rotation angle of each active joint 308, and sends corresponding rotation instructions to each joint drive 362, so that the end effector 500 reaches the position specified by the operator, greatly reducing the difficulty of using the control device 600.

[0098] In a specific embodiment, please refer to Fig.12 The control device 600 further includes a control panel 602, a second display screen 610 is installed on the control panel 602, the control panel 602 has an arm control area 620, and a multi-dimensional manipulator 621 is installed in the arm control area 620. The operator can complete the control of the robot arm 300 in the arm control area 620.

[0099] Optionally, the number of arm control areas 620 corresponds one-to-one to the number of robotic arms 300 .

[0100] Specifically, please refer to Fig.13 The control device 600 also includes a movement speed adjustment switch 622 installed in the arm control area 620, and the movement speed adjustment switch 622 is used to adjust the gear of the movement speed of the robot arm 300.

[0101] For example, the movement speed adjustment switch 622 is a three-speed knob switch, including a first speed gear, a second speed gear, and a third speed gear in which the movement speed of the robot arm 300 decreases in sequence.

[0102] Specifically, please refer to Fig.12 The control device 600 also includes a motion mode adjustment switch 623 installed in the arm control area 620, and the motion mode adjustment switch 623 is used to adjust the motion mode of the robot arm 300. The motion mode includes at least two of the global motion mode, the translational motion mode and the orbiting motion mode.

[0103] For example, the motion mode adjustment switch 623 is a three-position knob switch having a global motion mode, a translational motion mode, and a point-orbiting motion mode.

[0104] When the operator points the motion mode adjustment switch 623 to the global motion mode, the multidimensional manipulator 621 inputs multidimensional data containing six degrees of freedom, which can control the end of the robot arm 300 to perform global motion in the effective working space.

[0105] When the operator points the motion mode adjustment switch 623 to the translation motion mode, the multi-dimensional manipulator 621 inputs multi-dimensional data containing six degrees of freedom, and the control system retains the translation data along three axes and the rotation data around the vertical axis (Z axis) in the three-dimensional coordinate system, and ignores the rotation data of the two horizontal axes (X axis and Y axis), that is, the end of the control robot 300 can only translate and rotate around the vertical axis. For example, when the end effector 500 clamps the object being worked, in the translation motion mode, the end effector 500 will not overturn, preventing the liquid in the object being worked from spilling or the object from falling.

[0106] When the operator points the motion mode adjustment switch 623 to the point-around motion mode, the multidimensional manipulator 621 inputs multidimensional data containing six degrees of freedom, and the control system retains the rotation data around three axes in the three-dimensional coordinate system and ignores the translation data along the three axes, so that the end of the robotic arm 300 can only rotate but not translate. For example, when a special robot is performing bomb disposal operations and needs to cut the line, in the point-around motion mode, the end effector 500 will keep pointing to this point in the three-dimensional space and rotate around this point in space, so as to achieve fine operations under special environments and functional requirements.

[0107] When there are two robotic arms 300, the motion mode also includes a dual-arm joint synchronous motion mode. In the dual-arm joint synchronous motion mode, the operator operates a multi-dimensional manipulator 621 and inputs multi-dimensional data, and then the ends of the two robotic arms 300 move synchronously according to the multi-dimensional data. For example, two robotic arms 300 jointly clamp a certain object to be worked on. In the dual-arm joint synchronous motion mode, the two robotic arms 300 move synchronously to avoid the object to be worked on falling due to the asynchronous movement and separation of the two robotic arms 300.

[0108] Specifically, please refer to Fig.13 The control device 600 also includes a reset button 624 installed in the arm control area 620, and the reset button 624 is used to control the robot arm 300 to reset to a preset working posture.

[0109] For example, there are four reset buttons 624, and the operator can set four preset working postures. For example, one of the reset buttons 624 corresponds to the preset working posture of the robot arm 300, which is the reset of the end effector 500. When the operator presses the reset button 624, the first reset line 3511 of the wrist shell 351 and the second reset line 3521 of the rotating adapter 352 are aligned, so that the end effector 500 is quickly reset. For another example, there is a reset button 624 corresponding to the preset working posture of the robot arm 300, which is as follows: Figure 3 The initial posture is shown. When the operator presses the reset button 624, the entire robot arm 300 is reset to the initial posture.

[0110] Specifically, please refer to Fig.13 The control device 600 also includes an actuator working button 625 installed in the arm control area 620, and the actuator working button 625 is used to control the opening and closing of the end effector 500.

[0111] Specifically, please refer to Fig.13 The control device 600 also includes an actuator rotation button 626 installed in the arm control area 620, and the actuator rotation button 626 is used to control the forward and reverse rotation of the fourth rotation joint 307 to achieve external rotation and internal rotation of the end effector 500.

[0112] In a specific embodiment, please refer to Fig.13 The control panel 602 also has a switch wiring area 640, a chassis control area 650 and a visual device control area 630. The switch wiring area 640 is provided with a power switch and some wiring sockets. The chassis control area 650 is used to input the travel joystick and travel buttons of the travel mechanism 120 of the chassis 100.

[0113] Embodiment 3

[0114] The present application also provides a special robot system, including the special robot in any specific embodiment of Example 1 and the control device 600 in any specific embodiment of Example 2.

[0115] Please review Figures 4 to 6 The special robot includes a chassis 100, a body 200, a mechanical arm 300, a visual device and a controller, wherein the body 200 is mounted on the chassis 100. One end of the mechanical arm 300 is mounted on the body 200, and the other end of the mechanical arm 300 is mounted with an end effector 500. The mechanical arm 300 has a plurality of movable joints 308, and the movable joints 308 include joint driving components 362. The visual device is used to sense the surrounding environment of the special robot. The controller is electrically connected to the visual device and the plurality of joint driving components 362, respectively. The controller is used to obtain the current state of each joint driving component 362, and to receive multi-dimensional posture control instructions from the control system.

[0116] Please review Figures 11 to 13 The control device 600 includes a first display screen 601, a second display screen 610, a multi-dimensional manipulator and a control system. The control system is communicatively connected to the controller of the special robot. The first display screen 601, the second display screen 610 and the multi-dimensional manipulator 621 are electrically connected to the control system respectively. The first display screen 601 is used to display the image information captured by the visual device, and the second display screen 610 is used to display the working status of the special robot. The multi-dimensional manipulator 621 is used to input multi-dimensional data for controlling the movement of the end of the robot arm 300. The control system sends a multi-dimensional posture control instruction to the controller according to the multi-dimensional data.

[0117] Among them, the operator can intuitively perceive the surrounding environment of the special robot through the first display screen 601, avoid the robot arm 300 from colliding with surrounding obstacles, so as to accurately control the robot arm 300, and timely learn the working status of the special robot through the second display screen 610, thereby solving the technical problem of control failure existing in the existing control device 600, thereby improving the safety and reliability of the control method.

[0118] In a specific embodiment, the robot arm 300 also includes a force sensor 361 connected to the end effector 500, and the force sensor 361 is used to detect the connection stress information between the robot arm 300 and the end effector 500. The second display screen 610 is also used to display the connection stress information, so that the operator can timely understand the force conditions between the robot arm 300 and the end effector 500 to accurately and safely input multi-dimensional data.

[0119] In a specific embodiment, the movable joint 308 further includes a brake 365 electrically connected to the joint driver 362 , and the controller is used to send a braking instruction to the joint driver 362 so that the brake 365 mechanically locks the joint driver 362 .

[0120] In a specific embodiment, please refer to Figure 3 The visual device includes a plurality of cameras, which are mounted on the chassis 100, the body 200 or the mechanical arm 300. At least one camera is mounted on the chassis 100, the body 200 or the mechanical arm 300 through an electric pan-tilt platform. The plurality of cameras may be any three or more of the first camera 410, the second camera 420, the third camera 440, the fourth camera 450 and the fifth camera 460 introduced in the first embodiment. Specifically, the first camera 410 and the second camera 420 are mounted through an electric pan-tilt platform.

[0121] In a specific embodiment, please refer to Fig.12 The control panel 602 is equipped with a switch button 633 and a joystick. The switch button 633 is used to control the first display screen 601 to switch to display the image content captured by different cameras, so that the first display screen 601 switches to the image content captured by the first camera 410, the second camera 420, the third camera 440, the fourth camera 450 or the fifth camera 460. The joystick is used to control the electric pan-tilt head to perform rotation and pitch movements, and the joystick is also used to control the enabling of the electric pan-tilt head. For example, the joystick moves left and right, indicating that the electric pan-tilt head performs forward and reverse rotation; the joystick moves up and down, indicating that the electric pan-tilt head performs pitch movements.

[0122] Optionally, the joystick includes a first joystick 631 for controlling the first electric pan-tilt head 411 and a second joystick 632 for controlling the second electric pan-tilt head 421 .

[0123] Optionally, refer to Fig.11 The operator switches the first display screen 601 to display images captured by a single camera or simultaneously display images captured by at least two cameras by switching the button 633.

[0124] In addition, the first display screen 601 can also be used to zoom in or out the displayed image.

[0125] In a specific embodiment, please refer to Fig.11 and Fig.12 The number of the robotic arms 300 is more than two, the number of the multi-dimensional manipulators 621 is the same as the number of the robotic arms 300, and the multi-dimensional manipulators 621 and the robotic arms 300 are arranged in a one-to-one correspondence.

[0126] Embodiment 4

[0127] Please refer to Fig.14 The present application also provides a control method for a special robot system, which is applied to any of the above special robot systems, including:

[0128] S100: The multi-dimensional manipulator 621 sends the multi-dimensional data generated based on the operator's input action to the control system;

[0129] S200: The control system sends a multi-dimensional position control instruction to the controller of the special robot according to the multi-dimensional data.

[0130] S300: The controller calculates the driving instructions of each joint driving component 362 according to the multi-dimensional posture control instructions and the current posture of the robot arm.

[0131] S400: The controller sends a driving instruction to the corresponding joint driving component 362 .

[0132] In this way, the operator only needs to input multidimensional data through the multidimensional manipulator 621, and the controller automatically calculates the corresponding driving instructions of the joint driver 362, so that the end effector 500 can reach the target position specified by the operator, thereby improving the control convenience of the special robot, reducing the control difficulty, and providing the operator with a simple and efficient control method.

[0133] The execution subject of the above steps is the controller. The controller can also calculate the driving instructions of each joint driving member 362 according to the current state of the robot 300 and the multi-dimensional posture control instructions. The current state of the robot 300 includes one or more of the current posture of the robot 300, the rotation angle of each active joint 308, and the load state of the drive motor.

[0134] In a specific embodiment, the special robot further includes a first camera 410, a second camera 420 and a column 430, the first camera 410 is rotatably mounted on the top of the body 200 through a first electric pan-tilt platform 411, the column 430 is mounted on the chassis 100, and the second camera 420 is rotatably mounted on the top of the column 430 through a second electric pan-tilt platform 421. The above control method also includes:

[0135] Receive the first vector instruction sent by the control device 600 , calculate the first motion instruction according to the first vector instruction and the current state of the first electric pan-tilt platform 411 , and send the first motion instruction to the first electric pan-tilt platform 411 .

[0136] Receive the second vector instruction sent by the control device 600 , calculate the second motion instruction according to the second vector instruction and the current state of the second electric pan-tilt platform 421 , and send the second motion instruction to the second electric pan-tilt platform 421 .

[0137] In this way, the operator can conveniently control the rotation and pitch movements of the first electric pan-tilt head 411 and the second electric pan-tilt head 421 through the joystick of the operating device 600 .

[0138] In one embodiment, the chassis 100 includes a cabin 110 and a walking mechanism 120 for driving the cabin 110 to walk, and the controller is electrically connected to the walking mechanism 120 .

[0139] The control method provided in the present application also includes: the controller receives the third vector instruction for the motion control of the chassis 100 sent by the control device 600, and the controller calculates the third motion instruction and sends it to the chassis 100. In this way, the operator can conveniently control the walking mechanism 120 of the chassis 100 to walk through the control lever and button of the chassis control area 650 of the control device 600.

[0140] In one embodiment, the body 200 is swingably mounted on the chassis 100 .

[0141] The control method provided in the present application also includes: the controller also receives a fourth vector instruction sent by the control device 600 for controlling the body body 200, and the controller calculates a fourth motion instruction based on the fourth vector instruction and sends it to the body body 200 to control the pitch motion and rotation motion of the body body 200.

[0142] In this embodiment, the controller periodically sends information to each joint driver 362, chassis 100, first electric pan-tilt head 411, second electric pan-tilt head 421 and body main body 200 at a high refresh rate to control them to implement corresponding command movements and complete the entire process of special robot control.

[0143] In one embodiment, the control device 600 periodically sends the multi-dimensional posture control instructions to the controller, and the controller completes the calculation and sending of the current drive instruction in a single cycle. After receiving the current drive instruction, the joint drive component 362 immediately operates according to the current drive instruction.

[0144] That is, the controller completes the motion trajectory calculation, working space judgment, alarm information processing or calculation and issuance of drive instructions of the robot arm 300 within a single cycle, and the joint driver 362 starts to operate according to the drive instruction as soon as the drive instruction is received; in the next cycle, a new multi-dimensional posture control instruction arrives and completes the process. When the new drive instruction is sent to the joint driver 362, regardless of whether the drive instruction received by the joint driver 362 in the previous instruction cycle has been executed, it immediately starts to execute the latest received drive instruction, thereby achieving low-latency real-time control.

[0145] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A special robot system, characterized in that: The invention comprises a special robot and a control device, wherein the special robot is used to provide the control device with image information reflecting the surrounding environment of the special robot and the working state of the special robot; the control device comprises a first display screen, a second display screen, a multi-dimensional manipulator and a control system; The special robot comprises a chassis, a body, a mechanical arm, a visual device and a controller, wherein the body is mounted on the chassis, one end of the mechanical arm is mounted on the body, the other end of the mechanical arm is mounted with an end effector, the mechanical arm has a plurality of movable joints, the movable joints comprise joint driving parts, the visual device is used to sense the posture and surrounding environment of the special robot, the controller is electrically connected to the visual device and the plurality of joint driving parts respectively, and the controller is used to obtain the current state of each joint driving part, and receive multi-dimensional posture control instructions from the control system; The mechanical arm comprises a shoulder, an upper arm, an elbow, a lower arm and a wrist connected in sequence, the number of the movable joints is seven, and the seven movable joints are respectively a first rotation joint connecting the body and the shoulder, a first swing joint of the shoulder, a second rotation joint connecting the upper arm and the elbow, a second swing joint of the elbow, a third rotation joint connecting the lower arm and the wrist, a third swing joint of the wrist, and a fourth rotation joint of the end of the wrist; The end effector comprises an actuator mounting portion and an actuator working portion mounted on the actuator mounting portion, the actuator mounting portion having a mounting plate extending toward the fourth rotation joint, the mounting plate having a first mounting hole penetrating the mounting plate, and the actuator mounting portion also having a limiting plate extending toward the fourth rotation joint; the fourth rotation joint comprises a wrist housing and a rotation mounting portion; the rotation mounting portion is rotatably mounted on the wrist housing; the rotation mounting portion has a first mounting groove for inserting the mounting plate, and a side wall of the rotation mounting portion has a second mounting hole whose position corresponds to the position of the first mounting hole, and the rotation mounting portion also has a limiting groove for inserting the limiting plate; The mechanical arm further comprises a force sensor connected to the end effector, the force sensor is used to detect connection stress information between the mechanical arm and the end effector, and the second display screen is also used to display the connection stress information; The movable joint further comprises a brake electrically connected to the joint driving member, and the controller is used to send a braking instruction to the joint driving member, and the braking instruction is used to make the brake mechanically lock the joint driving member; The visual device includes a plurality of cameras installed on the chassis, the body or the mechanical arm, at least one of the cameras is installed through an electric pan-tilt head, and the control device also includes a control panel and a switch button and a joystick installed on the control panel, the switch button is used to control the first display screen to switch and display the image content captured by different cameras, the joystick is used to control the electric pan-tilt head to perform rotation and pitch movements, and the joystick is also used to control the enabling of the electric pan-tilt head; The control system is used to communicate with the special robot, and the control system is used to obtain image information reflecting the surrounding environment of the special robot and the working state of the special robot from the special robot; the control system is electrically connected to the first display screen, the second display screen and the multi-dimensional manipulator respectively; The first display screen is used to display the image information; The second display screen is used to display the working status of the special robot; The multi-dimensional manipulator is used to send the multi-dimensional data generated based on the input action of the operator to the control system; the multi-dimensional manipulator refers to a device that can independently output three-dimensional translation variables and three-dimensional rotation variables in space; The control system is used to send a multi-dimensional posture control instruction to the special robot according to the multi-dimensional data, wherein the multi-dimensional posture control instruction includes the movement end position information of the end of the mechanical arm of the special robot, and the multi-dimensional posture control instruction is used to control the end position of the movement of the end of the mechanical arm; the controller of the special robot calculates the movement path of the end of the mechanical arm according to the movement end position information of the end of the mechanical arm; The control device further comprises a control panel, the second display screen is mounted on the control panel, the control panel has an arm control area, and the multi-dimensional manipulator is mounted on the arm control area; The special robot includes a controller, and the control system is used to send a multi-dimensional posture control instruction to the controller according to the multi-dimensional data; The control device further comprises at least one of the following: A motion speed regulating switch installed in the arm control area, the motion speed regulating switch is used to adjust the gear position of the motion speed of the mechanical arm of the special robot; A motion mode adjustment switch installed in the arm control area, the motion mode adjustment switch is used to adjust the motion mode of the mechanical arm of the special robot, the motion mode including at least two of a global motion mode, a translational motion mode and a point orbiting motion mode; A reset button is installed in the arm control area, and the reset button is used to control the mechanical arm of the special robot to reset to a preset working posture.

2. A control method for a special robot system, applied to the special robot system according to claim 1, characterized in that: include: The multi-dimensional manipulator sends the multi-dimensional data generated based on the operator's input action to the control system; The control system sends a multi-dimensional position control instruction to a controller of the special robot according to the multi-dimensional data; The controller calculates the driving instructions of each joint driving component according to the multi-dimensional posture control instruction and the current posture of the robot arm; The controller sends the driving instruction to the corresponding joint driving component.

3. The control method of the special robot system according to claim 2, characterized in that: The multi-dimensional posture control instructions are periodically sent to the controller, and the controller completes the calculation and sending of the current drive instructions in a single cycle. After receiving the current drive instructions, the joint drive component immediately operates according to the current drive instructions.