A flexible robot and control method thereof
By designing a flexible robot with a servo-like structure and SMA spring-driven, combined with visual recognition and control module, the problem of insufficient power and complex control of flexible robots is solved, and safe and smooth pickup of fragile and micro items is achieved, reducing the Cost and improve applicability and efficiency.
Patent Information
- Application Number
- CN202211039430.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-29
- Publication Date
- 2024-11-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Existing flexible robots have problems such as insufficient power, unstable control, high development costs and complex control, and it is especially difficult to effectively grasp fragile and micro-items.
A flexible robot including a flexible robot, a visual recognition module and a control module is designed. The jaws are provided with joints similar to the servo structure. The jaws are driven by the SMA spring assembly to perform the gripping action, combining the Arduino expansion board and the Raspberry The system performs visual recognition and control to realize automated pickup.
It realizes safe and smooth clamping of fragile and micro items, reduces the complexity of structure and control, reduces costs, and realizes remote control through Bluetooth modules, improving the applicability and efficiency of flexible robots.
Smart Images

Figure CN115476379B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of mechanical automation, and in particular to a flexible robot and a control method thereof. Background Art
[0002] In the early stage of its development, robots were intended to be used in special scenarios that are not suitable for human work, and to ensure personal safety through manual control in a safe area. With the development of society, robots are not only used to replace human operations in harmful environments, but also to replace human operations in monotonous, repetitive and heavy labor, to achieve mechanization and automation of production, and are widely used in machinery manufacturing, metallurgy, electronics, light industry and atomic energy. For example, they are used in automatic production lines, automatic machine tools and machining centers in production workshops for loading and unloading or automatic inspection.
[0003] Based on the application environment of existing manipulators, manipulators are usually designed with large size and high strength structure, which are very complicated to install and control, and are used to grasp large and heavy structures. With the advancement of science and technology, manipulator castings have been improved from bulky and complex structures to flexible and simple structures, and flexible manipulators are a typical development direction; flexible manipulators can not only maintain the functions of the original manipulators, but also have more flexibility. The flexible robots they constitute are an indispensable part of the automation development of emerging industries such as medical fields, logistics and warehousing, and the technology is becoming more mature.
[0004] Flexible manipulators include pneumatic, hydraulic and electric types. Among them, pneumatic flexible manipulators are widely used in automobile manufacturing, semiconductor and home appliance industries, fertilizer and chemical industries, food and drug packaging, precision instruments and other fields due to their simple structure, light weight, speed, energy saving and pollution-free. With the application of pneumatic flexible manipulators, some problems were found, namely, insufficient power and unstable control. Hydraulic flexible manipulators not only have pollution problems, but also have difficulties in sealing and risks of liquid seepage.
[0005] Currently, there is a lack of a new type of robot that can solve the problems of existing flexible manipulators, such as insufficient power, low control and equipment stability, high development cost, and complex control. Summary of the invention
[0006] The purpose of the present invention is to provide a flexible robot and a control method thereof. The disclosed flexible manipulator solves the problems of insufficient power, low control and equipment stability, high development cost and complex control of existing flexible manipulators, and can be used for gripping fragile and micro-objects.
[0007] To achieve the above-mentioned object, the present invention proposes the following technical solution: a flexible robot, comprising a flexible manipulator, a visual recognition module and a control module;
[0008] The flexible manipulator comprises a plurality of manipulator grippers, any of which is provided with at least three joints, which are recorded as a first joint, a second joint and a third joint, and the first joint and the third joint are provided as a servo-like structure; the first joint is used by the flexible manipulator to adjust the relative positions of the plurality of manipulator grippers and change the gripping posture of the flexible manipulator; the second joint is a finger joint of the manipulator gripper, and the finger joint is composed of an SMA spring assembly and is used to drive the gripper on the manipulator gripper to perform a gripping action; the third joint is used to adjust the position of the gripper on the plurality of manipulator grippers so that the gripper approaches the object to be picked up or lifts the object after the gripper grabs the object to be picked up;
[0009] The control module includes an Arduino expansion board, a steering gear controller connected to the Arduino expansion board, and an SMA drive module, wherein the steering gear controller is controlled to be connected to the first joint and the third joint, and the SMA drive module is controlled to be connected to the SMA spring assembly;
[0010] The visual recognition module includes an image acquisition unit and a Raspberry Pi connected to the Arduino expansion board; the image acquisition unit signal is connected to the Raspberry Pi, used to acquire visual information of the object to be picked up and send it to the Raspberry Pi; the Raspberry Pi processes and recognizes the visual information it receives, and sends the recognition result to the Arduino expansion board;
[0011] The control module calls a preset manipulator working program corresponding to the recognition result according to the recognition result received by the Arduino expansion board to send a control signal to the servo controller and the SMA drive module. The servo controller and the SMA drive module respectively drive the first joint, the third joint and the SMA spring assembly according to the control signals received, thereby completing the picking up of the object to be picked up.
[0012] Furthermore, it also includes a Bluetooth module and a mobile terminal, wherein the Bluetooth module is connected to the Arduino expansion board, and the mobile terminal is communicatively connected to the Bluetooth module, so as to realize remote control of the flexible robot.
[0013] Furthermore, the flexible manipulator further includes a first connecting portion and a second connecting portion;
[0014] The plurality of manipulator grippers are connected to the output end of the first joint via the first connection portion, the manipulator grippers are distributed in an array around the same horizontal plane of the output end, and any two adjacent manipulator grippers have at least a first angle and a second angle under the drive of the first joint; the first angle and the second angle constitute two gripping postures of the manipulator;
[0015] The manipulator gripper also includes a connecting arm, one end of which is fixed to the first connecting portion, and the other end of which is movably connected to the gripper by an SMA spring assembly, the gripper is connected to the output end of the third joint via the second connecting portion, and the gripper has the freedom to move in the vertical direction under the drive of the third joint;
[0016] When the SMA driving module drives the SMA spring assembly to extend, the grippers of the manipulator close to the object to be picked up approach each other and close together, so that the object to be picked up is picked up.
[0017] Furthermore, the first joint and the third joint are arranged in sequence from top to bottom in the flexible manipulator to form the manipulator body;
[0018] The first joint includes a first housing and an electric rotating unit disposed in the first housing, and the third joint includes a second housing and an electric telescopic unit disposed in the second housing; the first housing is fixed above the second housing, and the electric rotating unit is provided with a first output shaft vertically penetrating the bottom surface of the first housing, and the bottom end of the first output shaft extends to the top of the second housing;
[0019] The manipulator gripper comprises three parts, wherein the first connection part comprises a first connection unit, a second connection unit and a third connection unit respectively connected to a manipulator gripper; the first connection unit is configured as a fixing part, which is connected to the top of the manipulator gripper and is used to fix the manipulator gripper connected thereto on the upper surface of the second shell; the second connection unit comprises a driving gear connected to the top of the manipulator gripper, the driving gear is fitted on the upper surface of the second shell, and a first through hole is provided at the axial center position of its tooth surface, and the first through hole is tightly matched with the bottom end of the first output shaft; the third connection unit comprises a driven gear connected to the top of the manipulator gripper, the driven gear is fitted on the upper surface of the second shell, and the driven gear is meshed with the driving gear; a second through hole is provided at the axial center position of the tooth surface of the driven gear, and a positioning part is provided on the upper surface of the second shell, and the positioning part adopts a bearing to adapt to the second through hole;
[0020] When the electric rotating unit is started, it drives the driving gear to drive the driven gear to rotate, and then drives the manipulator gripper connected thereto to rotate and change the gripping posture.
[0021] Furthermore, the manipulator gripper also includes a connecting rod unit;
[0022] A first mounting position and a second mounting position are arranged at the bottom end of the connecting arm, a third mounting position and a fourth mounting position are arranged on the hand claw, the first mounting position is rotatably connected to the third mounting position by an SMA spring assembly, the second mounting position is rotatably connected to the fourth mounting position by a connecting rod unit, and the SMA spring assembly is parallel to the connecting rod unit;
[0023] The closing direction of the flexible manipulator is defined as the inside, and a working surface facing inside is provided on the gripper; when the SMA driving module drives the SMA spring assembly to extend, the bottom of the working surface is driven to flip inside, and the working surface contacts the object to be picked up.
[0024] Furthermore, the second connection portion includes a rotating portion and three fourth connection units having the same structure;
[0025] The electric telescopic unit is provided with a second output shaft vertically penetrating the bottom surface of the second housing, and the rotating part is provided at the bottom end of the second output shaft extending out of the second housing; the rotating part includes a rotating disk, and a third through hole is provided in the middle of the rotating disk, and the third through hole of the rotating disk is adapted to be connected to the second output shaft via a bearing;
[0026] The fourth connection unit array is arranged on the rotating disk, and its position corresponds to the position of the manipulator gripper one by one; the fourth connection unit is provided with a movable connection part, and the movable connection part is rotatably connected to the connecting rod unit of the manipulator gripper;
[0027] When the electric telescopic unit is started, the rotating part is driven to move back and forth in the vertical direction, thereby driving the connecting rod unit and the hand claw connected thereto to move up and down in the vertical direction.
[0028] Furthermore, the first through hole is configured as an elliptical hole, and the shape of the bottom end of the first output shaft is adapted to the first through hole.
[0029] The present invention also discloses a control method for the above-mentioned flexible robot, the method comprising:
[0030] Obtaining a number of images of various objects to be picked up by the flexible robot, and constructing an image training set for each object;
[0031] Preprocess the training set of each image to obtain an optimized image training set to remove unrecognizable images;
[0032] Train a visual recognition classification model for objects based on an optimized image training set;
[0033] receiving a first instruction and acquiring visual information of an object to be picked up;
[0034] The visual information is classified according to the target recognition classification model to obtain the category information and item type corresponding to the item to be picked up;
[0035] According to the type of the object to be picked up, the corresponding robot working program is called to control the operation of the flexible robot.
[0036] Furthermore, the manipulator working program is used to determine the clamping posture and clamping force of the flexible manipulator, wherein the clamping posture of the flexible manipulator is determined by the servo controller controlling the first joint, and the clamping force of the flexible manipulator is determined by the SMA drive module setting the duty cycle of its output voltage to achieve control of the working temperature of the SMA spring assembly.
[0037] Furthermore, the method also includes: receiving a Bluetooth communication request sent by a mobile terminal to establish Bluetooth communication; receiving a second instruction sent by the mobile terminal to control the flexible robot to enter a working state.
[0038] It can be seen from the above technical solutions that the technical solutions of the present invention have the following beneficial effects:
[0039] The present invention discloses a flexible robot and a control method thereof, wherein the robot comprises a flexible manipulator having a plurality of manipulator grippers, a visual recognition module and a control module; wherein the manipulator grippers are provided with at least a first joint, a second joint and a third joint which are set as a servo-like structure and a third joint which is composed of an SMA spring assembly, wherein the first joint is used for the flexible manipulator to adjust the mutual positions of the plurality of manipulator grippers and change the gripping posture of the flexible manipulator, the second joint is a finger joint of the manipulator grippers and is used to drive the grippers to fully grasp the action, and the third joint is used to adjust the position of the grippers on the grippers so that the grippers are close to the objects to be picked up or lift the objects to be picked up after the grippers grasp the objects to be picked up; the visual recognition module comprises an image acquisition unit and a Raspberry Pi connected to an Arduino expansion board for controlling the acquisition of visual information of the objects to be picked up and processing and recognizing the information and then feeding back the recognition results to the control module; the control module comprises an Arduino expansion board, a servo controller connected to the Arduino expansion board and an SMA drive module, and is used to call the corresponding manipulator working program according to the recognition results to drive the manipulator to work and complete the picking up of the objects to be picked up. The present invention adopts an SMA spring assembly to form the drive of the finger joints of the flexible manipulator gripper. The SMA drive module adjusts the gripping force of the gripper by controlling the working current of the SMA spring assembly to achieve flexible picking of objects.
[0040] The flexible robot proposed in the present invention adopts an electric flexible manipulator. Compared with pneumatic or hydraulic flexible manipulators, it not only has the advantages of good flexibility, sufficient power, low cost and simple control, but is also more suitable for gripping fragile objects and micro-objects, safe and efficient. In addition, the flexible robot can also use a Bluetooth module to achieve remote control of the mobile terminal, further adapting to the needs of most control scenarios.
[0041] It should be appreciated that all combinations of the foregoing concepts, as well as additional concepts described in greater detail below, may be considered to be part of the inventive subject matter of the present disclosure, provided such concepts are not mutually inconsistent.
[0042] The foregoing and other aspects, embodiments and features of the present invention can be more fully understood from the following description in conjunction with the accompanying drawings. Other additional aspects of the present invention, such as the features and / or beneficial effects of the exemplary embodiments, will be apparent from the following description or learned from the practice of the specific embodiments according to the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] The accompanying drawings are not drawn to scale according to actual reference objects. In the accompanying drawings, each identical or nearly identical component shown in various figures may be represented by the same reference numeral. For the sake of clarity, not every component is labeled in each figure. Now, embodiments of various aspects of the present invention will be described by way of example and with reference to the accompanying drawings, in which:
[0044] Figure 1 The flexible manipulator structure of the present invention is shown in FIG. Figure 1 ;
[0045] Figure 2 The flexible manipulator structure of the present invention is shown in FIG. Figure 2 ;
[0046] Figure 3 It is a top view of the flexible manipulator of the present invention from the first connecting part downward;
[0047] Figure 4 A bottom view of the flexible manipulator of the present invention;
[0048] Figure 5 It is a three-dimensional schematic diagram of the manipulator gripper of the present invention;
[0049] Figure 6 This is a flow chart of the flexible robot control method of the present invention;
[0050] Figure 7 This is the organizational structure diagram of the flexible robot of the present invention.
[0051] In the figure, the specific meaning of each mark is as follows:
[0052] 1-manipulator gripper, 11-connecting arm, 12-claw, 121-working surface, 13-SMA spring assembly, 14-connecting rod unit; 2-first joint, 21-first housing; 3-third joint, 31-second housing, 32-second output shaft; 4-first connecting part, 41-first connecting unit; 42-second connecting unit, 421-driving gear; 43-third connecting unit, 431-driven gear; 5-second connecting part, 51-rotating part, 511-rotating disk; 52-fourth connecting unit. DETAILED DESCRIPTION
[0053] In order to make the purpose, technical solution and advantages of the embodiment of the present invention clearer, the technical solution of the embodiment of the present invention will be clearly and completely described below in conjunction with the drawings of the embodiment of the present invention. Obviously, the described embodiment is a part of the embodiment of the present invention, not all of the embodiments. Based on the described embodiment of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Unless otherwise defined, the technical terms or scientific terms used herein should be the common meanings understood by people with ordinary skills in the field to which the present invention belongs.
[0054] The words "first", "second" and similar words used in the patent application specification and claims of the present invention do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, unless the context clearly indicates otherwise, the singular form of "a", "an" or "the" and other similar words do not indicate a quantitative limitation, but indicate the existence of at least one. "Include" or "comprise" and other similar words mean that the elements or objects appearing before "include" or "comprise" include the features, wholes, steps, operations, elements and / or components listed after "include" or "comprise", and do not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components and / or their collections. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0055] Based on the emergence of more flexible flexible manipulators, they are widely used in scenarios with more complex environments and standard requirements. Some flexible manipulators have some disadvantages when used. For example, pneumatic flexible manipulators are insufficiently powered and hydraulic flexible manipulators are difficult to seal. Although electric manipulators do not have the above problems, they have the common problems of existing manipulators, namely, complex structure and control, and high cost. Therefore, the present invention proposes a flexible manipulator with relatively simple structure and control, and applies the manipulator to a flexible robot. On the one hand, the robot combines visual recognition to realize the process of automated picking. On the other hand, the flexible manipulator uses SMA springs as the drive of the fingers. It is not only flexible and easy to control, but also can be used for safe and smooth gripping control of fragile and micro-objects.
[0056] The flexible robot and control method thereof disclosed in the present invention will be further specifically introduced below in conjunction with the specific embodiments shown in the accompanying drawings.
[0057] Combination Figure 7 As shown, the flexible robot disclosed in the present invention includes a flexible manipulator, a visual recognition module and a control module. The visual recognition module serves as the eyes of the flexible robot to confirm the objects to be picked up, the control module serves as the brain of the flexible robot to publish the working program according to the confirmation results, and the flexible manipulator serves as the limbs of the flexible robot to realize the execution of the working program.
[0058] Specifically, in terms of structure, the flexible manipulator includes a plurality of manipulator grippers 1, and any manipulator gripper 1 is provided with at least three joints, which are denoted as the first joint 2, the second joint and the third joint 3, and the first joint 2 and the third joint 3 are configured as a servo-like structure; the first joint 2 is used for the flexible manipulator to adjust the relative positions of a plurality of manipulator grippers 1 and change the gripping posture of the flexible manipulator; the second joint is the finger joint of the manipulator gripper, which is composed of an SMA spring assembly 13 and is used to drive the claw 12 on the manipulator gripper 1 to perform a grasping action; the third joint 3 is used to adjust the position of the claw 12 on a plurality of manipulator grippers 1 to achieve the claw 12 approaching the object to be picked up or lifting the object after the claw 12 grasps the object to be picked up; when working, the first joint 2, the second joint and the third joint 3 receive control instructions from the control module and act according to the instructions.
[0059] As shown in the figure, the control module includes an Arduino expansion board, a servo controller and an SMA drive module connected to the Arduino expansion board, the servo controller is controlled to be connected to the first joint 2 and the third joint 3, and the SMA drive module is controlled to be connected to the SMA spring assembly 13; the visual recognition module is built by the Raspberry Pi with a Tensorflow framework for visual recognition, including an image acquisition unit and a Raspberry Pi controlled to be connected to the Arduino expansion board, and the Arduino expansion board and the Raspberry Pi realize the transmission and reception of data between the two hardware by establishing serial port communication; the image acquisition unit signal is connected to the Raspberry Pi, which is used to obtain the visual information of the object to be picked up and send it to the Raspberry Pi; the Raspberry Pi processes and recognizes the visual information received by it, and sends the recognition result to the Arduino expansion board; then, the control module calls the preset manipulator working program corresponding to the recognition result according to the recognition result received by the Arduino expansion board to send a control signal to the servo controller and the SMA drive module, and the servo controller and the SMA drive module respectively drive the first joint 2, the third joint 3 and the SMA spring assembly 13 to work according to the control signal received by them, so as to complete the picking of the object to be picked up.
[0060] In this solution, the action response of the flexible robotic finger tip mainly depends on the temperature change of the SMA spring. It is known that the main factors affecting the temperature change of the SMA spring are: the temperature of the SMA spring, the heat exchange between the SMA spring and the environment, and the phase change latent heat of the SMA spring. Therefore, in order to ensure the action response speed of the flexible robotic finger tip, the SMA spring material used in the embodiment is Ni-Ti-Cu shape memory alloy wire. After heat treatment, the Ni-Ti-Cu shape memory alloy wire is input with a driving current signal with an amplitude of 430mA, a period of 7.7s, and a pulse width of 2.7s, so that it heats up and stretches when powered on. After the input signal is turned off, it naturally cools and shrinks, with high precision and low cost.
[0061] In the embodiment, the control module uses the Arduino expansion board as the core of the control system, which allows developers to customize and adjust, can effectively improve the efficiency of the development of the robot arm function, and make the flexible manipulator better applied to daily life and industrial control. The overall concept of the control module is: using a steering gear controller, an SMA driver module, and an Arduino expansion board. The steering gear controller can have built-in Bluetooth, a handle interface, an interface and a bus execution module that can be debugged by the user. The Arduino expansion board can also connect a sensor module, a handle and other analog gyroscope devices to achieve communication with external modules. By writing different programs, the flexible manipulator is developed for function. Optionally, the control handle or the mobile terminal can also be used to transmit control signals through Bluetooth to realize the manual control of the flexible manipulator and the development of functions such as the overall automatic sensing and grasping of the device to achieve positioning and clamping.
[0062] For example, the flexible robot also includes a Bluetooth module and a mobile terminal, wherein the Bluetooth module is connected to the Arduino expansion board, and the mobile terminal is connected to the Bluetooth module for remote control of the flexible robot. The Bluetooth module can be selected as the BT06 Bluetooth module, which supports the UART interface and the SPP Bluetooth serial port protocol, has the advantages of low cost, small size, low power consumption, high transceiver sensitivity, etc., and only needs to be equipped with a few peripheral components to realize its powerful functions. During implementation, first connect the BT06 Bluetooth module through the Arduino expansion board, configure the Bluetooth name and password according to the AT instruction set, and see the successful prompt message in the serial port window; after successful pairing, reconnect RTX and TXD to the transceiver pins of the Arduino expansion board, and control the flexible manipulator action by setting the switch judgment statement in the Arduino expansion board; at the same time, connect the Bluetooth module to the mobile terminal Bluetooth serial port assistant, send control information, and the flexible manipulator can complete the corresponding grasping and releasing; the Bluetooth module has a fast response speed, and the response range is within the range of 10-30m. It can transmit over a long distance without obstructions, and can further adapt to the needs of most control scenarios.
[0063] Combination Figure 1 and Figure 2 As shown, the flexible manipulator also includes a first connection part 4 and a second connection part 5; when the flexible manipulator is assembled, a plurality of manipulator grippers 1 are connected to the output end of the first joint 2 via the first connection part 4, and the manipulator grippers 1 are arranged in an array around the same horizontal plane of the output end of the first joint 2, and any two adjacent manipulator grippers 1 have at least a first angle and a second angle under the drive of the first joint 2; the first angle and the second angle constitute two gripping postures of the manipulator; the manipulator gripper 1 includes a connecting arm 11, a hand gripper 12 and an SMA spring assembly 13, and when installed, the connection One end of the connecting arm 11 is fixed to the first connecting part 4, and the other end is movably connected to the gripper 12 by the SMA spring assembly 13. The gripper 12 is connected to the output end of the third joint 3 via the second connecting part 5, and the gripper 12 has the freedom to move in the vertical direction under the drive of the third joint 3; the control center is electrically connected to the first joint 2, the third joint 3 and the SMA spring assembly 13 respectively; when the SMA driving module drives the SMA spring assembly 13 to extend, the grippers 12 of the manipulator gripper 1 close to the object to be picked up approach each other and close together, so that the object to be picked up is picked up.
[0064] The working process of the flexible manipulator disclosed in the present invention is as follows: the first joint 2 drives the manipulator claw 1 to change the gripping posture of the manipulator, the third joint 3 drives the manipulator claw 12 to approach the object to be gripped, and the SMA spring assembly 13 drives the claw 12 to clamp on the surface of the object to be picked up when working.
[0065] When implementing it, Figure 1 and Figure 2 As shown, the first joint 2 and the third joint 3 are arranged in sequence from top to bottom in the flexible manipulator to form the main body of the manipulator; the first joint 2 includes a first shell 21 and an electric rotating unit arranged in the first shell 21, and the third joint 3 includes a second shell 31 and an electric telescopic unit arranged in the second shell 31; Figure 1 As shown, the first housing 21 is fixed above the second housing 31. In the embodiment, the first housing 21 is connected to the second housing 31 by a symmetrically arranged support column. The electric rotating unit is provided with a first output shaft vertically penetrating the bottom surface of the first housing 21, and the bottom end of the first output shaft extends to the top of the second housing 31. In the embodiment, the manipulator body constitutes the core structure of the flexible manipulator, and the electric rotating unit can select a rotating motor, and the electric telescopic unit can select a telescopic motor.
[0066] In the embodiment shown in the drawings, the flexible manipulator is provided with three manipulator grippers 1, so the first joint 2 can drive the three manipulator grippers 1 to change between a gripping posture of 120° or 180°.
[0067] Combination Figure 3 As shown, the first connecting portion 4 includes a first connecting unit 41, a second connecting unit 42 and a third connecting unit 43 respectively connected to a manipulator gripper 1; when designed, the first connecting unit 41 is set as a fixing portion, which is connected to the top of the manipulator gripper 1 and is used to fix the manipulator gripper 1 connected thereto on the upper surface of the second shell 31; the second connecting unit 42 includes a driving gear 421 connected to the top of the manipulator gripper 1, the driving gear 421 is fitted on the upper surface of the second shell 31, and the axial center position of the tooth surface is provided with a A first through hole; the third connecting unit 43 includes a driven gear 431 connected to the top of the manipulator gripper 1, the driven gear 431 is fitted on the upper surface of the second shell 31, and the driven gear 431 is meshed with the driving gear 421; during assembly, the first through hole is tightly matched with the bottom end of the first output shaft, and the driving gear 421 is connected to the first joint 2 only through the first output shaft; a second through hole is provided at the axial center position of the tooth surface of the driven gear 431, and a positioning portion is provided on the upper surface of the second shell 31, and the positioning portion adopts a bearing to adapt to the second through hole.
[0068] In the embodiment, the first through hole is set as an elliptical hole, the shape of the bottom end of the first output shaft is adapted to the first through hole, and the first output shaft will not slide after matching with the elliptical hole; the positioning part is designed as a cylinder protruding from the upper surface of the second shell 31 to the first shell 21, and the outer wall of the cylinder adopts a rolling bearing to match the second through hole. In order to facilitate installation, in the embodiment shown in the drawings, the driving gear 421 and the driven gear 431 are both set as a plate-like structure, and the driving gear 421 and the driven gear 431 are respectively composed of a plurality of continuous teeth arranged on the periphery of one end of the plate-like structure, and the other end of the plate-like structure is connected to the upper end of the connecting arm 11 on the manipulator gripper 1 by a connecting piece.
[0069] When the first joint 2 works, its electric rotation unit starts, driving the active gear 421 to drive the driven gear 431 to rotate, thereby driving the manipulator gripper 1 connected thereto to rotate and change the gripping posture. In this embodiment, the manipulator gripper 1 connected to the first connection unit 41 is fixed to the upper surface of the second housing 31 and is a fixed gripper, and the manipulator gripper 1 connected to the second connection unit 42 and the third connection unit 43 is a movable gripper. Therefore, the electric rotation unit realizes the adjustment and change of the gripping posture of the manipulator by driving the movable gripper.
[0070] Combination Figure 5 In the specific structure shown, the manipulator gripper 1 also includes a connecting rod unit 14; during installation, a first mounting position and a second mounting position are set at the bottom end of the connecting arm 1, and a third mounting position and a fourth mounting position are set on the gripper 12; during installation, the first mounting position adopts the SMA spring assembly 13 to be rotatably connected to the third mounting position, and the second mounting position adopts the connecting rod unit 14 to be rotatably connected to the fourth mounting position, and the SMA spring assembly 13 is parallel to the connecting rod unit 14; the closing direction of the flexible manipulator is defined as the inner side, and a working surface 121 facing the inner side is set on the gripper 12; when the SMA drive module drives the SMA spring assembly to extend, it drives the bottom of the working surface 121 to flip inward, and makes the working surface 121 contact the object to be picked up; in the flexible manipulator as a whole, the SMA spring assemblies 13 of the three manipulator grippers 1 work simultaneously and make the grippers 12 tighten and close inward to complete the clamping action of the object to be picked up.
[0071] Further integration Figure 1 and 2 As shown, in the initial state of the manipulator gripper 1, the length of the SMA spring assembly 13 should not be less than the length of the connecting rod of the connecting rod unit 14, otherwise the working surface 121 of the gripper 12 will be turned outward, and the elongation of the SMA spring assembly 13 required during operation will be greatly increased, which is not conducive to the realization of the gripping action; therefore, in the embodiment, the length of the connecting rod unit is designed to be equal to the length of the SMA spring assembly 13, so Figure 1As shown, the connecting rod unit 14 and the SMA spring assembly 13 form a parallelogram after being fixed in the first installation position to the fourth installation position, and then when the SMA spring assembly 13 is energized and extended, it can easily drive the claw 12 to flip inward to complete the object clamping.
[0072] The second connecting portion 5 includes a rotating portion 51 and three fourth connecting units 52 with the same structure. Figure 1 , Figure 2 , Figure 4 and Figure 5 As shown; structurally, the electric telescopic unit is provided with a second output shaft 32 vertically penetrating the bottom surface of the second housing 31, and the rotating part 51 is provided at the bottom end of the second output shaft 32 extending out of the second housing 31; the rotating part 51 includes a rotating disk 511, and a third through hole is provided in the middle of the rotating disk 511, and the third through hole of the rotating disk 511 is connected to the second output shaft 32 through a bearing adapter; the fourth connecting unit 52 is arranged in an array on the rotating disk 511, and its position corresponds to the position of the manipulator gripper 1. The matching bearings of the rotating disk 511 and the second output shaft 32 generally also adopt rolling bearings, which cooperate with the first joint 2, so that the fourth connecting unit 52 connects the connecting rod unit and the manipulator gripper 1 to rotate synchronously, and does not affect the normal extension and retraction of the third joint.
[0073] During installation, the fourth connecting unit 52 is provided with a movable connecting part, which is rotatably connected to the connecting rod unit of the manipulator gripper 1; therefore, when the electric telescopic unit is started, it drives the rotating part 51 to move back and forth in the vertical direction, thereby driving the connecting rod unit and the gripper 12 connected thereto to move up and down in the vertical direction.
[0074] As an optional embodiment, the upper part of the connecting arm 11 is set as a type of L-shaped bracket, and the bending part of this type of L-shaped bracket is set as a rounded corner to improve the structural strength of the connecting arm 11; the bottom end of the connecting arm 11 is set as a two-stage step structure extending inward, and the two-stage step structure includes a first step located on the outside and a second step located on the inside, and the bottom surface of the second step is higher than the bottom surface of the first step; when connected, there is a first installation groove with an opening facing downward in the middle of the first step, the first installation groove and the groove walls on both sides constitute the first installation position, and the second step constitutes the second installation position. A second installation groove with an opening facing upward is set on the upper part of the hand claw 12, and the second installation groove and the groove walls on both sides constitute the third installation position and the fourth installation position respectively, wherein the third installation position is located below the fourth installation position, and the third installation position and the fourth installation position correspond to the first installation position and the second installation position in the vertical direction. In a specific implementation, in order to prevent the robot gripper 1 from approaching the object to be picked up and colliding with its storage surface, thereby preventing the gripper 12 from flipping over, an arc-shaped transition surface is provided on the side of the gripper 12 opposite to the working surface 121; for example, as shown in the accompanying drawings, the gripper 12 is designed as a triangular prism structure, one side of the triangular prism constitutes the working surface 121, and the edge opposite to the side and its adjacent two side edges adopt an arc-shaped transition, and the second mounting groove passes through from an opposite side of the edge to the working surface 121, and the working surface 121 is designed as a vertical plane.
[0075] Optionally, considering that the flat surface has a poor clamping effect on fragile or miniature items when the shape is a spherical structure, the working surface 121 can also be designed as an arc-shaped surface that is recessed into the inside of the gripper 12 to adapt to the shape of the item, increase the contact area between the working surface 121 and the item, and effectively improve the clamping effect. In some embodiments, a rubber layer is also fitted on the working surface 121 of the gripper 12 to increase the friction between the gripper 12 and the item through the rubber layer to prevent the gripper 12 from slipping out of the gripper when the gripper is gripping an overly smooth item.
[0076] As an optional embodiment, the SMA spring assembly 13 includes an SMA spring, which is respectively fixed to a first connector and a second connector at both ends of the SMA spring; wherein, the end of the first connector away from the SMA spring is set as an annular structure, and the annular structure is rotatably set in the first mounting groove by a rotating shaft assembly; the end of the second connector away from the SMA spring is set as a semi-cylindrical structure, and the upper edge of the semi-cylindrical structure is parallel to its axial direction and provided with a fourth through hole, and the fourth through hole is rotatably set in the second mounting groove by a rotating shaft assembly, and the arc surface of the semi-cylindrical structure abuts against the bottom surface of the second mounting groove. When the SMA spring is energized and stretched, the SMA spring assembly 13 is stretched as a whole, and the gripper 12 is pushed inward from the abutment between the second connector and the second mounting groove to adapt to the elongation of the SMA spring, so as to realize the posture change of the gripper 12. In the embodiment shown in the drawings, the first connector and the second connector are made of ceramic, and when fixed, the first connector and the second connector are respectively provided with a card slot, and the two ends of the SMA spring are respectively fixed and clamped in the preset card slot.
[0077] As an optional embodiment, Figure 5 As shown, the fourth connecting unit 52 includes an L-shaped bracket and a cross bar, the upper end of the L-shaped bracket is fixedly connected to the disk surface of the rotating disk 511, and the bottom end is rotatably connected to one end of the cross bar by a rotating shaft assembly; the connecting rod unit 14 of the manipulator gripper 1 includes a pair of parallel connecting rods, the connecting rods are symmetrically arranged on the outside of the first mounting groove and the second mounting groove, and the two ends of the connecting rods are respectively rotatably connected to the groove walls of the first mounting groove and the second mounting groove by a rotating shaft assembly; during assembly, the other end of the cross bar is arranged between the two parallel connecting rods, and is connected to the middle of the two connecting rods by a rotating shaft assembly, that is, the cross bar constitutes the movable connection part of the fourth connecting unit 52.
[0078] As an optional embodiment, the shaft assembly is designed as a stud and at least two nuts adapted to be installed therewith; for the SMA spring assembly 13, the stud symmetrically penetrates the groove walls on both sides of the first installation groove or the second installation groove, the first connector and the second connector are respectively mounted on the rod section of the stud located in the groove, and the two ends of the stud protruding from the outside of the groove wall are locked with nuts; for the connecting rod unit, the stud symmetrically penetrates the groove walls on both sides of the second step or the second installation groove, the two ends of the symmetrical connecting rod are respectively connected to one end of the stud protruding from the second step or the second installation groove wall, and then locked with bolts; for the cross bar, it is connected in a position similar to that of the SMA spring during installation; when the shaft assembly composed of the studs is installed, all the studs are parallel to each other. Currently, for a larger manipulator, the shaft assembly can be composed of a shaft in combination with other locking units.
[0079] Combination Figure 6 As shown, another embodiment of the present invention discloses a control method for the above-mentioned flexible robot, the method comprising the following steps:
[0080] Step S102, obtaining a plurality of image information of various objects to be picked up by the flexible robot, and constructing an image training set for each object;
[0081] Generally, the types of objects that the flexible robot picks up are pre-selected, such as batteries, vegetables, fruits, plastic bottles, cans, etc. After determining the specific objects of each type, the objects are photographed from multiple angles, and the photos of each object constitute an independent training set.
[0082] Step S104, preprocessing the training set of each picture to obtain an optimized picture training set to remove unrecognizable pictures;
[0083] Step S106, training a visual recognition classification model of objects according to the optimized image training set;
[0084] During implementation, Lobx software was used for preprocessing and model training. Photos that could not be recognized by Lobx software needed to be deleted to obtain a visual recognition classification model. In this solution, after the visual recognition classification model was obtained, it was imported into the Raspberry Pi for effect testing.
[0085] Step S108, receiving the first instruction and acquiring visual information of the object to be picked up;
[0086] The first instruction is an input start command of the flexible robot, such as pressing a start button; when the control module receives the command and starts working, it controls the image acquisition unit, such as a camera, to take a picture of the object to be picked up, obtains visual information composed of the picture, and sends the visual information to the Raspberry Pi.
[0087] Step S110, classifying the visual information according to the target recognition classification model to obtain category information and item type corresponding to the item to be picked up;
[0088] The Raspberry Pi calls the stored target recognition classification model to classify the received visual information of the object to be picked up, that is, the Arduino expansion board reads the category information pre-stored by the Raspberry Pi through the serial port, so that the type of the object to be picked up can be determined based on the comparative analysis of the category information.
[0089] Step S112, according to the type of the object to be picked up, call the corresponding manipulator working program to control the flexible manipulator to work. The manipulator working program is stored in the control module and is used to determine the gripping posture and gripping force of the flexible manipulator. The gripping posture of the flexible manipulator is determined by the steering gear controller controlling the first joint. The gripping force of the flexible manipulator is controlled by the SMA drive module by setting the duty cycle of its output voltage to achieve the control of the working temperature of the SMA spring assembly, thereby achieving precise control of the gripping force of each object.
[0090] As an optional embodiment, the control method further includes: receiving a Bluetooth communication request sent by a mobile terminal and establishing Bluetooth communication; receiving a second instruction sent by the mobile terminal and controlling the flexible robot to enter a working state; and realizing remote control of the flexible robot. When the BT06 Bluetooth module connected to the control module receives a Bluetooth communication request and establishes communication with the mobile terminal, the mobile terminal can directly send a working instruction to the control module remotely through the second instruction, realizing the process of the flexible robot recognizing an action.
[0091] The flexible robot and control method thereof disclosed above in the present invention, wherein the fingertips of the robot are driven by SMA springs to realize the clamping of objects, have sufficient power, and are not only simple in structure and control, but also suitable for clamping fragile and micro objects, and have stable control; the control method of the present invention pre-builds a visual recognition classification model, and after identifying the objects to be picked up through the model, selects the working program of the manipulator, and then accurately controls the clamping posture of the flexible manipulator and the clamping force of the claws, ultimately achieving stable and safe picking up of objects.
[0092] Although the present invention has been disclosed as above with preferred embodiments, it is not intended to limit the present invention. A person with ordinary knowledge in the technical field to which the present invention belongs may make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the definition of the claims.
Claims
1. A flexible robot, It is characterized in that It includes a flexible manipulator, a visual recognition module and a control module; The flexible manipulator comprises a plurality of manipulator grippers, any of which is provided with at least three joints, which are recorded as a first joint, a second joint and a third joint, and the first joint and the third joint are provided as a servo-like structure; the first joint is used by the flexible manipulator to adjust the relative positions of the plurality of manipulator grippers and change the gripping posture of the flexible manipulator; the second joint is a finger joint of the manipulator gripper, and the finger joint is composed of an SMA spring assembly and is used to drive the gripper on the manipulator gripper to perform a gripping action; the third joint is used to adjust the position of the gripper on the plurality of manipulator grippers so that the gripper approaches the object to be picked up or lifts the object after the gripper grabs the object to be picked up; The control module includes an Arduino expansion board, a steering gear controller connected to the Arduino expansion board, and an SMA drive module, wherein the steering gear controller is controlled to be connected to the first joint and the third joint, and the SMA drive module is controlled to be connected to the SMA spring assembly; The visual recognition module includes an image acquisition unit and a Raspberry Pi connected to the Arduino expansion board; the image acquisition unit signal is connected to the Raspberry Pi, used to acquire visual information of the object to be picked up and send it to the Raspberry Pi; the Raspberry Pi processes and recognizes the visual information it receives, and sends the recognition result to the Arduino expansion board; The control module calls a preset manipulator working program corresponding to the recognition result according to the recognition result received by the Arduino expansion board, and sends a control signal to the steering gear controller and the SMA driving module. The steering gear controller and the SMA driving module respectively drive the first joint, the third joint and the SMA spring assembly to work according to the control signal received, so as to complete the picking up of the object to be picked up; The flexible manipulator further includes a first connecting portion and a second connecting portion; The plurality of manipulator grippers are connected to the output end of the first joint via the first connection portion, the manipulator grippers are distributed in an array around the same horizontal plane of the output end, and any two adjacent manipulator grippers have at least a first angle and a second angle under the drive of the first joint; the first angle and the second angle constitute two gripping postures of the manipulator; The manipulator gripper also includes a connecting arm, one end of which is fixed to the first connecting portion, and the other end of which is movably connected to the gripper by an SMA spring assembly, the gripper is connected to the output end of the third joint via the second connecting portion, and the gripper has the freedom to move in the vertical direction under the drive of the third joint; When the SMA driving module drives the SMA spring assembly to extend, the grippers of the manipulator grippers close to the object to be picked up approach each other and close together, so that the object to be picked up is picked up; The manipulator gripper also includes a connecting rod unit; a first mounting position and a second mounting position are arranged at the bottom end of the connecting arm, a third mounting position and a fourth mounting position are arranged on the gripper, the first mounting position is rotatably connected to the third mounting position by an SMA spring assembly, the second mounting position is rotatably connected to the fourth mounting position by a connecting rod unit, and the SMA spring assembly is parallel to the connecting rod unit; A first mounting groove with an opening facing downward is provided at the bottom end of the connecting arm, and the first mounting groove and the groove walls on both sides thereof constitute a first mounting position; a second mounting groove with an opening facing upward is provided at the upper part of the hand claw, and the second mounting groove and the groove walls on both sides thereof constitute a third mounting position and a fourth mounting position respectively; the SMA spring assembly comprises an SMA spring, and a first connector and a second connector are respectively fixedly connected to the two ends of the SMA spring; wherein, the end of the first connector away from the SMA spring is provided with an annular structure, and the annular structure is rotatably arranged in the first mounting groove by a rotating shaft assembly; the end of the second connector away from the SMA spring is provided with a semi-cylindrical structure, and a fourth through hole is provided on the upper edge of the semi-cylindrical structure parallel to its axial direction, and the fourth through hole is rotatably arranged in the second mounting groove by a rotating shaft assembly, and the arc surface of the semi-cylindrical structure abuts against the groove bottom surface of the second mounting groove; The flexible manipulator is defined as closing inward, and a working surface facing inward is provided on the gripper; when the SMA driving module drives the SMA spring assembly to extend, the bottom of the working surface is driven to flip inward, and the working surface contacts the object to be picked up; The second connection portion includes a rotating portion and three fourth connection units with the same structure; The electric telescopic unit is provided with a second output shaft vertically penetrating the bottom surface of the second housing, and the rotating part is provided at the bottom end of the second output shaft extending out of the second housing; the rotating part includes a rotating disk, and a third through hole is provided in the middle of the rotating disk, and the third through hole is adapted to be connected to the second output shaft via a bearing; The fourth connection unit array is arranged on the rotating disk, and its position corresponds to the position of the manipulator gripper one by one; the fourth connection unit is provided with a movable connection part, and the movable connection part is rotatably connected to the connecting rod unit of the manipulator gripper; When the electric telescopic unit is started, the rotating part is driven to move back and forth in the vertical direction, thereby driving the connecting rod unit and the hand claw connected thereto to move up and down in the vertical direction.
2. The flexible robot according to claim 1, It is characterized in that It also includes a Bluetooth module and a mobile terminal, wherein the Bluetooth module is connected to the Arduino expansion board, and the mobile terminal is communicatively connected to the Bluetooth module, so as to realize remote control of the flexible robot.
3. The flexible robot according to claim 1, It is characterized in that The first joint and the third joint are arranged in sequence from top to bottom in the flexible manipulator to form the manipulator body; The first joint includes a first housing and an electric rotating unit disposed in the first housing, and the third joint includes a second housing and an electric telescopic unit disposed in the second housing; the first housing is fixed above the second housing, and the electric rotating unit is provided with a first output shaft vertically penetrating the bottom surface of the first housing, and the bottom end of the first output shaft extends to the top of the second housing; The manipulator gripper comprises three parts, wherein the first connection part comprises a first connection unit, a second connection unit and a third connection unit respectively connected to a manipulator gripper; the first connection unit is configured as a fixing part, which is connected to the top of the manipulator gripper and is used to fix the manipulator gripper connected thereto on the upper surface of the second shell; the second connection unit comprises a driving gear connected to the top of the manipulator gripper, the driving gear is fitted on the upper surface of the second shell, and a first through hole is provided at the axial center position of its tooth surface, and the first through hole is tightly matched with the bottom end of the first output shaft; the third connection unit comprises a driven gear connected to the top of the manipulator gripper, the driven gear is fitted on the upper surface of the second shell, and the driven gear is meshed with the driving gear; a second through hole is provided at the axial center position of the tooth surface of the driven gear, and a positioning part is provided on the upper surface of the second shell, and the positioning part adopts a bearing to adapt to the second through hole; When the electric rotating unit is started, it drives the driving gear to drive the driven gear to rotate, and then drives the manipulator gripper connected thereto to rotate and change the gripping posture.
4. The flexible robot according to claim 3, It is characterized in that The first through hole is configured as an elliptical hole, and the shape of the bottom end of the first output shaft matches the first through hole.
5. A control method for a flexible robot, applied to the flexible robot according to any one of claims 1 to 4, Characterized in that the method include: Obtaining a number of images of various objects to be picked up by the flexible robot, and constructing an image training set for each object; Preprocess the training set of each image to obtain an optimized image training set to remove unrecognizable images; Train a visual recognition classification model for objects based on an optimized image training set; receiving a first instruction and acquiring visual information of an object to be picked up; The visual information is classified according to the target recognition classification model to obtain the category information and item type corresponding to the item to be picked up; According to the type of the object to be picked up, the corresponding robot working program is called to control the operation of the flexible robot.
6. The control method of the flexible robot according to claim 5, It is characterized in that The manipulator working program is used to determine the clamping posture and clamping force of the flexible manipulator, wherein the clamping posture of the flexible manipulator is determined by the servo controller controlling the first joint, and the clamping force of the flexible manipulator is determined by the SMA drive module setting the duty cycle of its output voltage to achieve control of the working temperature of the SMA spring assembly.
7. The control method of the flexible robot according to claim 6, It is characterized in that Also includes: Receive the Bluetooth communication request sent by the mobile and establish Bluetooth communication; Receive the second instruction sent by the mobile terminal and control the flexible robot to enter a working state.
Citation Information
Patent Citations
Finger rotating and moving device of configuration-changeable robotic gripper and working method thereof
CN101844358A
Space capture manipulator driven by SMA (shape memory alloy) wires
CN111452030A
Device and method for picking and collection of water shield
CN111844009A
Robot arm device with fruit maturity distinguishing function
CN112136506A
Underactuated three -jaw clamping device
CN207616596U
