A multi-posture material positioning and grasping method and system based on visual recognition
Through visual recognition and multi-position posture grasping methods, combined with the positioning device, the problem of low material grasping efficiency in automated loading and unloading is solved, and efficient transfer of complex products is achieved.
Patent Information
- Application Number
- CN202411252906.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-09
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2044-09-09
AI Technical Summary
In the automated loading and unloading industry, existing robots cannot effectively grasp multi-position material when processing speed is fast, product shape is complex and need to be replaced, resulting in low transfer efficiency and uncommon system.
Using a multi-position material positioning and grabbing method based on visual recognition, the material shape and position posture are identified through the visual recognition module, the appropriate material picking fixture is selected, and the material picking or changing posture is grasped according to the material posture, and the material is used to grasp it. The positioning device improves the transfer efficiency.
It improves the material transfer efficiency and can adapt to the situation of fast processing rhythm, complex product appearance and need to be replaced, solving the problems of low transfer efficiency and non-universal system in traditional methods.
Smart Images

Figure CN118752293B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of material grasping, and in particular to a multi-posture material positioning and grasping method and system based on visual recognition. Background Art
[0002] In the automated loading and unloading industry, the products to be processed are usually fed by means of dot matrix tray swinging, conveyor belt feeding, mechanical positioning or visual positioning to determine the position and posture. The robot then takes the products and sends them to the machine tool equipment for processing.
[0003] However, existing robots have the following defects when performing posture grasping of products:
[0004] (1) The dot matrix tray swing feeding solution cannot meet the working conditions with fast processing cycle, and one tray can only correspond to one product.
[0005] (2) The solution of conveyor belt feeding plus mechanical positioning to determine the posture of feeding cannot meet the needs of products with more complex structures. A system is generally only suitable for specific products and cannot be used universally.
[0006] (3) The solution of conveyor belt feeding plus visual positioning to determine the posture of feeding can only meet the needs of products with simple appearance. Products with complex appearance have more postures, and the visual system needs to frequently screen the postures. It can only select the postures suitable for grasping and discard the postures that cannot be grasped, which delays the feeding cycle. In addition, a system is generally only applicable to specific products and cannot be universal. Summary of the invention
[0007] One of the objectives of the present application is to provide a multi-posture material positioning and grasping method based on visual recognition that can solve at least one of the defects in the above-mentioned background technology.
[0008] Another object of the present application is to provide a multi-posture material positioning and grasping system that can solve at least one defect in the above-mentioned background technology.
[0009] In order to achieve at least one of the above purposes, the technical solution adopted in this application is: a multi-posture material positioning and grasping method based on visual recognition, comprising the following steps:
[0010] S100: transporting the material to be transferred to a designated location to trigger visual recognition;
[0011] S200: Identify the shape and position of the material based on visual recognition;
[0012] S300: Selecting a corresponding material picking fixture according to the shape and position of the material;
[0013] S400: determining the working condition of the material grabbing fixture according to the position and posture of the material and performing the grabbing;
[0014] S500: For materials that meet the preset posture conditions, the material picking fixture directly transfers the materials to the feeding fixture;
[0015] S600: For materials that do not conform to the preset posture working condition, the material picking fixture transfers the materials to the position changing device for position change; the feeding fixture is suitable for moving to the position changing device to grab the materials that conform to the preset posture after the change.
[0016] Preferably, the position posture of the material includes a lying posture and a vertical posture; for the material in the lying posture, the material picking clamp is suitable for clamping the material from the side of the material in the horizontal direction; for the material in the vertical posture, the material picking clamp is suitable for clamping the material from the top of the material in the vertical direction.
[0017] Preferably, the material includes an opposite end a and an end b, and the feeding clamp clamps the end b of the material; the grasping condition judgment for the material in a lying position includes the following process: calculating the angle α between the line connecting the end a and the end b of the material and the grasping direction of the picking clamp; if the angle α is 90°, the picking clamp rotates 90° to face the end a and clamps it, and the grasped material is in compliance with the preset posture condition; if the angle α is not 90°, the feeding angle is rotated at an angle less than 90° to face one end of the material and clamp it; when the clamped end of the material is the end a, the grasped material is in compliance with the preset posture condition; when the clamped end of the material is the end b, the grasped material is not in compliance with the preset posture condition.
[0018] Preferably, the material includes a relative end a and end b, and the feeding clamp clamps the end b of the material; the grasping condition judgment for the material in a vertical posture includes the following process: the material picking clamp directly clamps the upper end of the material in a vertical posture downward; if the upper end of the material is the end a, the grasped material is in a state that meets the preset posture condition; if the upper end of the material is the end b, the grasped material is in a state that does not meet the preset posture condition.
[0019] Preferably, step S200 includes the following process:
[0020] S210: Collect the original image I of the material, and pre-process the original image I by Gaussian filtering method to obtain a denoised image Ismooth; Ismooth=G0*I;
[0021] S220: grayscale the image Ismooth to obtain a grayscale image Igray; Igray=0.299R+0.587G+0.114B;
[0022] S230: enhancing the contrast of a specific area in the grayscale image Igray by using an adaptive histogram equalization method;
[0023] S240: Detect the edge of the material using the Sobel operator on the enhanced image to obtain the contour of the current position of the material;
[0024] S250: Matching the acquired material contour with a pre-set part template to acquire the shape of the material, and identifying the position and posture of the material in combination with the current contour position of the material;
[0025] Among them, G0 represents the Gaussian kernel, and R, G, and B represent the intensities of the red, green, and blue color channels, respectively.
[0026] Preferably, in step S250, the matching degree between the material contour and the preset part template is represented by the matching degree NC; when the matching degree NC exceeds the set threshold, it means that the material matches a valid template; if the matching degrees of multiple templates all exceed the set threshold, the template with the highest matching degree is selected; the calculation formula of the matching degree NC is as follows:
[0027] NC(x,y)=∑[(I0(x+i,y+i)-μI0)(T(i,j)- μT)] / [∑ (I0(x+i,y+i)-μI0) 2 ∑(T(i, j)- μT) 2 ];
[0028] Among them, I0 represents the material contour image; T represents the template image; μI0 and μT represent the means of the material contour image and the template image respectively; (x, y) represents the current position of the template in the material contour image; i, j represent the relative position inside the template.
[0029] A multi-posture material positioning and grasping system, used to implement the above-mentioned multi-posture material positioning and grasping method based on visual recognition, comprising a base and a conveyor belt installed on the base, a control system, a visual recognition module, a material picking system, a displacement device and a feeding system; the conveyor belt is used to convey the material to be transferred to the grasping station of the base; the visual recognition module is located near the grasping station to perform visual recognition on the material at the grasping station; the control system is suitable for receiving data from the visual recognition module to recognize the shape and position posture of the material, and calculate the grasping of the material logical trajectory; the picking system is located at one side of the grabbing station, and the picking system is equipped with multiple picking fixtures; the picking system is suitable for receiving the control signal of the control system to select the corresponding picking fixture, and grabbing and transferring the material to the position shifting device or the picking system along the generated grabbing logical trajectory; the position shifting device is suitable for receiving the material transferred by the picking system for position change; the feeding system is located at the feeding station of the base, and the feeding system is suitable for receiving the material transferred by the picking system, or grabbing the material located at the position shifting device.
[0030] Preferably, the material picking system includes a material picking robot and a plurality of the material picking fixtures; the material picking robot is fixedly mounted on the base, and the plurality of the material picking fixtures are divided into at least one group, and the plurality of groups of the material picking fixtures are suitable for being axially spaced along the terminal end of the material picking robot; the number of the material picking fixtures in each group is at least one, and the plurality of the material picking fixtures in each group are equally spaced in the circumferential direction along the terminal end of the material picking robot.
[0031] Preferably, the material picking fixture includes a rotating device, a driving cylinder and at least two jaws; the rotating device is fixedly installed on the terminal of the material picking robot, the driving cylinder is installed on the output end of the rotating device, and the driving cylinder is suitable for rotating around the output axis of the rotating device under the drive of the rotating device; the jaws are installed on the output end of the driving cylinder, and the jaws are suitable for moving closer to or away from each other under the drive of the driving cylinder, thereby grabbing and releasing the material; the jaw structures of different material picking fixtures are different, so that materials of different shapes can be grabbed.
[0032] Preferably, the displacement device includes a third rotating device, a third driving cylinder and at least two third clamps; the third rotating device is fixedly installed, the third driving cylinder is installed at the output end of the third rotating device, and the third clamp is installed at the output end of the third driving cylinder; the feeding system includes a feeding robot and a feeding fixture installed at the terminal of the feeding robot; the feeding fixture includes a fourth driving cylinder and at least two fourth clamps, the fourth driving cylinder is installed at the terminal of the feeding robot, and the fourth clamp is installed at the output end of the fourth driving cylinder.
[0033] Compared with the prior art, the beneficial effects of this application are:
[0034] By using visual recognition to determine the shape and position of the material in advance, we can generate the fastest grabbing logic for transferring the material, thereby improving the efficiency of material transfer to solve the problem of automated loading and unloading when the processing cycle is fast, the product appearance is complex, and the product needs to be changed. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] Figure 1 This is a schematic diagram of the overall structure of the multi-posture material positioning and grasping system in this application.
[0036] Figure 2 For this application Figure 1 An enlarged schematic diagram of part A in the middle.
[0037] Figure 3 Schematic diagrams of various postures of materials in this application.
[0038] Figure 4This is a schematic diagram of the state of the first material grabbing fixture grabbing the material in this application Figure 1 .
[0039] Figure 5 This is a schematic diagram of the state of the first material grabbing fixture grabbing the material in this application Figure 2 .
[0040] Figure 6 This is a schematic diagram of the state of the second material grabbing fixture grabbing the material in this application Figure 1 .
[0041] Figure 7 This is a schematic diagram of the state of the second material grabbing fixture grabbing the material in this application Figure 2 .
[0042] Figure 8 This is a schematic diagram of the relative position of the second material grabbing fixture in this application to grab the material Figure 1 .
[0043] Fig. 9 This is a schematic diagram of the relative position of the second material grabbing fixture in this application to grab the material Figure 2 .
[0044] Fig.10 It is a structural schematic diagram of the displacement device in this application.
[0045] Fig.11 This is a schematic diagram of the feeding clamp in the present application when clamping materials from the displacement device.
[0046] Fig.12 Schematic diagram of the workflow of the multi-pose material positioning and grasping method based on visual recognition in this application.
[0047] In the figure: material 01, base 10, control system 20, conveyor belt 30, visual recognition module 40, material picking robot 50, fixed bracket 501, feeding robot 60, first material picking fixture 71, first rotating device 711, first bracket 712, first drive cylinder 713, first clamp 714, second material picking fixture 72, second rotating device 721, second bracket 722, second drive cylinder 723, second clamp 724, displacement device 80, third rotating device 801, deceleration device 802, third bracket 803, third drive cylinder 804, third clamp 805, feeding fixture 90, fourth bracket 901, fourth drive cylinder 902, fourth clamp 903. DETAILED DESCRIPTION
[0048] Below, the present application is further described in conjunction with specific implementation methods. It should be noted that, under the premise of no conflict, the various embodiments or technical features described below can be arbitrarily combined to form new embodiments.
[0049] In the description of the present application, it should be noted that directional words, such as the terms "center", "lateral", "longitudinal", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", etc., indicating directions and positional relationships are based on the directions or positional relationships shown in the accompanying drawings, and are only for the convenience of narrating the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and cannot be understood as limiting the specific scope of protection of the present application.
[0050] It should be noted that the terms "first", "second", etc. in the description and claims of the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.
[0051] The terms "including" and "having" and any variations thereof in the specification and claims of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or apparatus comprising a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products or apparatuses.
[0052] One aspect of the present application provides a multi-position material positioning and grasping system, such as Figure 1 As shown, one preferred embodiment includes a base 10, a conveyor belt 30, a control system 20, a visual recognition module 40, a material picking system, a displacement device 80 and a feeding system. The base 10 is fixedly arranged, and a grabbing station and a feeding station are arranged at intervals on the base 10. The conveyor belt 30 is installed on the base 10 and the conveyor belt 30 can extend to the grabbing station. The conveyor belt 30 is used to transport random posture materials 01. The visual recognition module 40 is installed on the base 10 and is located near the grabbing station. The visual recognition module 40 can visually recognize the material 01 located at the grabbing station to obtain image data of the material 01. The control system 20 is installed on the base 10, and the control system 20 can be respectively communicated with the visual recognition module 40, the conveyor belt 30, the material picking system, the displacement device 80 and the feeding system. The control system 20 can receive data sent by the visual recognition module 40; the material picking system is located on one side of the grabbing station, and multiple material picking fixtures are installed on the material picking system, each of which is used to grab materials 01 of different types and / or different postures. The positioner 80 is installed on the base 10 and is located between the material picking system and the feeding system. The positioner 80 can perform intermediate position shifting for grabbing the material 01. The feeding system is installed on the base 10 and is located at the feeding station of the base 10. The feeding system is used to grab the material 01 located at the positioner 80 or the material picking system.
[0053] When transferring material 01, material 01 with random posture will be transported to the grabbing station, and then transferred to the feeding station. The specific transfer process is as follows: First, the conveyor belt 30 can transport material 01 with random posture to the grabbing station; then, the visual recognition module 40 can visually recognize material 01 located at the grabbing station, and send the recognized data to the control system 20. The control system 20 can recognize the shape and position posture of material 01 according to the received data, and calculate the grabbing logic trajectory of material 01 to send it to the material picking system, the displacement device 80 and the feeding system. Finally, the material picking system can select the corresponding material picking fixture according to the control signal sent by the control system 20, and grab material 01 along the generated grabbing logic trajectory; the grabbed material 01 can be transferred to the displacement device 80 or the material picking system by the material picking system according to its own posture. The feeding system can directly receive the material 01 transferred by the material picking system, or grab the material 01 that has undergone position change at the displacement device 80. Compared with traditional methods, the present application uses visual recognition to determine the shape and position of material 01 in advance, thereby generating the fastest grabbing logic for transferring material 01. This can improve the transfer efficiency of material 01 to solve the problem of automated loading and unloading when the processing cycle is fast, the product appearance is complex, and the product needs to be changed.
[0054] It can be understood that the purpose of this application is to grab the disordered material 01 delivered to the grabbing station and transfer it to the feeding station in an orderly manner. That is, the material 01 can be delivered to the grabbing station by the conveyor belt 30 in a variety of disordered postures, and then the shape and posture of the material 01 are recognized by visual recognition to generate a grabbing logic trajectory corresponding to the current posture of the material 01 and grab and transfer the material 01 at a speed close to the fastest speed, thereby improving the transfer efficiency of the material 01. For ease of understanding, the position and posture of the material 01 will be described in detail below through the specific structure of one of the materials 01.
[0055] Specifically, Figure 3 As shown in the figure, no matter what kind of material 01, its position and posture can be mainly divided into two types: lying posture and vertical posture. For material 01 in lying posture, such as Figure 3 As shown in (1) to (3), it can be regarded that the two opposite ends of the material 01 to be grasped are horizontally distributed, and the material grabbing fixture needs to grasp one end of the material 01 along the horizontal direction. For the material 01 in a vertical position, as shown in Figure 3 As shown in (4) and (5), the material 01 can be regarded as being pulled to two opposite ends to be vertically distributed, and the material grabbing fixture needs to grab the upper end of the material 01 along the vertical direction.
[0056] The ends of material 01 for being grasped can be set to end a and end b respectively; since the feeding system transfers material 01 in an orderly manner, the grasping position of material 01 by the feeding system can be set to end b. Based on the lying posture and vertical posture of material 01, there are many specific postures when it is conveyed to the grasping station. The grasping logic of material 01 in the lying posture and vertical posture will be described in detail below.
[0057] 1. For materials in a lying position 01.
[0058] like Figure 3 As shown in (1) to (3), assuming that the initial position of the material picking fixture when grabbing material 01 is located on the left side of material 01, then based on the specific situation of the material 01 and the initial position of the material picking fixture, the position posture of material 01 can specifically include posture one, posture two and posture three.
[0059] For posture 1, Figure 3 Neutral (1) and Figure 8 As shown, the a end of material 01 is close to the material picking fixture, that is, at this time, the angle α between the line connecting the a end and the b end of material 01 and the current grabbing direction of the material picking fixture is less than 90°. If the value of the angle α is 0, it means that the material picking fixture is facing the a end of material 01 at this time, then the material picking fixture can directly approach and grab the a end of material 01, and then directly transfer it to the feeding system, so that the feeding system can clamp the b end of material 01 to complete the orderly transfer of material 01. If the value of the angle α is greater than 0, the material picking fixture can be rotated by an angle of α to face the a end of material 01 in the grabbing direction, and then the material picking fixture can approach and grab the a end of material 01 to directly transfer it to the feeding system, so that the feeding system can clamp the b end of material 01 to complete the orderly transfer of material 01.
[0060] For posture 2, Figure 3 As shown in (2), the distances from the a and b ends of material 01 to the pick-up fixture are the same, that is, the value of the angle α is 90°. In theory, the time required for the pick-up fixture to grab the a and b ends of material 01 is the same, but considering the subsequent transfer process, the pick-up fixture can be rotated 90° to face the a end of material 01, and then approach the a end of material 01 and grab it to transfer it to the feeding system, so that the feeding system can clamp the b end of material 01 to complete the orderly transfer of material 01.
[0061] For posture three, Figure 3 Neutral (3) and Fig. 9As shown, the b end of material 01 is close to the material picking fixture, that is, at this time, the angle α between the line connecting the a end and the b end of material 01 and the current grabbing direction of the material picking fixture is greater than 90°. If the value of the angle α is 180°, it means that the material picking fixture is facing the b end of material 01 at this time, then the material picking fixture can directly approach and grab the b end of material 01, and then directly transfer it to the position of the displacement device 80 for position change, and finally the feeding system can clamp the b end of material 01 located at the displacement device 80 to complete the orderly transfer of material 01. If the value of the angle α is less than 180°, the material picking fixture can rotate by an angle of 180°-α to the grabbing direction facing the b end of material 01, and then the material picking fixture can approach and grab the b end of material 01 to transfer it to the displacement device 80, so that the feeding system can clamp the b end of material 01 located at the displacement device 80 to complete the orderly transfer of material 01.
[0062] It can be understood that the value of the angle α is 0~180°; for the above-mentioned posture three, if the material picking fixture directly grabs the a end of the material 01, and then directly transfers it to the material picking system. Then the angle that the material picking fixture rotates when grabbing the material 01 is α, and the angle α is greater than 90°; compared with the present embodiment that grabs the b end of the material 01, the material picking fixture needs to rotate an angle of 2α-180° more. Similarly, when the material picking fixture transfers the material 01 grabbed at the a end to the feeding system, the material picking fixture also needs to rotate more angles to ensure that the b end of the material 01 can face the feeding system. Therefore, the method of this embodiment can effectively shorten the grabbing time of the material picking fixture for the material 01 to improve the transfer efficiency.
[0063] 2. For materials in vertical position 01.
[0064] like Figure 3 As shown in (4) and (5), based on the different upper ends of the material 01 when the material 01 is transported to the grabbing station, the vertical postures of the material 01 can include posture four with the a end facing upward and posture five with the b end facing upward.
[0065] For posture 4, Figure 3 As shown in (4), the material picking fixture can directly grab the end a of the material 01 downward, and then directly transfer it to the feeding system, so that the feeding system clamps the end b of the material 01 to complete the orderly transfer of the material 01.
[0066] For posture five, Figure 3 As shown in (5), the material picking fixture can directly grab the b end of the material 01 downward, and then transfer it to the position shifting device 80 for position change. Finally, the feeding system can clamp the b end of the material 01 located at the position of the position shifting device 80 to complete the orderly transfer of the material 01.
[0067] In this embodiment, Figure 1 As shown, the specific structures and working principles of the control system 20, the conveyor belt 30 and the visual recognition module 40 are well known to those skilled in the art, so they will not be elaborated in detail here. The installation position of the visual recognition module 40 can be located on one side of the conveyor belt 30 or on the top of the conveyor belt 30; in order to ensure the recognition accuracy of the visual recognition module 40, the installation position of the visual recognition module 40 in this embodiment is preferably set directly above the grabbing station. When the conveyor belt 30 conveys the material 01, the visual recognition module 40 can be used to visually recognize the material 01, and then the control system 20 controls the stopping position of the material 01 according to the data of the visual recognition module 40 to ensure that the conveyed material 01 can stop at the grabbing station. Of course, for the determination of the parking position of the material 01, a sensor that communicates with the control system 20, such as a laser sensor, can also be set on the side of the conveyor belt 30 located at the grabbing station; when the material 01 is conveyed to the grabbing station by the conveyor belt 30, the sensor is triggered, and then the control system 20 can control the conveyor belt 30 to stop according to the trigger signal of the sensor. Of course, the parking position of the material 01 can also be determined by combining the visual recognition module 40 and the sensor.
[0068] In this embodiment, Figure 1 and Figure 2 As shown, the material picking system includes a material picking robot 50 and a plurality of material picking fixtures. The material picking robot 50 is fixedly mounted on the base 10, and the plurality of material picking fixtures are divided into at least one group, and the plurality of material picking fixtures can be arranged axially at intervals along the fixed bracket 501 at the terminal of the material picking robot 50. The number of material picking fixtures in each group is at least one, and the plurality of material picking fixtures in each group can be arranged at equal intervals in the circumferential direction along the fixed bracket 501 at the terminal of the material picking robot 50.
[0069] It should be known that the specific structure and working principle of the material picking robot 50 are well-known technologies to those skilled in the art, so they will not be elaborated in detail here. The material picking robot 50 can drive the material picking fixture installed on the terminal to move and rotate in multiple directions in space. Since the material 01 has various shapes, it can be regular or irregular; it can be block-shaped or columnar. In addition, the grasping structure corresponding to the material 01 of the same shape but different posture is also different. Therefore, for materials 01 of different shapes and postures, it is necessary to set material picking fixtures of different structures to carry out the corresponding grasping; then the specific number of the material picking fixtures can be specifically selected according to the type of material 01 to be transferred and the possible transfer posture.
[0070] At the same time, the arrangement of the multiple material picking fixtures in the aforementioned content can also be expressed as multiple material picking fixtures are divided into at least one group, and the multiple groups of material picking fixtures can be arranged at intervals in the circumferential direction along the fixed bracket 501 at the terminal of the material picking robot 50; the number of material picking fixtures in each group is at least one, and the multiple material picking fixtures in each group can be arranged at intervals in the axial direction along the fixed bracket 501 at the terminal of the material picking robot 50. It should be noted that when arranging the axial intervals of multiple material picking fixtures, the multiple material picking fixtures can be arranged in sequence from low to high or from high to low in height to avoid working interference between two adjacent material picking fixtures.
[0071] In this embodiment, there are many specific structures of the material picking fixture that can achieve the above functions. For the sake of easy understanding, the following will be described in detail using one of the structures. Figure 2 As shown, the material picking fixture includes a rotating device, a driving cylinder and at least two clamping claws. The rotating device is fixedly mounted on a fixed bracket 501 at the terminal of the material picking robot 50, and the driving cylinder is mounted on the output end of the rotating device. The driving cylinder can rotate around the output axis of the rotating device under the drive of the rotating device. The clamping claws are mounted on the output end of the driving cylinder. The clamping claws can move closer or farther away from each other under the drive of the driving cylinder, thereby grabbing and releasing the material 01. Different material picking fixtures have different clamping claw structures, thereby grabbing materials 01 of different shapes.
[0072] It should be known that the specific structure and working principle of the rotating device and the driving cylinder are well-known technologies for those skilled in the art, so they will not be elaborated in detail here. Common rotating devices include servo motors and stepper motors, etc.; common driving cylinders include hydraulic cylinders and pneumatic cylinders, etc.; the driving method of the driving cylinder to the clamp is well-known technology for those skilled in the art, so it will not be elaborated in detail here; of course, electric clamps can also be used to replace the driving coordination of the driving cylinder and the clamp. The specific number of clamps can be selected according to the actual needs of those skilled in the art.
[0073] It can be understood from the above content that for grabbing material 01 in different postures, especially in postures 1 and 3, if the material grabbing fixture is not provided with a rotating device, the material grabbing robot 50 needs to first drive the material grabbing fixture to rotate the corresponding angle, and then translate to the end close to the material 01 to achieve grabbing. After the rotating device is provided, the material grabbing robot 50 drives the material grabbing fixture to move directly from the initial position to the end to be grabbed of the material 01 in a straight line. In the process of the material grabbing robot 50 driving the material grabbing fixture to move, the rotating device can drive the clamp to rotate the corresponding diagonal angle, so that when the material grabbing fixture moves to the end of the material 01, the clamp is in a state facing the end to be grabbed of the material 01. Thereby further shortening the time required for the material grabbing robot 50 to move and improving the grabbing efficiency of the material 01.
[0074] For the convenience of understanding, the following will use a tubular material 01 as shown in Figure 3 to describe in detail the specific structure and working process of the material taking fixture.
[0075] Specifically, as shown in Figure 2 and Figures 4 to 7 For two position postures of the material 01, there can be two material taking fixtures for clamping the material 01, namely the first material taking fixture 71 and the second material taking fixture 72. The first material taking fixture 71 includes a first rotating device 711, a first driving cylinder 713 and a pair of first clamping jaws 714; the first driving cylinder 713 is fixedly installed on a first bracket 712 at the output end of the first rotating device 711, and a pair of first clamping jaws 714 are symmetrically installed at the output end of the first driving cylinder 713. The second material taking fixture 72 includes a second rotating device 721, a second driving cylinder 723 and a pair of second clamping jaws 724; the second driving cylinder 723 is fixedly installed on a second bracket 722 at the output end of the second rotating device 721, and a pair of second clamping jaws 724 are symmetrically installed at the output end of the second driving cylinder 723.
[0076] Among them, the first material taking fixture 71 is used to grab the material 01 in the vertical posture, and the second material taking fixture 72 is used to grab the material 01 in the lying posture. Since both the first material taking fixture 71 and the second material taking fixture 72 grab the material 01 in an overall vertical state, the first clamping jaw 714 can be a straight structure or an L-shaped structure, as long as it is ensured that the first clamping jaw 714 can vertically extend to the upper end of the material 01 for grabbing. The second clamping jaw 724 is an L-shaped structure or a U-shaped structure to ensure that the second clamping jaw 724 needs to have a horizontal section to grab the end of the material 01.
[0077] As shown in Figure 3 in (4) and Figure 4 When the material 01 is conveyed to the grabbing station in the form of posture four, the material taking robot 50 can drive the terminal to drive the fixed bracket 501 to move according to the control signal of the control system 20, so that the first material taking fixture 71 is located directly above the material 01. Then the material taking robot 50 can drive the first material taking fixture 71 to move vertically downward until the a end of the material 01 is located in the clamping area between the first clamping jaws 714. Then the first clamping jaws 714 can approach each other under the drive of the first driving cylinder 713 to clamp the a end of the material 01. Finally, the first material taking fixture 71 can carry the clamped material 01 and be transferred to the position of the feeding system under the movement of the material taking robot 50, so that the feeding system grabs the b end of the material 01 to complete the orderly transfer of the material 01.
[0078] As shown in Figure 3 in (5) and Figure 5As shown, when the material 01 is transported to the grabbing station in the form of posture five, the material grabbing robot 50 can drive the terminal to drive the fixed bracket 501 to move according to the control signal of the control system 20, so that the first material grabbing fixture 71 is located directly above the material 01. Then the material grabbing robot 50 can drive the first material grabbing fixture 71 to move vertically downward until the b end of the material 01 is located in the clamping area between the first clamping jaws 714. Then the first clamping jaws 714 can move closer to each other under the drive of the first driving cylinder 713 to clamp the b end of the material 01. Then the first material grabbing fixture 71 can carry the clamped material 01 and transfer it to the position of the displacement device 80 under the movement of the material grabbing robot 50 to change the position of the material 01. Finally, the feeding system can clamp the b end of the material 01 from the position of the displacement device 80 to complete the orderly transfer of the material 01.
[0079] It should be known that, for a tubular material 01 , the first clamping jaw 714 can also extend into the inner cavity of the material 01 to clamp the material 01 in a tensioned manner.
[0080] like Figure 3 Middle (1) Figure 6 as well as Figure 8 As shown, when the material 01 is transported to the grabbing station in the form of posture 1, the material grabbing robot 50 can drive the terminal to drive the fixed bracket 501 to move according to the control signal of the control system 20, so that the second material grabbing fixture 72 is located on one side of the material 01. Then the material grabbing robot 50 can drive the second material grabbing fixture 72 to move along the generated straight track c toward the a end of the material 01, and at the same time, the second clamping jaw 724 can be driven by the second rotating device 721 to rotate by an angle α, so that when the second material grabbing fixture 72 is located at the end of the straight track c, the extension direction of the second clamping jaw 724 is directly opposite to the a end of the material 01. Then, the second material grabbing fixture 72 can be driven by the material grabbing robot 50 to move along the extension direction of the second clamping jaw 724 until the second clamping jaw 724 extends to the inner cavity of the a end of the material 01, and then the second clamping jaw 724 is driven by the second driving cylinder 723 to expand to tighten the inner cavity of the material 01 to clamp the material 01. Finally, the second material picking fixture 72 can carry the clamped material 01 and transfer it to the feeding system position under the movement of the material picking robot 50, so that the feeding system grabs the b end of the material 01 to complete the orderly transfer of the material 01.
[0081] like Figure 3 (2) and Figure 8As shown, when the material 01 is transported to the grabbing station in the form of posture 2, the material grabbing robot 50 can drive the terminal to drive the fixed bracket 501 to move according to the control signal of the control system 20, so that the second material grabbing fixture 72 is located on one side of the material 01. Then the material grabbing robot 50 can drive the second material grabbing fixture 72 along the generated straight track c ( Figure 8 The second material picking fixture 72 can be driven by the second rotating device 721 to rotate 90° to the a end of the material 01, and the second clamping jaw 724 can be driven by the second rotating device 721 to rotate 90°, so that when the second material picking fixture 72 is located at the end of the straight track c, the extension direction of the second clamping jaw 724 is directly opposite to the a end of the material 01. Then, the second material picking fixture 72 can be driven by the material picking robot 50 to move along the extension direction of the second clamping jaw 724 until the second clamping jaw 724 extends to the inner cavity of the a end of the material 01, and then the second clamping jaw 724 is driven by the second driving cylinder 723 to expand to tighten the inner cavity of the material 01 to clamp the material 01. Finally, the second material picking fixture 72 can carry the clamped material 01 and transfer it to the feeding system position under the movement of the material picking robot 50, so that the feeding system grabs the b end of the material 01 to complete the orderly transfer of the material 01.
[0082] like Figure 3 Middle (3) Figure 7 as well as Fig. 9 As shown, when the material 01 is transported to the grabbing station in the form of posture three, the material grabbing robot 50 can drive the terminal to drive the fixed bracket 501 to move according to the control signal of the control system 20, so that the second material grabbing fixture 72 is located on one side of the material 01. Then the material grabbing robot 50 can drive the second material grabbing fixture 72 along the generated straight track c ( Fig. 9 The second material picking fixture 72 can be driven by the second rotating device 721 to rotate 180°-α angle to make the second material picking fixture 72 at the end of the straight track c, and the extension direction of the second clamp 724 is directly opposite to the b end of the material 01. Then, the second material picking fixture 72 can be driven by the material picking robot 50 to move along the extension direction of the second clamp 724 until the second clamp 724 extends to the inner cavity of the b end of the material 01, and then the second clamp 724 is driven by the second driving cylinder 723 to expand to tighten the inner cavity of the material 01 to clamp the material 01. Then, the second material picking fixture 72 can carry the clamped material 01 and transfer it to the position of the displacement device 80 under the movement of the material picking robot 50 to change the position of the material 01. Finally, the feeding system can clamp the b end of the material 01 from the position of the displacement device 80 to complete the orderly transfer of the material 01.
[0083] It should be known that, when the outer structure of the material 01 is regular, the second clamping jaw 724 can grasp the material 01 by clamping the outer side of the end of the material 01.
[0084] It can be understood that the position shifting device 80 changes the position of the material 01 in the following manner: when the b end of the material 01 is clamped by the material taking fixture, the position shifting device 80 can clamp the a end of the material 01, so that after the material taking fixture releases the material 01, the b end of the material 01 will be exposed, and the feeding system can clamp the b end of the material 01 to orderly transfer the material 01. There are many specific structures of the position shifting device 80 based on the above functions. For the sake of easy understanding, one of the structures will be described in detail below.
[0085] In this embodiment, Fig.10 and Fig.11 As shown, the displacement device 80 includes a third rotating device 801, a third driving cylinder 804 and at least two third clamps 805. The third rotating device 801 is fixedly mounted on the base 10, the third driving cylinder 804 is mounted on the third bracket 803 at the output end of the third rotating device 801, and the third clamp 805 is mounted on the output end of the third driving cylinder 804. When the material 01 is moved to the clamping area of the third clamp 805 under the transfer of the material taking system, the third clamp 805 can clamp the end a of the material 01 under the drive of the third driving cylinder 804, so that the end b of the material 01 is exposed for the subsequent grasping of the feeding system.
[0086] It should be known that the specific structure and working principle of the third rotating device 801 and the third driving cylinder 804 are well-known technologies for those skilled in the art, so they will not be elaborated in detail here. The common third rotating device 801 includes a servo motor, a stepper motor, a reduction motor, etc.; if the third rotating device 801 adopts a servo motor or a stepper motor, in order to reduce the output speed of the third rotating device 801, a reduction device 802 can be installed at the output end of the third rotating device 801, and then a third bracket 803 is installed at the output end of the reduction device 802 for the installation of the third driving cylinder 804. The common third driving cylinder 804 includes a hydraulic cylinder and a pneumatic cylinder, etc.; the driving method of the third driving cylinder 804 to the third clamping jaw 805 is well-known technologies for those skilled in the art, so they will not be elaborated in detail here; of course, electric clamping jaws can also be used to replace the driving cooperation between the third driving cylinder 804 and the third clamping jaw 805. The specific number of the third clamping jaws 805 can be selected according to the actual needs of those skilled in the art. The third clamping jaw 805 grabs the material 01 by clamping the outer side of the end of the material 01 or by tensioning the inner wall of the material 01 .
[0087] It is understandable that the third rotating device 801 is provided to meet the requirements of the transfer position of the material 01. Since the external structure of some materials 01 may have position requirements when being transferred, when the material 01 is transferred to the position of the position shifting device 80, the position shifting device 80 can adjust the external structure position of the material 01 under the drive of the third rotating device 801 to ensure that the external structure position of the material 01 after being grabbed by the feeding system can directly meet the transfer requirements to further improve the transfer efficiency.
[0088] In this embodiment, Figure 1 and Fig.11 As shown, the feeding system includes a feeding robot 60 and a feeding fixture 90 installed at the terminal of the feeding robot 60. The feeding fixture 90 includes a fourth driving cylinder 902 and at least two fourth clamping claws 903; the fourth driving cylinder 902 is fixedly installed at the terminal of the feeding robot 60 through a fourth bracket 901, and the fourth clamping claw 903 is installed at the output end of the fourth driving cylinder 902. When grabbing the material 01, the feeding fixture 90 can be driven by the feeding robot 60 to dock with the material grabbing fixture or the displacement device 80 to clamp the b end of the material 01, thereby facilitating the orderly transfer of the material 01.
[0089] It should be known that the specific structure and working principle of the fourth drive cylinder 902 are well-known technologies for those skilled in the art, so they will not be elaborated in detail here. Common fourth drive cylinders 902 include hydraulic cylinders and pneumatic cylinders, etc.; the driving mode of the fourth drive cylinder 902 to the fourth clamp 903 is well-known technologies for those skilled in the art, so they will not be elaborated in detail here; of course, electric clamps can also be used to replace the driving coordination of the fourth drive cylinder 902 and the fourth clamp 903. The specific number of fourth clamps 903 can be selected according to the actual needs of those skilled in the art. The fourth clamp 903 can grasp the material 01 by clamping the outer side of the end of the material 01, or by tensioning the inner wall of the material 01.
[0090] It should also be known that the feeding clamp 90 can grasp the material 01 vertically or horizontally. If the feeding clamp 90 needs to grasp the material 01 horizontally, the structure of the fourth clamp 903 is the same as that of the second clamp 724; accordingly, the displacement device 80 will also be set horizontally. If the feeding clamp 90 needs to grasp the material 01 vertically, the structure of the fourth clamp 903 is the same as that of the first clamp 714; accordingly, the displacement device 80 will also be set vertically.
[0091] Another aspect of the present application provides a multi-posture material positioning and grasping method based on visual recognition, which can be implemented by the multi-posture material positioning and grasping system mentioned above; Fig.12As shown, one of the preferred embodiments includes the following steps:
[0092] S100: The material 01 to be transferred is transported to a designated location to trigger visual recognition.
[0093] S200: Identify the shape and position of material 01 based on visual recognition.
[0094] S300: Select a corresponding material picking fixture according to the shape and position of material 01.
[0095] S400: Determine the working conditions of the material picking fixture according to the position and posture of material 01 and perform the grabbing.
[0096] S500: For the material 01 that meets the preset posture working condition, the material picking fixture directly transfers the material 01 to the feeding fixture 90.
[0097] S600: For the material 01 that does not conform to the preset posture condition, the material picking fixture transfers the material 01 to the position shifting device 80 for position change; the feeding fixture 90 can move to the position shifting device 80 to grab the material 01 that conforms to the preset posture after the change.
[0098] It should be known that, from the above content, there are many postures of material 01, such as lying posture and vertical posture, and each position posture also includes a variety of specific posture forms. The traditional transfer method for multi-position material 01 is to select one of the postures as a template, such as posture one or posture four can be used as a template, and the remaining postures are abandoned, which will cause part of the material 01 to be unable to be grasped, thereby affecting the overall transfer efficiency of material 01. In this embodiment, a variety of different material grabbing fixtures are set, and the posture of material 01 is obtained based on visual recognition to select the corresponding material grabbing fixture to achieve that all postures of material 01 can be grasped. And in the process of grasping material 01, a displacement device 80 can be set for the situation that the grasping path may be long, so that the material grabbing system can use a shorter path to grasp the material 01 and then send it to the displacement device 80 for displacement, and then let the feeding fixture 90 grasp the material 01 from the displacement device 80, which can effectively shorten the transfer time of material 01 to improve the transfer efficiency.
[0099] It should also be known that the software of the control system 20 needs to set up a variety of materials 01 and templates of various postures corresponding to each material 01 in advance. Therefore, when the material 01 is conveyed to the grabbing station by the conveyor belt 30, the visual recognition module 40 can identify the shape and position posture of the material 01 and then feedback to the control system 20; the control system 20 can compare the data fed back by the visual recognition module 40 with the pre-set data to screen out the corresponding template. Then the control system 20 can control the corresponding material grabbing fixture to grab the material 01 according to the screened template. After the material 01 is grabbed, the control system 20 can decide whether to directly drive the material grabbing fixture to dock with the feeding fixture 90 or place the material 01 at the position of the displacement device 80 according to the placement working condition configured by the template number. If it is placed in the displacement device 80, the displacement device 80 can change the posture according to the parameters configured by the template number, and after the posture is changed, call the feeding robot 60 to drive the feeding fixture 90 to grab the material 01. For ease of understanding, the specific working process of this embodiment will be described in detail below.
[0100] During the transportation stage of the material 01 , the conveyor belt 30 can separate the stacked materials 01 one by one and transport them to a designated location, namely, a grabbing station; the transportation stop position of the material 01 can be achieved by a sensor and / or a visual recognition module 40 .
[0101] When material 01 arrives at the grabbing station, the visual recognition module 40 will be triggered and take a photo of material 01, and then send the photo data to the control system 20 to determine the shape and position of material 01. The recognition of the shape and position of material 01 includes the following process:
[0102] S210: Collect the original image I of material 01, and pre-process the original image I by using the Gaussian filtering method to obtain a denoised image Ismooth; Ismooth=G0*I.
[0103] S220: Grayscale the image Ismooth to obtain a grayscale image Igray; Igray = 0.299R + 0.587G + 0.114B. Grayscale the image can reduce the image processing time and reduce the complexity of image processing.
[0104] S230: using an adaptive histogram equalization method to enhance the contrast of a specific area in the grayscale image Igray, thereby improving the visibility of the image and reducing the impact of illumination changes on the image.
[0105] S240: Detect the edge of material 01 using the Sobel operator on the enhanced image to obtain the contour of the current position of material 01.
[0106] S250: Matching the acquired contour of material 01 with a preset part template to acquire the shape of material 01, and identifying the position and posture of material 01 in combination with the current contour position of material 01.
[0107] Among them, G0 represents the Gaussian kernel, and R, G, and B represent the intensities of the red, green, and blue color channels, respectively.
[0108] In step S250, the matching degree between the outline of material 01 and the preset part template can be represented by the matching degree NC; when the matching degree NC exceeds the set threshold, it means that material 01 matches a valid template; if the matching degrees of multiple templates exceed the set threshold, the template with the highest matching degree is selected. The calculation formula of the matching degree NC is as follows:
[0109] NC(x,y)=∑[(I0(x+i,y+i)-μI0)(T(i,j)- μT)] / [∑ (I0(x+i,y+i)-μI0) 2 ∑(T(i, j)- μT) 2 ].
[0110] Among them, I0 represents the contour image of material 01; T represents the template image; μI0 and μT represent the mean of the contour image of material 01 and the template image respectively; (x, y) represents the current position of the template in the contour image of material 01; i, j represent the relative position inside the template.
[0111] When the visual recognition module 40 reports that the recognition of this material 01 is unsuccessful, this material 01 is abandoned and waits again for the next material 01 to arrive at the grabbing station. When the visual recognition module 40 reports that the recognition of this material 01 is successful, the control system 20 will control the material picking robot 50 to drive the material picking fixture to move to the grabbing position of material 01 to grab material 01. Since material 01 may have multiple postures, the fixtures used for different postures may be different. Therefore, it is necessary to configure the material picking fixture for grabbing each template and the placement strategy of the material picking system after completing the grabbing of material 01 in advance in the user interface. For ease of understanding, the specific grabbing process of material 01 will be briefly described below.
[0112] It should be known that the position posture of material 01 includes a lying posture and a vertical posture; for material 01 in a lying posture, the material picking clamp is suitable for clamping material 01 from the side of material 01 along the horizontal direction; for material 01 in a vertical posture, the material picking clamp is suitable for clamping material 01 from the top of material 01 along the vertical direction.
[0113] The material 01 includes an end a and an end b that are opposite to each other, and the feeding clamp 90 clamps the end b of the material 01 .
[0114] The grasping condition judgment for the material 01 in a lying posture includes the following process: calculating the angle α between the line connecting the end a and the end b of the material 01 and the grasping direction of the material picking clamp; if the angle α is 90°, the material picking clamp rotates 90° to face the end a and clamps it, and at this time the grasped material 01 is in compliance with the preset posture condition; if the angle α is not 90°, the feeding angle is rotated at a rotation angle less than 90° to face one end of the material 01 and clamp it; when the clamped end of the material 01 is the end a, the grasped material 01 is in compliance with the preset posture condition; when the clamped end of the material 01 is the end b, the grasped material 01 is not in compliance with the preset posture condition.
[0115] The judgment of the grasping condition of the material 01 in the vertical posture includes the following process: the material picking clamp directly clamps the upper end of the material 01 in the vertical posture downward; if the upper end of the material 01 is end a, the grasped material 01 is in a state that meets the preset posture condition; if the upper end of the material 01 is end b, the grasped material 01 is in a state that does not meet the preset posture condition.
[0116] It is understandable that, in order to facilitate the description of the subsequent content, the working condition that meets the preset posture can be defined as working condition one, and the working condition that does not meet the preset posture can be defined as working condition two. Figure 3 Taking the material 01 shown as an example, it can be seen from the above content that postures 1, 2 and 4 of material 01 meet working condition 1, and postures 3 and 5 of material 01 meet working condition 2.
[0117] Thus, after the material taking system completes the grabbing of the material 01 at the grabbing station, the control system 20 can control the conveyor belt 30 to continue feeding while comparing the template number and configuration parameters of the currently grabbed material 01. When the grabbed material 01 meets the working condition 1, the material taking system is controlled to directly hand over the material 01 to the feeding system, that is, the feeding system grabs the material 01 clamped by the material taking system through the feeding fixture 90 under the drive of the feeding robot 60. When the grabbed material 01 meets the working condition 2, the material 01 needs to be placed in the position shifting device 80, and the position shifting device 80 changes the corresponding position and angle according to the set parameters, so that the materials 01 in different postures are all transformed to the same preset posture after passing through the position shifting device 80. After the position shifting device 80 is transformed, the feeding robot 60 can drive the feeding fixture 90 to take away the material 01 located at the position shifting device 80 to complete the orderly transfer.
[0118] The above describes the basic principles, main features and advantages of the present application. Those skilled in the art should understand that the present application is not limited by the above embodiments, and the above embodiments and the specification only describe the principles of the present application. The present application may have various changes and improvements without departing from the spirit and scope of the present application, and these changes and improvements fall within the scope of the present application for which protection is sought. The scope of protection claimed by the present application is defined by the attached claims and their equivalents.
Claims
1. A multi-pose material positioning and grasping method based on visual recognition, characterized in that: The steps include: S100: transporting the material to be transferred to a designated location to trigger visual recognition; S200: Identify the shape and position of the material based on visual recognition; S300: Selecting a corresponding material picking fixture according to the shape and position of the material; S400: determining the working condition of the material grabbing fixture according to the position and posture of the material and performing the grabbing; S500: For materials that meet the preset posture conditions, the material picking fixture directly transfers the materials to the feeding fixture; S600: For materials that do not meet the preset posture working conditions, the material picking fixture transfers the materials to the position changing device for position change; the feeding fixture is suitable for moving to the position changing device to grab the materials that meet the preset posture after the change; The position and posture of the material include lying posture and vertical posture; For materials lying flat, the material taking fixture is suitable for clamping the materials horizontally from the side of the materials; For materials in a vertical position, the material taking fixture is suitable for clamping the materials in a vertical direction from the top of the materials; The material includes opposite ends a and b, and the feeding clamp clamps the end b of the material; The grasping condition judgment for materials in a flat position includes the following process: Calculate the angle α between the line connecting the ends a and b of the material and the grabbing direction of the material grabbing fixture; If the angle α is 90°, the material picking fixture rotates 90° to face the end a and clamps it. At this time, the material being grabbed is in a preset posture condition; If the angle α is not 90°, the feeding angle is rotated at an angle less than 90° to the end facing the material and clamped; When the end of the material being clamped is end a, the material being grasped is in a state that meets the preset posture; When the end of the material being clamped is end b, the material being grasped is in a state that does not conform to the preset posture; The grasping condition judgment for vertical materials includes the following process: The material taking fixture directly moves downward to clamp the upper end of the vertical material; If the upper end of the material is end a, the material being grabbed is in a state that meets the preset posture; If the upper end of the material is end b, the material being grasped is in a state that does not conform to the preset posture.
2. The multi-posture material positioning and grasping method based on visual recognition as claimed in claim 1, characterized in that: Step S200 includes the following process: S210: Collect the original image I of the material, and pre-process the original image I by Gaussian filtering method to obtain a denoised image Ismooth; Ismooth=G0*I; S220: grayscale the image Ismooth to obtain a grayscale image Igray; Igray=0.299R+0.587G+0.114B; S230: enhancing the contrast of a specific area in the grayscale image Igray by using an adaptive histogram equalization method; S240: Detect the edge of the material using the Sobel operator on the enhanced image to obtain the contour of the current position of the material; S250: Matching the acquired material contour with a pre-set part template to acquire the shape of the material, and identifying the position and posture of the material in combination with the current contour position of the material; Among them, G0 represents the Gaussian kernel, and R, G, and B represent the intensities of the red, green, and blue color channels, respectively.
3. The multi-posture material positioning and grasping method based on visual recognition as claimed in claim 2 is characterized in that: In step S250, the matching degree between the material profile and the preset part template is represented by the matching degree NC; When the matching degree NC exceeds the set threshold, it means that the material matches a valid template; if the matching degrees of multiple templates exceed the set threshold, the template with the highest matching degree is selected; the calculation formula of the matching degree NC is as follows: NC(x,y)= ∑[(I0(x+i,y+i)- μI0)(T(i,j)- μT)] / [∑ (I0(x+i,y+i)- μI0) 2 ∑(T(i,j)- μT) 2 ]; Among them, I0 represents the material contour image; T represents the template image; μI0 and μT represent the means of the material contour image and the template image respectively; (x, y) represents the current position of the template in the material contour image; i, j represent the relative position inside the template.
4. A multi-posture material positioning and grasping system, used to implement the multi-posture material positioning and grasping method based on visual recognition according to any one of claims 1 to 3, characterized in that: It includes a base and: Conveyor belt; the conveyor belt is used to transport the material to be transferred to the grabbing station of the base; A visual recognition module; the visual recognition module is located near the grabbing station and is used to visually recognize the material at the grabbing station; Control system; the control system is adapted to receive data from the visual recognition module to identify the shape and position of the material, and calculate the grabbing logic trajectory of the material; A material taking system; the material taking system is located at one side of the grabbing station, and is equipped with a plurality of material taking fixtures; the material taking system is adapted to receive a control signal from the control system to select a corresponding material taking fixture, and to grab and transfer the material to a position shifting device or a material taking system along a generated grabbing logic trajectory; Position changing device; the position changing device is suitable for receiving the material transferred by the material taking system to change the position; as well as Feeding system; The feeding system is located at the feeding station of the base, and the feeding system is suitable for receiving materials transferred by the material taking system, or grabbing materials located at the position changing device.
5. The multi-position material positioning and grasping system according to claim 4, characterized in that: The material picking system comprises: a material picking robot and a plurality of material picking fixtures; The material picking robot is fixedly mounted on the base, and the plurality of material picking fixtures are divided into at least one group, and the plurality of groups of material picking fixtures are suitable for being axially spaced and arranged along the terminal end of the material picking robot; The number of the material picking clamps in each group is at least one, and the multiple material picking clamps in each group are arranged at equal intervals in the circumferential direction along the terminal end of the material picking robot.
6. The multi-position material positioning and grasping system according to claim 5, characterized in that: The material taking fixture comprises: Rotating device; the rotating device is fixedly installed on the terminal of the material picking robot; A drive cylinder; the drive cylinder is mounted at the output end of the rotating device, and the drive cylinder is adapted to rotate around the output axis of the rotating device under the drive of the rotating device; and At least two clamping jaws; the clamping jaws are installed at the output end of the driving cylinder, and the clamping jaws are suitable for moving closer to or away from each other under the drive of the driving cylinder, thereby grasping and releasing the material; The clamping jaw structures of different material picking clamps are different, so as to grab materials of different shapes.
7. The multi-position material positioning and grasping system according to claim 4, characterized in that: The displacement device comprises a third rotating device, a third driving cylinder and at least two third clamps; the third rotating device is fixedly installed, the third driving cylinder is installed at the output end of the third rotating device, and the third clamps are installed at the output end of the third driving cylinder; The feeding system includes a feeding robot and a feeding fixture installed at the terminal of the feeding robot; the feeding fixture includes a fourth driving cylinder and at least two fourth clamps, the fourth driving cylinder is installed at the terminal of the feeding robot, and the fourth clamps are installed at the output end of the fourth driving cylinder.
Citation Information
Patent Citations
Vision-based industrial robot system
CN112008696A
Vision-based oil tank inner cover identification and pose parameter sensing method
CN114359597A
Contour matching method and device, electronic equipment and storage medium
CN117115485A
Workpiece placing and positioning system and robot
CN117863166A
Cylinder cap tongs device of manipulator
CN208358375U
