A non-contact automatic string tomato picking robot and picking method
Through the contactless tomato automatic picking robot, the depth camera and seven-link imitation hand mechanism are used to achieve efficient and low-damage picking of tomato skewers in complex environments, solving the problems of contact damage and identification in traditional picking methods. Improved picking efficiency and automation.
Patent Information
- Application Number
- CN202210853147.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-07
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2042-07-07
AI Technical Summary
In the prior art, tomato picking robots mainly use contact method, which leads to problems such as blessing damage and fruit drop. In addition, traditional shear end effectors have difficulties in identifying and cutting tomato strings, and cannot effectively deal with complex unstructured environments and Diversity of tomato growth shapes.
Using a contactless tomato automatic picking robot, the tomato string information is recognized in real time through the depth camera, the cutting point position is derived, and the contactless fruit stems are cut and picked using a multi-joint robot arm and a seven-link imitation hand mechanism. Fruits are inserted from bottom to top to reduce damage to the plant.
It realizes efficient and low-damage tomato picking, reduces the labor intensity and production costs of picking workers, improves the picking efficiency and automation, and reduces the fruit injury rate.
Smart Images

Figure CN115194742B_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of agricultural fruit and vegetable automatic picking robots, and in particular relates to a non-contact automatic string tomato picking manipulator and a picking method. Background Art
[0002] Fruit and vegetable picking is a labor-intensive job and is the most time-consuming and labor-intensive link in the entire production chain. Existing fruit and vegetable picking operations are mainly completed manually, which has problems such as low picking efficiency, high cost, and high labor intensity. In recent years, due to the serious shortage of human resources caused by the aging population, the cost of manual picking operations accounts for a high proportion of the total production cost. Therefore, realizing the automation of picking operations has become an urgent need and a key technical bottleneck for the deepening development of agriculture.
[0003] The growth environment of tomatoes is relatively complex, and they are in a highly unstructured and uncertain unknown environment. Due to the random and diverse natural growth state of crops, the spatial layout of crop branches (vines), true leaves, brackets, etc. and fruits and vegetables is complex, and their shapes are also complex and diverse. When picking, the picking robot should have a high degree of adaptability to the picking objects, have less disturbance and destructiveness to the surrounding environment and fruit objects, and be able to better cope with the fragility of the picking objects and the differences in individual shapes.
[0004] Vines and plants can grow in clusters within the structure, maximizing the yield of agricultural products in a small area. In the tomato production process, picking is one of the most time-consuming and labor-intensive parts of the tomato production process. The main reasons are: 1. Tomatoes need to be picked in clusters to ensure their appearance quality; 2. Tomatoes produce a large number of clusters and fruits. Each plant can produce many clusters throughout the year, and each cluster usually has multiple tomato fruits. This results in a large amount of picking work for workers, high greenhouse temperatures, difficult working conditions, and high labor intensity, which affects the quality of picking.
[0005] Traditional robot picking methods are mainly based on contact. The end effector contacts the surface of tomatoes through gripping and adsorption, causing a series of problems such as gripping damage and fruit falling.
[0006] The traditional shearing end effector is just a shearing mechanism, similar to a scissors structure, which acts directly on the fruit stem. In actual production, there are great problems in directly finding the fruit stem by vision. Since tomatoes have various fruit stem characteristics such as vines, long stems, and short stems, there will be confusion in fruit stem identification, and it is impossible to determine the reasonable shearing position. In addition, due to gravity factors, the tomato bunch will fall down after being cut, causing damage to the fruit bunch. Summary of the invention
[0007] In view of the above technical problems, the purpose of the present invention is to provide a non-contact automatic picking robot and picking method for tomatoes on a string, which can identify the information of the tomato string in real time through a camera, deduce the appropriate cutting point position above the tomato string through the information of the whole string of fruits, and obtain the position and posture information of the actuator at the cutting point, control the movement of the multi-joint robot arm, and move the picking robot to the designated picking position. The actuator of the picking robot is aligned with the center of the fruit at the lowest point below the tomato string, moves from bottom to top and inserts the fruit. When it reaches the fruit stem cutting position, it drives the seven-link humanoid hand mechanism to cut the fruit stem, then clamps the tomato string, and controls the robot arm to put the tomato string into the designated collection basket to complete the picking task. The opening size of the actuator is strictly designed according to the size of the tomato string space in the actual production environment. There is no need to adjust the size, and it can meet the performance of inserting the tomato string. Moreover, when performing the picking operation, the actuator will well remove the stems and tomato strings next to the tomato string, greatly reducing the damage to the tomato plant.
[0008] The present invention is suitable for picking fruits that grow in bunches and are compactly arranged. It causes little damage to the fruits during picking and has high picking efficiency. It automatically completes the fruit collection process and has high fruit picking efficiency and stability. The present invention has a simple and compact structure, a high degree of automation, high picking efficiency, a low fruit damage rate, and wide adaptability, and can effectively reduce the labor intensity and production costs of pickers.
[0009] In order to achieve the above object, the present invention provides the following technical solutions:
[0010] A contactless automatic string tomato picking robot arm is used for automatic string tomato picking, comprising a robot arm 2, a bracket 3, an actuator 4 and a depth camera 5.
[0011] The bracket 3 is fixedly connected to the end of the robotic arm 2 ; the depth camera 5 and the actuator 4 are fixedly connected to the upper and lower parts of the bracket 3 , respectively; and a collecting basket 1 is provided near the robotic arm 2 .
[0012] The actuator 4 includes a housing 410 , a cylinder 409 and a seven-link human hand mechanism; the seven-link human hand mechanism includes a left shearing knife 401 , a right shearing knife 402 , a left lever 403 , a right lever 404 , a left connecting rod 405 , a right connecting rod 406 and a joint 407 .
[0013] The shell 410 is fixed to the bracket 3 by bolts; a lever connecting portion 410-1 is provided at the front end of the shell 410; a cylinder mounting groove 410-2 is provided at the rear of the shell 410, and the cylinder 409 is fixed in the cylinder mounting groove 410-2, and the piston rod 408 of the cylinder 409 can freely extend and retract in the front space of the shell 410; long grooves 410-3 are provided on the left and right sides of the front of the shell 410 for the left connecting rod 405 and the right connecting rod 406 to move forward and backward respectively.
[0014] The joint 407 is fixedly connected to the end of the piston rod 408 of the cylinder 409 through threads and locking nuts; the rear ends of the left connecting rod 405 and the right connecting rod 406 are respectively hinged to the left and right sides of the joint 407; the left connecting rod 405 and the right connecting rod 406 respectively pass through the long grooves 410-3 on the left and right sides of the front part of the shell 410, and can slide back and forth in the long grooves 410-3 as the piston rod 408 is extended and retracted; the front end of the left connecting rod 405 is connected to the left lever The rear end of the rod 403 is hinged, and the front end of the right connecting rod 406 is hinged to the rear end of the right lever 404; the front end of the left lever 403 is hinged to the rear end of the left shearing knife 401, and the front end of the right lever 404 is hinged to the rear end of the right shearing knife 402; the front end of the left shearing knife 401 and the front end of the right shearing knife 402 are hinged to each other; the middle parts of the left lever 403 and the right lever 404 are respectively hinged to the left and right sides of the lever connecting part 410-1.
[0015] When the piston rod 408 of the cylinder 409 is in a retracted state, the lever connecting portion 410 - 1 , the front portions of the left lever 403 and the right lever 404 , and the left shearing knife 401 and the right shearing knife 402 together form a picking ring that allows the fruit bunch 6 to pass through.
[0016] When the piston rod 408 of the air cylinder 409 is in an extended state, the left shearing knife 401 and the right shearing knife 402 are closed together to cut off and clamp the fruit stems 7 of the fruit bunch 6.
[0017] The depth camera 5 obtains the position data of the tomatoes on the bunch, and the controller identifies the posture of the tomatoes on the bunch according to the position data of the tomatoes on the bunch, determines the cutting position and fits the motion trajectory of the actuator 4; operates the seven-link human-like hand mechanism to form a picking ring that allows the fruit bunch 6 to pass through, and controls the actuator 4 to move according to the motion trajectory to reach the cutting position on the fruit stalk 7 above the fruit bunch; operates the seven-link human-like hand mechanism to close to cut off and clamp the fruit stalk 7 of the fruit bunch 6; operates the robotic arm 2 to move the actuator 4 to the top of the collection basket 1, and operates the seven-link human-like hand mechanism to unfold to place the fruit bunch 6 in the collection basket 1.
[0018] The left shearing knife 401 includes a shearing blade 401-1 and a left clamping portion 401-2 arranged in parallel up and down; the right shearing knife 402 includes a blade groove 402-1 corresponding to the shearing blade 401-1 and a right clamping portion 402-2 corresponding to the left clamping portion 401-2;
[0019] The rear part of the shear blade 401-1 is hinged to the rear part of the left clamping part 401-2 through a pin 401-4; the shear blade 401-1 is provided with at least one fixing bolt 401-1-1 perpendicular to the blade plane along its axis passing through the pin 401-4; the left clamping part 401-2 is provided with a movable groove 401-2-1 corresponding to the fixing bolt 401-1-1, and the movable groove 401-2-1 is an arc shape with the pin 401-4 as the center; the reset spring 401-3 and the fixing bolt 401-1-1 of the shear blade 401-1 are connected to the shear blade 401-1. It is located in the movable groove 401-2-1 of the left clamping part 401-2; and the return spring 401-3 is located between the end of the movable groove 401-2-1 close to the clamping working surface and the fixing bolt 401-1-1, so that the left clamping part 401-2 can make a small rotation relative to the shearing blade 401-1 with the pin shaft 401-4 as the center, and can be reset under the action of the return spring 401-3, so that when the left shearing knife 401 and the right shearing knife 402 are closed together to shear the fruit stem 7, the shearing blade 401-1 can completely enter the knife groove 402-1 to avoid incomplete shearing.
[0020] The left clamping portion 401 - 2 and the right clamping portion 402 - 2 are tooth-shaped structures that mesh with each other.
[0021] The left clamping part 401 - 2 and the right clamping part 402 - 2 are made of stainless steel.
[0022] A non-contact automatic tomato picking method using the non-contact automatic tomato picking manipulator comprises the following steps:
[0023] S1, Tomato posture recognition;
[0024] Recognize the posture of the bunch of tomatoes according to the position data of the fruit bunch 6 obtained by the depth camera 5;
[0025] S2, determining the cutting position according to the posture of the tomatoes on the string and fitting the motion trajectory of the actuator 4;
[0026] According to the posture of the tomato bunch, the motion nodes a, b, c, d and e of the fruit bunch 6 are located, and the motion trajectory of the actuator 4 is fitted according to the motion nodes a, b, c, d and e;
[0027] The motion node a is the midpoint of the line connecting the mass centers of the two tomato fruits with the lowest height in the identified fruit bunch 6; the motion node b is the midpoint of the line connecting the mass centers of the two tomato fruits with the highest height in the identified fruit bunch 6; the motion node c is located below the motion node a, and is the starting target point for the actuator 4 to insert into the fruit bunch 6 when performing the picking operation; the motion node d is located above the motion node b, and is the ending target point for the actuator 4 to insert into the fruit bunch 6 when performing the picking operation; the motion node e is the point where the horizontal plane where the motion node d is located intersects with the spatial line of the fruit fitting of the fruit bunch 6, and is the blade cutting point for the actuator 4 to shear the fruit stem 7 on the fruit bunch 6;
[0028] S3, harvesting of bunch tomatoes;
[0029] Operate the seven-link human-like hand mechanism to form a picking ring that allows the fruit bunch 6 to pass through, and move to the starting target point below the fruit bunch 6; control the actuator 4 to move along the motion trajectory to reach the upper position of the fruit bunch 6; control the actuator 4 to move to the blade cutting point: move backward a certain distance and rotate a certain angle so that the fruit stalk 7 is vertically located in the shearing plane of the left shear knife 401 and the right shear knife 402; operate the left shear knife 401 and the right shear knife 402 to close together to cut off and clamp the fruit stalk 7 of the fruit bunch 6; operate the robotic arm 2 to move the actuator 4 to the top of the collection basket 1, and operate the seven-link human-like hand mechanism to unfold and place the fruit bunch 6 in the collection basket 1.
[0030] The step S1 adopts a posture detection method based on YOLOv4 deep learning to determine the corresponding position relationship between the tomato fruit bunch and the fruit stalk joint point, and realizes the identification and positioning of the fruit bunch 6 by identifying the connectivity relationship between the tomato fruit bunch and the fruit stalk joint point.
[0031] Compared with the prior art, the present invention has the following beneficial effects:
[0032] 1. The invention integrates picking and collecting, effectively reduces the picking action and saves a lot of working time in the fruit picking process.
[0033] 2. Based on the linkage control of the six-degree-of-freedom robotic arm, the seven-link human-like hand mechanism and the shear knife, no device touches the tomatoes during the entire process, achieving zero contact, no damage and no bruises.
[0034] 3. Compared with the traditional method of finding the cutting point of the stem, this method does not directly find the stem on the fruit bunch, but obtains the outline of the tomato bunch and determines the cutting point of the stem based on the length of most tomato bunches.
[0035] 4. The blade of the shearing device is long enough and the shearing efficiency is high.
[0036] 5. The invention has a simple and compact structure, a high degree of automation, high fruit picking efficiency, a low fruit damage rate, and wide adaptability, which effectively reduces the labor intensity and production costs of picking workers. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 It is a structural schematic diagram of the non-contact automatic tomato picking robot of the present invention;
[0038] Figure 2 It is a structural schematic diagram of the actuator 4 of the present invention;
[0039] Figure 3 It is a schematic structural diagram of the left shearing knife 401 and the right shearing knife 402 of the present invention;
[0040] Figure 4 It is a schematic diagram of the bottom structure of the left shearing knife 401 of the present invention;
[0041] Figure 5 A schematic diagram of the movement nodes of the fruit bunch 6 positioned according to the present invention;
[0042] Figure 6 to Figure 10 It is a schematic diagram of the picking process of the contactless automatic picking robot for tomatoes on a string of the present invention.
[0043] The accompanying drawings are denoted as follows:
[0044] 1. Collection basket 2. Robotic arm
[0045] 3. Bracket 4. Actuator
[0046] 401, left shear knife 401-1, shear blade
[0047] 401-1-1, fixing bolt 401-2, left clamping part
[0048] 401-2-1, movable groove 401-3, return spring
[0049] 401-4, pin 402, right shear knife
[0050] 402-1, knife groove 402-2, right clamping part
[0051] 403, left lever 404, right lever
[0052] 405, left connecting rod 406, right connecting rod
[0053] 407, joint 408, piston rod
[0054] 409, cylinder 410, shell
[0055] 410-1, lever connection part 410-2, cylinder mounting groove
[0056] 410-3, Long slot 5, Depth camera
[0057] 6. Fruit bunch 7. Fruit stem DETAILED DESCRIPTION
[0058] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.
[0059] like Figure 1 As shown, a non-contact automatic picking robot for tomatoes on a string is used for automatic picking of tomatoes on a string, and includes a robot arm 2, a bracket 3, an actuator 4 and a depth camera 5. The tomatoes on a string include a fruit string 6 and a fruit stalk 7.
[0060] The bracket 3 is fixedly connected to the end of the robotic arm 2 ; the depth camera 5 and the actuator 4 are fixedly connected to the upper and lower parts of the bracket 3 , respectively; and a collecting basket 1 is provided near the robotic arm 2 .
[0061] like Figure 2 As shown, the actuator 4 includes a housing 410, a cylinder 409 and a seven-link human hand mechanism; the seven-link human hand mechanism includes a left shearing knife 401, a right shearing knife 402, a left lever 403, a right lever 404, a left connecting rod 405, a right connecting rod 406 and a joint 407.
[0062] The shell 410 is fixed to the bracket 3 by bolts; a lever connecting portion 410-1 is provided at the front end of the shell 410; a cylinder mounting groove 410-2 is provided at the rear of the shell 410, and the cylinder 409 is fixed in the cylinder mounting groove 410-2, and the piston rod 408 of the cylinder 409 can freely extend and retract in the front space of the shell 410; long grooves 410-3 are provided on the left and right sides of the front of the shell 410 for the left connecting rod 405 and the right connecting rod 406 to move forward and backward respectively.
[0063] The joint 407 is fixedly connected to the end of the piston rod 408 of the cylinder 409 through threads and locking nuts; the rear ends of the left connecting rod 405 and the right connecting rod 406 are respectively hinged to the left and right sides of the joint 407; the left connecting rod 405 and the right connecting rod 406 respectively pass through the long grooves 410-3 on the left and right sides of the front part of the shell 410, and can slide back and forth in the long grooves 410-3 as the piston rod 408 is extended and retracted; the front end of the left connecting rod 405 is connected to the left lever The rear end of the rod 403 is hinged, and the front end of the right connecting rod 406 is hinged to the rear end of the right lever 404; the front end of the left lever 403 is hinged to the rear end of the left shearing knife 401, and the front end of the right lever 404 is hinged to the rear end of the right shearing knife 402; the front end of the left shearing knife 401 and the front end of the right shearing knife 402 are hinged to each other; the middle parts of the left lever 403 and the right lever 404 are respectively hinged to the left and right sides of the lever connecting part 410-1.
[0064] When the piston rod 408 of the cylinder 409 is in a retracted state, the lever connecting portion 410 - 1 , the front portions of the left lever 403 and the right lever 404 , and the left shearing knife 401 and the right shearing knife 402 together form a picking ring that allows the fruit bunch 6 to pass through.
[0065] When the piston rod 408 of the air cylinder 409 is in an extended state, the left shearing knife 401 and the right shearing knife 402 are closed together to cut off and clamp the fruit stems 7 of the fruit bunch 6.
[0066] like Figure 3 As shown, the left shearing knife 401 includes a shearing blade 401-1 and a left clamping portion 401-2 arranged in parallel up and down; the right shearing knife 402 includes a knife groove 402-1 corresponding to the shearing blade 401-1 and a right clamping portion 402-2 corresponding to the left clamping portion 401-2.
[0067] like Figure 4 As shown, the rear part of the shear blade 401-1 is hinged with the rear part of the left clamping part 401-2 through a pin shaft 401-4; the shear blade 401-1 is provided with at least one fixing bolt 401-1-1 perpendicular to the blade plane along its axis passing through the pin shaft 401-4; the left clamping part 401-2 is provided with a movable groove 401-2-1 corresponding to the fixing bolt 401-1-1, and the movable groove 401-2-1 is an arc shape with the pin shaft 401-4 as the center; The reset spring 401-3 and the fixing bolt 401-1-1 of the shear blade 401-1 are located in the movable groove 401-2-1 of the left clamping part 401-2; and the reset spring 401-3 is located between the end of the movable groove 401-2-1 close to the clamping working surface and the fixing bolt 401-1-1, so that the left clamping part 401-2 can rotate slightly relative to the shear blade 401-1 with the pin 401-4 as the center of the circle, and can be reset under the action of the reset spring 401-3. This arrangement can ensure that when the left shear blade 401 and the right shear blade 402 are closed together to shear the fruit stem 7, the shear blade 401-1 can completely enter the knife groove 402-1 to avoid incomplete shearing.
[0068] Preferably, the left clamping portion 401 - 2 and the right clamping portion 402 - 2 are tooth-like structures that mesh with each other, and the material is preferably stainless steel, which has the characteristics of high hardness, sharpness, and corrosion resistance.
[0069] The depth camera 5 obtains the position data of the tomatoes on the bunch, and the controller identifies the posture of the tomatoes on the bunch according to the position data of the tomatoes on the bunch, determines the cutting position and fits the motion trajectory of the actuator 4; operates the seven-link human-like hand mechanism to form a picking ring that allows the fruit bunch 6 to pass through, and controls the actuator 4 to move according to the motion trajectory to reach the cutting position on the fruit stalk 7 above the fruit bunch; operates the seven-link human-like hand mechanism to close to cut off and clamp the fruit stalk 7 of the fruit bunch 6; operates the robotic arm 2 to move the actuator 4 to the top of the collection basket 1, and operates the seven-link human-like hand mechanism to unfold to place the fruit bunch 6 in the collection basket 1.
[0070] A non-contact automatic tomato picking method based on the non-contact automatic tomato picking manipulator of the present invention comprises the following steps:
[0071] S1, Tomato posture recognition;
[0072] Recognize the posture of the bunch of tomatoes according to the position data of the fruit bunch 6 obtained by the depth camera 5;
[0073] This embodiment uses an existing fruit bunch 6 posture detection method based on YOLOv4 deep learning to determine the corresponding position relationship between the tomato fruit bunch and the fruit stalk joint point, and realizes the recognition and positioning of the fruit bunch 6 by identifying the connectivity relationship between the tomato fruit bunch and the fruit stalk joint point.
[0074] S2, determining the cutting position according to the posture of the tomatoes on the string and fitting the motion trajectory of the actuator 4;
[0075] According to the posture of the tomato bunch, the motion nodes a, b, c, d and e of the fruit bunch 6 are located, and the motion trajectory of the actuator 4 is fitted according to the motion nodes a, b, c, d and e;
[0076] like Figure 5 As shown, motion node a is the midpoint of the line connecting the mass centers of the two tomato fruits with the lowest height in the identified fruit bunch 6; motion node b is the midpoint of the line connecting the mass centers of the two tomato fruits with the highest height in the identified fruit bunch 6; motion node c is located below motion node a, and is the starting target point for the actuator 4 to insert into the fruit bunch 6 when performing the picking operation; motion node d is located above motion node b, and is the ending target point for the actuator 4 to insert into the fruit bunch 6 when performing the picking operation; motion node e is the point where the horizontal plane where motion node d is located intersects with the spatial line of the fruit fitting of the fruit bunch 6, and is the blade cutting point for the actuator 4 to shear the fruit stalk 7 on the fruit bunch 6.
[0077] S3, harvesting of bunch tomatoes;
[0078] Operate the seven-link human-like hand mechanism to form a picking ring that allows the fruit bunch 6 to pass through, and move to the starting target point below the fruit bunch 6, such as Figure 6Control actuator 4 moves according to the motion trajectory to reach the upper position of the fruit string 6, such as Figure 7 Control the actuator 4 to move to the blade cutting point: move back a certain distance and rotate a certain angle, so that the fruit stem 7 is vertically located in the shear plane of the left shear knife 401 and the right shear knife 402, such as Figure 8 Operation left shear knife 401 and right shear knife 402 close to each other to cut off and clamp the fruit stalk 7 of the fruit bunch 6, such as Fig. 9 and Fig.10 As shown; operate the robotic arm 2 to move the actuator 4 to the top of the collection basket 1, and operate the seven-link human hand mechanism to unfold and place the fruit bunch 6 in the collection basket 1.
Claims
1. A non-contact automatic string tomato picking robot for automatic string tomato picking, characterized in that: It includes a robotic arm (2), a bracket (3), an actuator (4) and a depth camera (5); The bracket (3) is fixedly connected to the end of the mechanical arm (2); the depth camera (5) and the actuator (4) are respectively fixedly connected to the upper part and the lower part of the bracket (3); a collection basket (1) is provided near the mechanical arm (2); The actuator (4) comprises a housing (410), a cylinder (409) and a seven-link human hand-simulating mechanism; the seven-link human hand-simulating mechanism comprises a left shearing knife (401), a right shearing knife (402), a left lever (403), a right lever (404), a left connecting rod (405), a right connecting rod (406) and a joint (407); The housing (410) is fixedly connected to the bracket (3) by bolts; a lever connecting portion (410-1) is provided at the front end of the housing (410); a cylinder mounting groove (410-2) is provided at the rear of the housing (410), the cylinder (409) is fixedly connected in the cylinder mounting groove (410-2), and the piston rod (408) of the cylinder (409) can freely extend and retract in the front space of the housing (410); long grooves (410-3) are provided on the left and right sides of the front of the housing (410) for the left connecting rod (405) and the right connecting rod (406) to move forward and backward respectively; The joint (407) is fixedly connected to the end of the piston rod (408) of the cylinder (409) through threads and a locking nut; the rear ends of the left connecting rod (405) and the right connecting rod (406) are respectively hinged to the left and right sides of the joint (407); the left connecting rod (405) and the right connecting rod (406) respectively pass through the long slots (410-3) on the left and right sides of the front part of the housing (410) and can slide forward and backward in the long slots (410-3) as the piston rod (408) is extended and retracted; the front end of the left connecting rod (405) is connected to the left The rear end of the lever (403) is hinged, and the front end of the right connecting rod (406) is hinged to the rear end of the right lever (404); the front end of the left lever (403) is hinged to the rear end of the left shearing knife (401), and the front end of the right lever (404) is hinged to the rear end of the right shearing knife (402); the front end of the left shearing knife (401) and the front end of the right shearing knife (402) are hinged to each other; the middle parts of the left lever (403) and the right lever (404) are respectively hinged to the left and right sides of the lever connecting part (410-1); When the piston rod (408) of the cylinder (409) is in a retracted state, the lever connecting portion (410-1), the front portions of the left lever (403) and the right lever (404), and the left shearing knife (401) and the right shearing knife (402) together form a picking ring that allows the fruit bunch (6) to pass through; When the piston rod (408) of the cylinder (409) is in an extended state, the left shearing knife (401) and the right shearing knife (402) are closed together to cut off and clamp the fruit stems (7) of the fruit bunch (6); The depth camera (5) acquires position data of the bunch of tomatoes, and the controller identifies the posture of the bunch of tomatoes based on the position data of the bunch of tomatoes, determines the cutting position and fits the motion trajectory of the actuator (4); operates the seven-link humanoid hand mechanism to form a picking ring that allows the fruit bunch (6) to pass through, and controls the actuator (4) to move according to the motion trajectory to reach the cutting position on the fruit stem (7) above the fruit bunch; operates the seven-link humanoid hand mechanism to close to cut off and clamp the fruit stem (7) of the fruit bunch (6); operates the mechanical arm (2) to move the actuator (4) to the top of the collection basket (1), and operates the seven-link humanoid hand mechanism to unfold to place the fruit bunch (6) in the collection basket (1); The left shearing knife (401) comprises a shearing blade (401-1) and a left clamping portion (401-2) arranged in parallel up and down; the right shearing knife (402) comprises a knife groove (402-1) corresponding to the shearing blade (401-1) and a right clamping portion (402-2) corresponding to the left clamping portion (401-2); The rear part of the shear blade (401-1) is hinged to the rear part of the left clamping part (401-2) via a pin shaft (401-4); the shear blade (401-1) is provided with at least one fixing bolt (401-1-1) perpendicular to the blade plane along its axis passing through the pin shaft (401-4); the left clamping part (401-2) is provided with movable grooves (401-2-1) corresponding to the fixing bolts (401-1-1) one by one, and the movable grooves (401-2-1) are in the shape of an arc with the pin shaft (401-4) as the center; the reset spring (401-3) and the fixing bolt (401-1-1) of the shear blade (401-1) are located at the rear of the shear blade (401-1). The left clamping portion (401-2) is in a movable groove (401-2-1) of the left clamping portion (401-2); and the reset spring (401-3) is located between one end of the movable groove (401-2-1) close to the clamping working surface and the fixing bolt (401-1-1), so that the left clamping portion (401-2) can rotate slightly relative to the shearing blade (401-1) with the pin shaft (401-4) as the center of the circle, and can be reset under the action of the reset spring (401-3), so that when the left shearing blade (401) and the right shearing blade (402) are closed together to shear the fruit stem (7), the shearing blade (401-1) can completely enter the knife groove (402-1), thereby avoiding incomplete shearing; The left clamping portion (401-2) and the right clamping portion (402-2) are tooth-shaped structures that mesh with each other; The left clamping part (401-2) and the right clamping part (402-2) are made of stainless steel.
2. A non-contact automatic tomato picking method using the non-contact automatic tomato picking manipulator according to claim 1, characterized in that: The steps include: S1, Tomato posture recognition; Recognize the posture of the bunch of tomatoes based on the position data of the fruit bunch (6) obtained by the depth camera (5); S2, determining the cutting position according to the posture of the tomatoes on the bunch and fitting the motion trajectory of the actuator (4); Locate the motion nodes a, b, c, d and e of the tomato bunch (6) according to the posture of the tomato bunch, and fit the motion trajectory of the actuator (4) according to the motion nodes a, b, c, d and e; The motion node a is the midpoint of the line connecting the mass centers of the two tomato fruits with the lowest height in the identified fruit bunch (6); the motion node b is the midpoint of the line connecting the mass centers of the two tomato fruits with the highest height in the identified fruit bunch (6); the motion node c is located below the motion node a and is the starting target point for the actuator (4) to insert into the fruit bunch (6) when performing a picking operation; the motion node d is located above the motion node b and is the ending target point for the actuator (4) to insert into the fruit bunch (6) when performing a picking operation; the motion node e is the point where the horizontal plane where the motion node d is located intersects with the spatial line fitted by the fruit of the fruit bunch (6), and is the blade cutting point for the actuator (4) to shear the fruit stem (7) on the fruit bunch (6); S3, harvesting bunch tomatoes; The seven-link humanoid hand mechanism is operated to form a picking ring that allows the fruit bunch (6) to pass through, and is moved to a starting target point below the fruit bunch (6); the actuator (4) is controlled to move along a motion trajectory to reach a position above the fruit bunch (6); the actuator (4) is controlled to move to a blade cutting point: it is moved backwards by a certain distance and rotated by a certain angle so that the fruit stem (7) is vertically located within the shearing plane of the left shearing knife (401) and the right shearing knife (402); the left shearing knife (401) and the right shearing knife (402) are operated to close together to cut off and clamp the fruit stem (7) of the fruit bunch (6); the mechanical arm (2) is operated to move the actuator (4) to the top of the collection basket (1), and the seven-link humanoid hand mechanism is operated to unfold to place the fruit bunch (6) in the collection basket (1); The step S1 adopts a posture detection method based on YOLOv4 deep learning to determine the corresponding position relationship between the tomato fruit bunch and the fruit stalk joint point, and realizes the identification and positioning of the fruit bunch (6) by identifying the connectivity relationship between the tomato fruit bunch and the fruit stalk joint point.
Citation Information
Patent Citations
Automated harvester effector
CN110536598A
Harvesting robot
JP2021036821A
End effector
JP2021093968A
Automated harvester effector
US20200008355A1
Crop harvesting method, crop harvesting device, and crop harvesting system
WO2021215218A1
