Pitching extraction type tomato stringing picking, shearing and clamping integrated end effector
Through the pitch-to-pull-type tomato picking and clip-in integrated end effector combined with deep learning and RGB-D vision sensor, the problems of fruit damage and low efficiency in tomato picking are solved, and efficient tomato picking operations are achieved, which improves the recognition success and operational flexibility of the robotic arm.
Patent Information
- Application Number
- CN202411242459.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-05
- Publication Date
- 2024-11-12
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The prior art has problems such as easy damage to fruits and low picking efficiency during tomato picking, especially because 3D vision algorithms have unstable recognition of fruit stems and great environmental impact, resulting in inaccurate operation of the robotic arm.
Using YOLO v8 object detection based on deep learning combined with RGB-D color images and depth maps, the integrated end effector of tomato picking and clipping is achieved by using the visual module, guide rail module, torsion spring module and clipping module. There is no need to determine the position of the tomato graft, and the fingers are driven by the cylinder to cut with the blade.
It improves the success rate and efficiency of tomato picking, avoids technical difficulties in identifying the angle and position of the fruit stem, enhances the operation flexibility and low visual accuracy of the robotic arm, and adapts to the tomato size with high redundancy.
Smart Images

Figure CN118923346A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of agriculture, and in particular to a pitching and sleeve-type tomato picking, shearing and clamping integrated end effector. Background Art
[0002] Currently, tomato collection and picking still relies on a large amount of manual picking. During manual picking, the fruit is easy to fall to the ground and be damaged. This method not only requires a lot of manpower but is also very inefficient. The existing picking robot is equipped with a fruit collection device, and a pipe is installed under the mechanical arm. After the tomatoes are picked, they slide down the pipe. When they fall under the collection device, the tomatoes will be damaged. Or after the picking robot grabs the tomatoes, the mechanical arm is controlled to continue to put the tomatoes into the collection device below. The tomatoes are damaged when they fall, which is inefficient.
[0003] The existing technical solution also uses a 3D vision algorithm to identify the stalks of tomatoes on a string, and performs 3D reconstruction of the growth direction of the stalks, so that the motor of the end effector performs corresponding pitch movements. The tomatoes on a string are identified through 3D vision, and the end effector is driven to perform simple shearing. However, the above solution also has defects. For example, the recognition of the stalks through the 3D vision algorithm is not stable enough, and the 3D reconstruction is prone to failure or errors. It is greatly affected by the environment such as light. The present invention is based on deep learning, and the improved YOLO v8 performs tomato target detection, obtains tomato information based on the fusion of RGB-D color images and depth maps, and adopts a tomato shearing method, which does not require the judgment of the position of the tomato stalks. Summary of the invention
[0004] In view of the defects in the prior art, the object of the present invention is to provide a pitch-and-sleeve type tomato picking, shearing and clamping integrated end effector.
[0005] According to the present invention, a pitch-and-sleeve type tomato picking shear-and-clamp integrated end effector comprises a vision module, a guide rail module, a flange frame, a torsion spring module and a shear-and-clamp module, wherein:
[0006] The vision module is installed on the flange frame;
[0007] The guide rail module is sleeved on the outer side of the characteristic shaft of the flange frame and is connected to the characteristic shaft through a bearing;
[0008] The torsion spring module acts on the guide rail module so that the guide rail module remains horizontal when no force is applied;
[0009] The shearing and clamping module is arranged on the guide rail module to clamp and shear the target object.
[0010] Preferably, the vision module includes a vision camera.
[0011] Preferably, the guide rail module comprises a guide rail upper cover and a guide rail lower cover, wherein:
[0012] The guide rail upper cover and the guide rail lower cover are threadedly connected.
[0013] Preferably, the shearing and clamping module comprises a finger member, a cylinder, a blade, a fruit stem guide member and a fruit stem clamping member, wherein:
[0014] The finger member forms a moving pair between the guide rail upper cover and the guide rail lower cover;
[0015] The fruit stem guide is installed on the guide rail cover;
[0016] The blade and the fruit stem clamping member are clamped between the guide rail upper cover and the fruit stem guide member;
[0017] The air cylinder can drive the finger member to move.
[0018] Preferably, the cylinder body of the cylinder is mounted on the guide rail upper cover; the gas rod of the cylinder is connected to the finger member.
[0019] Preferably, a hollow area is provided at the front end of the finger member, and the cylinder can control the size of the hollow area.
[0020] Preferably, the torsion spring module comprises a torsion spring and a torsion spring center fixing member, wherein:
[0021] The torsion spring center fixing piece is connected to the guide rail module by threads;
[0022] The large diameter of the torsion spring is inserted into the center fixing piece of the torsion spring.
[0023] Preferably, it also includes a pitch torsion spring follower, which is connected to the guide rail lower cover by threads; the long arm of the torsion spring is inserted into the torsion spring hole of the pitch torsion spring follower.
[0024] Preferably, it also includes a torsion spring short arm fixing piece, and the torsion spring short arm fixing piece is connected to the guide rail lower cover by threads; the torsion spring short arm is inserted into the gap formed by the guide rail lower cover and the torsion spring short arm fixing piece.
[0025] Preferably, it also includes a shaft elastic retaining ring, which constrains the axial direction of the guide rail lower cover and the bearing.
[0026] Compared with the prior art, the present invention has the following beneficial effects:
[0027] 1. The present invention uses a picking robot to pick the tomatoes, and does not need to judge the angle and position of the fruit stem. The robot arm only needs to obtain the overall information of the tomatoes, extend the end effector to the bottom of the bunch of tomatoes, and complete the clipping of the bunch of tomatoes by picking them up. This avoids the technical difficulties caused by identifying the fruit stems;
[0028] 2. The present invention greatly improves the success rate of fruit identification and picking by picking with a picking robot. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:
[0030] Figure 1 This is a schematic diagram of the structure of the pitch-and-slide type tomato picking shear-clamp integrated end effector.
[0031] Figure 2 This is a top view of the pitch-and-slide tomato picking shear-clamp integrated end effector.
[0032] Figure 3-5 This is a schematic diagram of the picking process of the pitch-and-slide tomato picking shear-and-clamp integrated end effector.
[0033] In the figure:
[0034] Finger piece 1
[0035] Guide rail cover 2
[0036] Cylinder 3
[0037] Side mounted flange frame 4
[0038] Vision Camera 5
[0039] Blade 6
[0040] Fruit stem guide 7
[0041] Fruit stem holder 8
[0042] Pitch torsion spring follower 9
[0043] Guide rail bottom cover 10
[0044] Bearing 11
[0045] Torsion spring 12
[0046] Torsion spring center fixing 13
[0047] Torsion spring short arm fixing 14 DETAILED DESCRIPTION
[0048] The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several changes and improvements can also be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.
[0049] The existing technology uses algorithms to identify stems, which is technically difficult, takes a long time to identify and reconstruct, and the characteristics of fruit stems are relatively more difficult to correctly identify than fruits. The sleeve-type end effector for identifying fruits lacks the corresponding angle, which makes shearing easy to fail. This patent uses RGB-D visual sensors to obtain tomato growth information and tomato positions in real time, and uses deep learning to obtain tomato information - filtering and denoising background information, reducing the interference and influence of background information on subsequent maturity judgments, and comprehensively judging fruit characteristic information. On this basis, the picking robot gloves are used to pick up the fruit, and there is no need to judge the angle and position of the fruit stem. The robotic arm only needs to obtain the overall information of the tomato, extend the end effector to the bottom of the bunch of tomatoes, and complete the shearing of the bunch of tomatoes by sleeve-picking. It has the characteristics of flexible movement, low requirements for visual accuracy, and high redundancy in tomato size.
[0050] like Figure 1 and Figure 2 As shown, a pitch-and-sleeve type tomato picking, shearing and clamping integrated end effector provided by the present invention includes a side-mounted flange frame 4, a guide rail lower cover 10, a guide rail upper cover 2, a finger part 1, a cylinder 3, a visual camera 5, a blade 6, a fruit stalk guide part 7, a fruit stalk clamping part 8, a pitch torsion spring follower 9, a bearing 11, a torsion spring 12, a torsion spring center fixing part 13, and a torsion spring short arm fixing part 14.
[0051] The bearing 11 and the guide rail lower cover 10 are transitionally matched, and then the bearing 11 and the guide rail lower cover 10 are inserted into the characteristic shaft of the side-mounted flange frame, and the shaft elastic retaining ring is used to constrain the axial direction of the guide rail lower cover 10 and the bearing 11; the visual camera 5 is connected to the side-mounted flange frame through a thread; the cylinder body of the cylinder 3 is connected to the guide rail upper cover 2 through a thread; the finger piece 1 is connected to the gas rod of the cylinder 3 through a thread; the guide rail upper cover 2 is connected to the guide rail lower cover 10 through a thread; the finger piece forms a moving pair between the guide rail upper cover and the guide rail lower cover; the fruit stem guide 7 It is connected to the guide rail upper cover 2 by threads; the blade 6 and the fruit stem clamping piece 8 are clamped between the guide rail upper cover 2 and the fruit stem guide piece 7; the pitch torsion spring follower 9 is connected to the guide rail lower cover 10 by threads; the torsion spring center fixing piece 13 is connected to the guide rail lower cover 10 by threads; the torsion spring short arm fixing piece 14 is connected to the guide rail lower cover 10 by threads; the long arm of the torsion spring 12 is inserted into the torsion spring hole of the pitch torsion spring follower 9; the large diameter of the torsion spring 12 is inserted into the torsion spring center fixing piece 13, and the short arm is stuck in the gap formed by the guide rail lower cover 10 and the torsion spring short arm fixing piece 14.
[0052] The present invention makes the cutting surface of the finger piece 1 perpendicular to the fruit stem by tilting downward after the front end of the finger piece 1 contacts the fruit stem. The torsion spring 12 cooperates with the angled torsion spring hole in the pitch torsion spring follower 9 so that the whole can remain horizontal when no force is applied.
[0053] like Figure 3-5As shown, the working process of the present invention is as follows: after the tomato fruit is identified by the visual camera 5, the robot arm extends the end effector to the bottom of the tomato string, and after the square hollow at the front end of the finger piece 1 is aligned with the bottom of the tomato string, the end effector is lifted upward until the front edge of the finger piece 1 touches the fruit stalk, and the front end is tilted downward by the tangential force until the front plane is perpendicular to the fruit stalk, and the air rod in the cylinder 3 is pushed out, so that the finger piece and the blade 6 bite and cut the fruit stalk, and the upper part of the fruit stalk is discharged through the front end inclined surface of the guide rail upper cover 2, and the lower part of the fruit stalk is clamped by the fruit stalk clamping piece 8 and the finger piece 1, thereby completing the shearing and clamping of the tomato string.
[0054] In the description of the present application, it should be understood that the terms "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.
[0055] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various changes or modifications within the scope of the claims, which does not affect the essence of the present invention. In the absence of conflict, the embodiments of the present application and the features in the embodiments can be combined with each other arbitrarily.
Claims
1. A pitch-and-drop tomato picking shear-and-clamp integrated end effector, It is characterized in that It includes vision module, guide rail module, flange rack, torsion spring module and shear clamp module, among which: The vision module is installed on the flange frame; The guide rail module is sleeved on the outer side of the characteristic shaft of the flange frame and is connected to the characteristic shaft through a bearing; The torsion spring module acts on the guide rail module so that the guide rail module remains horizontal when no force is applied; The shearing and clamping module is arranged on the guide rail module to clamp and shear the target object.
2. The pitching and sleeve-type tomato picking shear-clamp integrated end effector according to claim 1, It is characterized in that The vision module includes a vision camera.
3. The pitching and sleeve-type tomato picking shear-clamp integrated end effector according to claim 1, It is characterized in that The guide rail module includes a guide rail upper cover and a guide rail lower cover, wherein: The guide rail upper cover and the guide rail lower cover are threadedly connected.
4. The pitching and sleeve-type tomato picking shear-clamp integrated end effector according to claim 3, It is characterized in that The shearing and clamping module comprises a finger part, a cylinder, a blade, a fruit stem guide part and a fruit stem clamping part, wherein: The finger member forms a moving pair between the guide rail upper cover and the guide rail lower cover; The fruit stem guide is installed on the guide rail cover; The blade and the fruit stem clamping member are clamped between the guide rail upper cover and the fruit stem guide member; The air cylinder can drive the finger member to move.
5. The pitching and sleeve-type tomato picking shear-clamp integrated end effector according to claim 3, It is characterized in that The cylinder body of the cylinder is installed on the guide rail upper cover; the gas rod of the cylinder is connected to the finger piece.
6. The pitching and sleeve-type tomato picking shear-clamp integrated end effector according to claim 5, It is characterized in that A hollow area is arranged at the front end of the finger member, and the cylinder can control the size of the hollow area.
7. The pitching and sleeve-type tomato picking shear-clamp integrated end effector according to claim 1, It is characterized in that The torsion spring module comprises a torsion spring and a torsion spring center fixing member, wherein: The torsion spring center fixing piece is connected to the guide rail module by threads; The large diameter of the torsion spring is inserted into the center fixing piece of the torsion spring.
8. The pitching and sleeve-taking tomato picking shear-clamp integrated end effector according to claim 7, It is characterized in that It also includes a pitch torsion spring follower, which is connected to the guide rail lower cover through threads; the long arm of the torsion spring is inserted into the torsion spring hole of the pitch torsion spring follower.
9. The pitching and sleeve-type tomato picking shear-clamp integrated end effector according to claim 7, It is characterized in that It also includes a torsion spring short arm fixing piece, which is connected to the guide rail lower cover through threads; the torsion spring short arm is inserted into a gap formed by the guide rail lower cover and the torsion spring short arm fixing piece.
10. The pitching and sleeve-type tomato picking shear-clamp integrated end effector according to claim 3, It is characterized in that It also includes a shaft elastic retaining ring, which constrains the axial direction of the guide rail lower cover and the bearing.
