Tea garden picking robot device and autonomous picking operation method
By using a crawler walking mechanism and a parallel robot arm in the tea garden picking robot, combining navigation vision sensors and picking vision sensors, autonomous navigation and precise bud picking in an unstructured environment are achieved, and navigation and precision bud picking in the existing technology are solved. The problem of insufficient cutting accuracy improves the picking efficiency and quality.
Patent Information
- Application Number
- CN202411364072.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-28
- Publication Date
- 2024-11-15
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing tea garden picking robots lack autonomous navigation capabilities in unstructured environments, making it difficult to accurately locate young buds, and the cutting accuracy of the end effector of the robot arm is low, which can easily cause damage to the young buds and affect the picking efficiency and quality.
A tea garden picking robot device that uses a crawler walking mechanism to drive the movement of a parallel robotic arm, combines navigation vision sensors and picking vision sensors to detect the location of the buds through deep learning, and uses an iris cutter and a negative pressure collection device to achieve accurate picking and collection.
It realizes independent navigation and precise bud picking in an unstructured environment, improves picking efficiency, reduces labor demand, reduces tea production costs, and effectively retains the integrity and quality of buds.
Smart Images

Figure CN118947356A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of intelligent picking, and in particular to a tea garden picking robot device and an autonomous picking operation method. Background Art
[0002] With the growing demand for high-quality tea among consumers, the market for high-quality tea is booming. The preparation of high-quality tea usually requires carefully selected raw materials, among which the selection of tender buds is particularly critical. Tea buds tend to have richer nutrients and fresher flavor characteristics, so they are usually used as one of the important raw materials for high-quality tea. However, the automated production of tea picking in my country is still in its early stages of development, and the picking of tender buds is currently mainly done manually by agricultural labor. In addition, tea picking is a labor-intensive job with strong seasonality and short picking cycles, resulting in a short-term shortage of labor and high labor costs in the actual tender bud picking process; therefore, it is of great significance to introduce tea garden picking robots to replace manual work in tender bud picking.
[0003] Most of the tea garden picking robots proposed in the existing patents can obtain the target tea location information through the visual system and drive the picking mechanism to achieve selective picking of tender buds, but there are still the following limitations:
[0004] (1) Most tea garden picking robots need to rely on fixed tracks or manually preset trajectories to operate. They lack the ability to autonomously navigate in unstructured tea garden environments and are unable to autonomously complete the bud picking operation, making it difficult to meet the automated picking needs of smart agriculture.
[0005] (2) In terms of positioning of tender buds, the existing technologies generally lack effective spatial range definition of tender buds, which makes it easy for background information to interfere with the accurate positioning of tender buds and affect the accuracy of picking tender buds;
[0006] (3) In the design of the end effector of the robot arm, a mechanism of double blades closing each other is usually adopted. During the cutting process, due to the low cutting accuracy, this method is easy to exert unnecessary pressure on the tender shoots, thereby squeezing and damaging the tender shoots, affecting the integrity of the tender shoots and the quality of subsequent processing.
[0007] Therefore, there is an urgent need for a tea garden picking robot device and an autonomous picking operation method that can effectively improve the efficiency of tender bud picking operations, effectively alleviate the problem of labor shortage in tea picking agriculture, and effectively reduce the labor cost of tea production. Summary of the invention
[0008] The purpose of the present invention is to provide a tea garden picking robot device and an autonomous picking operation method to solve the problems existing in the above-mentioned prior art.
[0009] To achieve the above-mentioned purpose, the present invention provides the following scheme: a tea garden picking robot device, comprising a frame, a crawler walking mechanism for driving the frame to move is arranged under the frame, a control box is fixedly connected to the top surface of the crawler walking mechanism, an iris cutter for picking is arranged under the frame, a parallel mechanical arm for driving the iris cutter to move is arranged at one end of the iris cutter facing the frame, the parallel mechanical arm is fixedly connected to the frame, a navigation vision sensor and a picking vision sensor are installed on the frame, a negative pressure collection device is installed on the end of the frame away from the navigation vision sensor, and the negative pressure collection device is communicated with the parallel mechanical arm.
[0010] Preferably, the negative pressure collecting device comprises a negative pressure collecting box, which is fixedly connected to the top surface of the frame, and the negative pressure collecting box is connected to the iris cutter through a collecting tube.
[0011] Preferably, the control box is electrically connected to the parallel robotic arm, the iris cutter, the navigation vision sensor, the picking vision sensor, and the negative pressure collection box.
[0012] Preferably, the parallel robotic arm includes a static platform, the top surface of the static platform is fixedly connected to the frame via a plurality of electric telescopic rods, a plurality of active arms are arranged on the bottom surface of the static platform, one end of the active arm is rotatably connected to the bottom surface of the static platform, the other end of the active arm is rotatably connected to a driven arm via a connecting rod, the end of the driven arm away from the connecting rod is rotatably connected to a dynamic platform, and the dynamic platform is rotatably connected to the iris cutter via a deep groove ball bearing.
[0013] Preferably, the iris cutter comprises a driving tube, one end of which is fixedly connected to a gear ring, the gear ring is meshed with a steering gear, the steering gear is transmission-connected to a steering gear, and the steering gear is fixedly connected to the moving platform.
[0014] Preferably, one end of the driving tube away from the moving platform is fixedly connected to a chassis, and a blade is slidably connected inside the chassis.
[0015] Preferably, one end of the driving tube extending out of the moving platform is connected to the collecting tube.
[0016] Preferably, the collecting pipe passes through the static platform and is connected with the driving pipe.
[0017] Preferably, the steering gear is electrically connected to the control box.
[0018] A tea garden picking robot autonomous picking operation method, comprising the following steps:
[0019] S1. Target navigation path fitting based on tea bush 3D point cloud;
[0020] S2. Detection and positioning of young shoots based on deep learning;
[0021] S3. Iris cutter performs harvesting operations;
[0022] S4. Use negative pressure collection device to collect young shoots.
[0023] The present invention discloses the following technical effects:
[0024] The present invention drives the frame to move through the crawler walking mechanism, the frame drives the parallel mechanical arm to move, and the parallel mechanical arm drives the iris cutter to pick the tender buds, which not only effectively improves the efficiency of the tender bud picking operation, but also can effectively alleviate the labor shortage problem in tea picking agriculture, and effectively reduce the labor cost of tea production. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0026] Figure 1 It is a schematic diagram of the overall structure of the present invention;
[0027] Figure 2 It is a schematic diagram of the structure of the parallel type mechanical arm and the iris cutter of the present invention;
[0028] Figure 3 This is a schematic diagram of the structure of the iris cutter of the present invention when viewed from above;
[0029] Figure 4 This is a schematic diagram of the top view of the iris cutter of the present invention;
[0030] Figure 5 This is a flow chart of the autonomous picking operation method of the present invention;
[0031] Figure 6 This is a flowchart of the visual navigation path extraction technology of the present invention;
[0032] Figure 7 This is a flowchart of the technology for detecting and locating the sprout target of the present invention;
[0033] Figure 8 This is a picking operation workflow diagram of the present invention;
[0034] Fig. 9 This is a schematic diagram of the autonomous following model of the target navigation path of the present invention;
[0035] Fig.10 A schematic diagram of the process flow of obtaining the optimal tender shoot picking sequence of the present invention;
[0036] Fig.11 This is a schematic diagram of the center origin position of the iris cutter of the present invention;
[0037] Fig.12 It is a schematic diagram of the iris cutter of the present invention performing the action of enveloping the tender bud;
[0038] Among them, 1. crawler walking mechanism; 2. parallel robotic arm; 3. navigation vision sensor; 4. picking vision sensor; 5. control box; 6. frame; 7. collection pipe; 8. negative pressure collection box; 2-1. static platform; 2-2. drive motor; 2-3. active arm; 2-4. driven arm; 2-5. connecting rod; 2-6. dynamic platform; 2-7. iris cutter; 2-7-1. chassis; 2-7-2. blade; 2-7-3. drive pipe; 2-7-4. servo gear; 2-7-5. deep groove ball bearing; 2-7-6. servo. DETAILED DESCRIPTION
[0039] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0040] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.
[0041] Reference Figure 1-Figure 12 The present invention provides a tea garden picking robot device, including a frame 6, a crawler walking mechanism 1 for driving the frame 6 to move is arranged below the frame 6, a control box 5 is fixedly connected to the top surface of the crawler walking mechanism 1, an iris cutter 2-7 for picking is arranged below the frame 6, a parallel mechanical arm 2 for driving the iris cutter 2-7 to move is arranged at one end of the iris cutter 2-7 facing the frame 6, the parallel mechanical arm 2 is fixedly connected to the frame 6, a navigation vision sensor 3 and a picking vision sensor 4 are installed on the frame 6, a negative pressure collection device is installed on the end of the frame 6 away from the navigation vision sensor 3, and the negative pressure collection device is communicated with the parallel mechanical arm 2.
[0042] The present invention drives the frame 6 to move through the crawler walking mechanism 1, the frame 6 drives the parallel robotic arm 2 to move, and the parallel robotic arm 2 drives the iris cutter 2-7 to pick the tender buds, which not only effectively improves the efficiency of the tender bud picking operation, but also effectively alleviates the labor shortage problem in tea picking agriculture, and effectively reduces the labor cost of tea production.
[0043] The crawler walking mechanism 1 includes symmetrically arranged driving crawlers, the top surfaces of which are fixedly connected to the bottom of the frame 6 .
[0044] According to a further optimized solution, the negative pressure collecting device includes a negative pressure collecting box 8, which is fixedly connected to the top surface of the frame 6, and the negative pressure collecting box 8 is connected to the iris cutter 2-7 through a collecting tube 7.
[0045] To further optimize the solution, the control box 5 is electrically connected to the parallel robotic arm 2, the iris cutter 2-7, the navigation vision sensor 3, the picking vision sensor 4, and the negative pressure collection box 8.
[0046] A further optimized solution is that the parallel robot arm 2 includes a static platform 2-1, the top surface of the static platform 2-1 is fixedly connected to the frame 6 through a plurality of electric telescopic rods, and a plurality of active arms 2-3 are arranged on the bottom surface of the static platform 2-1, one end of the active arm 2-3 is rotatably connected to the bottom surface of the static platform 2-1, and the other end of the active arm 2-3 is rotatably connected to the driven arm 2-4 through a connecting rod 2-5, and the end of the driven arm 2-4 away from the connecting rod 2-5 is rotatably connected to a dynamic platform 2-6, and the dynamic platform 2-6 is rotatably connected to the iris cutter 2-7 through a deep groove ball bearing 2-7-5.
[0047] The active arm 2-3 is transmission-connected to a drive motor 2-2, and the drive motor 2-2 is fixedly connected to the static platform 2-1.
[0048] The active arm 2-3 is driven to rotate by the driving motor 2-2, and the active arm 2-3 drives the driven arm 2-4 to move through the connecting rod 2-5, so that several driven arms 2-4 drive the iris cutter 2-7 to move.
[0049] According to a further optimization scheme, the iris cutter 2-7 includes a driving tube 2-7-3, one end of which is fixedly connected to a gear ring, the gear ring is meshed with a servo gear 2-7-4, the servo gear 2-7-4 is transmission-connected to a servo 2-7-6, and the servo 2-7-6 is fixedly connected to the moving platform 2-6.
[0050] To further optimize the solution, one end of the driving tube 2-7-3 away from the moving platform 2-6 is fixedly connected to the chassis 2-7-1, and the blade 2-7-2 is slidably connected inside the chassis 2-7-1.
[0051] The outer wall of the chassis 2-7-1 is fixedly connected with a plurality of connecting plates, and one end of the connecting plate away from the chassis 2-7-1 is fixedly connected to the moving platform 2-6; the blade 2-7-2 is installed on the driving tube 2-7-3.
[0052] The servo 2-7-6 drives the servo gear 2-7-4 to rotate, and the servo gear 2-7-4 drives the driving tube 2-7-3 to rotate through the gear ring, thereby pushing the blade 2-7-2 to expand or close.
[0053] The present invention uses the iris cutter 2-7 to perform the task of cutting the tender shoots, which can provide a more delicate and uniform cutting effect, retain the integrity and quality of the tender shoots to the greatest extent, and at the same time improve the efficiency of picking the tender shoots.
[0054] To further optimize the solution, one end of the driving tube 2-7-3 extending out of the moving platform 2-6 is connected to the collecting tube 7.
[0055] To further optimize the solution, the collecting pipe 7 passes through the static platform 2-1 and is connected with the driving pipe 2-7-3.
[0056] To further optimize the solution, the servo 2-7-6 is electrically connected to the control box 5.
[0057] A tea garden picking robot autonomous picking operation method, comprising the following steps:
[0058] S1. Target navigation path fitting based on tea bush 3D point cloud;
[0059] Firstly, the navigation vision sensor 3 carried by the robot is used to obtain the three-dimensional point cloud of the tea bush in real time. Secondly, the original point cloud is filtered by Gaussian filtering, and the point cloud is downsampled by uniform downsampling. Finally, the RANSAC algorithm is used to fit the robot's target navigation path, and the Pure Pursuit algorithm based on the differential model is combined to realize the robot's autonomous following of the target navigation path.
[0060] S2. Detection and positioning of young shoots based on deep learning;
[0061] First, the angle of 45° between the optical axis and the horizontal plane is selected as the installation angle of the picking vision sensor 4 on the tea garden picking robot, the bud image data is collected, and the tea bud dataset is constructed. Based on this dataset, the YOLOv5 bud target detection network model is trained and tested to realize the automatic detection of buds and obtain the bud prediction frame information; secondly, the two-dimensional coordinates of all pixels in the prediction frame are extracted, and the three-dimensional point cloud containing the buds and part of the background is generated by combining the depth map and the camera parameters of the picking vision sensor; then, the three-dimensional coordinates corresponding to the midpoint pixels of the upper and lower edges of the prediction frame are extracted from the three-dimensional point cloud, and the two points are connected to form a space vector. With the space vector as the central axis, a cylinder with a diameter equal to the width of the prediction frame is constructed as the tea envelope to define the range of the buds. Next, bilateral filtering is used to process the point cloud within the tea envelope, and the Euclidean clustering algorithm is used to extract the tender bud point cloud from the tea envelope; finally, the RANSAC algorithm is used to perform spatial fitting on the tender bud point cloud to form the tender bud spatial vector and obtain the position information of the tender bud, providing a basis for the precise picking of the end effector.
[0062] S3. Iris cutter 2-7 performs picking operation;
[0063] First, the bud space vector is converted from the camera coordinate system of the picking vision sensor 4 to the base coordinate system of the parallel robot 2 through the external parameter calibration data of the picking vision sensor 4 and the parallel robot 2; secondly, the ant colony optimization algorithm is used to obtain the optimal bud picking sequence, and the auxiliary target picking point is set; then, according to the optimal picking sequence, the robot drives the iris cutter 2-7 to reach the auxiliary target picking point position, and turns on the iris cutter 2-7 at the same time; then, combined with the position information of the bud space vector, the iris cutter 2-7 moves vertically downward and envelopes the bud; finally, the iris cutter 2-7 performs the bud cutting action, and the negative pressure collection box 8 absorbs the bud to realize autonomous bud picking operation.
[0064] S4. Use negative pressure collection device to collect young shoots.
[0065] S4.1. Use iris cutter 2-7 pairs of buds cut
[0066] The blade 2-7-2 is a twelve-leaf blade, which cuts the petiole of the tender buds uniformly at the same time. During the picking process, after the tender buds are inserted into the iris cutter 2-7, the robot will drive the servo 2-7-6 to rotate, driving the servo gear 2-7-4 to rotate. Then, under the action of the gear transmission, the drive tube 2-7-3 rotates with the servo gear 2-7-4. Then, due to the coordination of the notches between the blade 2-7-2, the drive tube 2-7-3 and the chassis 2-7-1, the rotation of the drive tube 2-7-3 will drive the blade 2-7-2 to close inward along the slide groove, so that the twelve-leaf blade can achieve the cutting of tea leaves through the joint action of multiple cutting points, ensuring that the cutting force of the tender buds is more uniform when being cut, and ensuring the integrity and quality of the tender buds.
[0067] S4.2. Use of bud collection in conjunction with negative pressure collection device
[0068] The driving tube 2-7-3 of the iris cutter 2-7 is directly connected to the collecting tube 7 in a concentric manner. After the buds are cut, they will be immediately sealed inside the iris cutter 2-7, effectively preventing the buds from scattering. Then, the negative pressure collection box 8 activates the negative pressure suction function, and forms a local low-pressure environment inside the iris cutter 2-7 through the collecting tube 7, sucking the cut buds and transporting them to the negative pressure collection box 8, realizing the "picking-collecting" coordinated continuous operation and improving the tea picking efficiency.
[0069] The tea garden picking robot provided by the present invention can capture the three-dimensional point cloud data of tea bushes in real time, and realize the autonomous navigation function of the robot in an unstructured environment by fitting the point cloud into a target navigation path. At the same time, during the autonomous navigation process, the robot can use the tender bud target detection algorithm to detect the tender buds in the tea bushes, and at the same time use the method of constructing tea leaf envelopes to obtain the position information of the tender buds, which is also one of the characteristics of this method. By defining the effective spatial range of the tender buds, the interference of background or noise is effectively reduced. Combined with the control of the robotic arm and the execution of the improved end effector, the autonomous picking of tender buds can be completed accurately. The present invention can replace manual labor to efficiently and accurately complete the work of picking tender buds, alleviate the pressure of labor demand, and reduce the production cost of famous and high-quality teas.
[0070] The iris cutter 2-7 of the present invention can cut the tender buds by simulating the opening and closing action of the iris. When cutting the tender buds, it can provide a more delicate and uniform cutting effect, which is conducive to maintaining the integrity of the tender buds and avoiding damage to the tea leaves. At the same time, the end effector can be highly matched with the vacuum adsorption tea collection method to jointly improve the efficiency and quality of tender bud picking.
[0071] The present invention uses a tea garden picking robot as a carrier, and is equipped with a navigation vision sensor 3, a picking vision sensor 4, a parallel robotic arm 2 and an iris cutter 2-7. It realizes the autonomous navigation function in an unstructured tea garden environment through a visual navigation method, and on this basis, autonomously picks young buds, thereby realizing autonomous young bud picking operations without human intervention, and meeting the needs of modern agriculture for automated production.
[0072] The present invention uses a bud target detection algorithm based on deep learning to achieve automatic detection of buds and obtain bud prediction frame information. Based on the prediction frame information, the tea leaf envelope is constructed to define the effective spatial range of the buds, effectively reducing the interference of background or noise, thereby accurately obtaining the three-dimensional information of the buds and providing support for subsequent precise picking.
[0073] In the description of the present invention, it should be understood that the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.
[0074] The embodiments described above are only descriptions of the preferred modes of the present invention, and are not intended to limit the scope of the present invention. Without departing from the design spirit of the present invention, various modifications and improvements made to the technical solutions of the present invention by ordinary technicians in this field should all fall within the protection scope determined by the claims of the present invention.
Claims
1. A tea garden picking robot device, Features: The invention comprises a frame (6), a crawler walking mechanism (1) for driving the frame (6) to move is arranged below the frame (6), a control box (5) is fixedly connected to the top surface of the crawler walking mechanism (1), an iris cutter (2-7) for picking is arranged below the frame (6), a parallel mechanical arm (2) for driving the iris cutter (2-7) to move is arranged at one end of the iris cutter (2-7) facing the frame (6), the parallel mechanical arm (2) is fixedly connected to the frame (6), a navigation vision sensor (3) and a picking vision sensor (4) are installed on the frame (6), and a negative pressure collection device is installed on one end of the frame (6) away from the navigation vision sensor (3), and the negative pressure collection device is connected to the parallel mechanical arm (2).
2. The tea garden picking robot device according to claim 1, Features: The negative pressure collection device comprises a negative pressure collection box (8), the negative pressure collection box (8) is fixedly connected to the top surface of the frame (6), and the negative pressure collection box (8) is connected to the iris cutter (2-7) through a collection pipe (7).
3. The tea garden picking robot device according to claim 2, Features: The control box (5) is electrically connected to the parallel robotic arm (2), the iris cutter (2-7), the navigation vision sensor (3), the picking vision sensor (4), and the negative pressure collection box (8).
4. The tea garden picking robot device according to claim 3, Features: The parallel robot arm (2) comprises a static platform (2-1), the top surface of the static platform (2-1) is fixedly connected to the frame (6) via a plurality of electric telescopic rods, the bottom surface of the static platform (2-1) is provided with a plurality of active arms (2-3), one end of the active arm (2-3) is rotatably connected to the bottom surface of the static platform (2-1), the other end of the active arm (2-3) is rotatably connected to a driven arm (2-4) via a connecting rod (2-5), one end of the driven arm (2-4) away from the connecting rod (2-5) is rotatably connected to a dynamic platform (2-6), and the dynamic platform (2-6) is rotatably connected to the iris cutter (2-7) via a deep groove ball bearing (2-7-5).
5. The tea garden picking robot device according to claim 4, Features: The iris cutter (2-7) comprises a driving tube (2-7-3), one end of which is fixedly connected to a gear ring, the gear ring is meshed with a steering gear (2-7-4), the steering gear (2-7-4) is transmission-connected to a steering gear (2-7-6), and the steering gear (2-7-6) is fixedly connected to the moving platform (2-6).
6. The tea garden picking robot device according to claim 5, Features: One end of the driving tube (2-7-3) away from the moving platform (2-6) is fixedly connected to a chassis (2-7-1), and a blade (2-7-2) is slidably connected inside the chassis (2-7-1).
7. The tea garden picking robot device according to claim 6, Features: One end of the driving tube (2-7-3) extending out of the moving platform (2-6) is connected to the collecting tube (7).
8. The tea garden picking robot device according to claim 5, Features: The collecting pipe (7) passes through the static platform (2-1) and is connected to the driving pipe (2-7-3).
9. The tea garden picking robot device according to claim 5, Features: The steering gear (2-7-6) is electrically connected to the control box (5).
10. A tea garden picking robot autonomous picking operation method, based on the tea garden picking robot device according to any one of claims 1 to 9, Features: The following steps are involved: S1. Target navigation path fitting based on tea bush 3D point cloud; S2. Detection and positioning of young shoots based on deep learning; S3. Iris cutter (2-7) performs harvesting operations; S4. Use negative pressure collection device to collect young shoots.
Citation Information
Cited By
Remote control type edible rose picking machine
CN119866804A
Hangzhou white chrysanthemum picking robot and flower picking method thereof
CN119866807A
A chrysanthemum picking robot and a flower picking method thereof
CN119866807B
Tea leaf picking method with recognition function for tea leaf planting
CN119991393A
Stretcher type Asiatic bilberry trimming and harvesting all-in-one machine
CN119999467A
