Accurate detection method and system for dense plums picked by robot

A detection method and robot technology, applied in the research field of agricultural robots, can solve problems such as poor performance, limited technical resources of fruit picking robots, and increase the difficulty of detecting small and small objects, and achieve the effect of improving light weight and accuracy.

Pending Publication Date: 2022-04-22
SOUTH CHINA AGRI UNIV
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although relevant scholars have done research work on the detection of plums, the characteristics of clustered growth and mixed maturity of plums make it more difficult to detect small targets, which leads to the poor performance of existing algorithms in the process of plum detection. performance
So far, there has been no research on deep learning methods for detecting dense plums in natural environments, resulting in limited technical resources for fruit picking robots in orchards

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Accurate detection method and system for dense plums picked by robot
  • Accurate detection method and system for dense plums picked by robot
  • Accurate detection method and system for dense plums picked by robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0061] A method for precise detection of dense plums for robot picking, such as figure 1 shown, including the following steps:

[0062] Collect images of orchard fruits through image acquisition equipment;

[0063] Check and process the collected images to obtain target detection images that meet the requirements;

[0064] Use the data annotation tool to perform data annotation on the target detection image, and obtain annotated images with different maturity levels;

[0065] Divide the labeled image into the training set in proportion, and obtain the number of mature fruits and the number of immature fruits in the training set;

[0066] According to the fruit maturity ratio in the training set, it is judged whether to perform data balance processing, and a balanced training set is obtained after data balance processing;

[0067] Perform data enhancement processing on the balanced training set data set to obtain a data enhancement training set;

[0068] Improve the target ...

Embodiment 2

[0105] A dense plum detection system for robot picking, such as image 3 shown, including:

[0106] An image collection device for collecting images of orchard fruits;

[0107] The image processing module is used to check and process the collected images to obtain target detection images that meet the requirements;

[0108] The data labeling module is used to perform data labeling on the target detection image and obtain the labeling image;

[0109] A label division module is used to divide the labeled image into a training set and a test set in proportion to obtain the number of ripe fruits and the number of immature fruits in the training set;

[0110] The balance processing module performs data balance processing according to the fruit maturity ratio in the training set to obtain a balanced training set;

[0111] The data enhancement module performs data enhancement processing on the balanced training set data set to obtain a data enhancement training set;

[0112] The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for accurately detecting dense plums picked by a robot. The method comprises the following steps: acquiring images of fruits in an orchard through image acquisition equipment; performing inspection processing to obtain a target detection image meeting requirements; performing data annotation of fruits with different maturity degrees on the target detection image to obtain an annotated image; dividing the marked image into a training set and a test set according to a proportion, and obtaining the number of mature proportion fruits in the training set; judging whether data balance processing is needed or not according to the fruit ripening proportion in the training set; performing data enhancement processing on the balance training set data; improving the target detection model; training and predicting the data enhancement training set by improving the target detection model to obtain a detection result; according to the invention, the deep learning model is applied to identification and picking of plums, can be deployed on a robot picking platform, and provides technical support for yield estimation of orchards and research of picking robots.

Description

technical field [0001] The invention relates to the research field of agricultural robots, in particular to a method and system for precise detection of dense plums for robot picking. Background technique [0002] Compared with apples, citrus, mango and other fruits, plums are small and densely distributed, and are easily blocked by fruits or branches and leaves. Most plum trees are planted on hillsides, and the growth environment of their fruits is full of complexity and uncertainty. In the current plum orchard, the tasks of identifying the maturity of plums and picking plums are all completed by the fruit growers. Today, labor costs have risen greatly, and the proportion of labor costs in the total cost is also increasing. According to the survey, the increase in labor costs in 2019 is as high as 12-15%. In precision agriculture, labor shortages and an aging population add resistance to the development of the fruit industry. To sum up, the mechanization and intelligenc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V20/10G06V10/44G06V10/764G06V10/82G06V10/80G06T7/00G06T7/90G06K9/62G06N3/04G06N3/08
CPCG06T7/0002G06T7/90G06N3/082G06N3/047G06N3/048G06N3/045G06F18/2415G06F18/241G06F18/253
Inventor 兰玉彬王乐乐刘圣搏赵英杰熊章钧常坤王从越
Owner SOUTH CHINA AGRI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products