The invention provides an
agaricus bisporus picking
sequence planning method based on YOLOv8-USD instance segmentation and 3D
point cloud, and the method comprises the steps:
processing color image information through employing a YOLOv8n-USD instance segmentation
algorithm, and generating a segmentation
mask corresponding to
label information; performing registration on the generated segmentation
mask and the corresponding depth image to generate a 3D
point cloud;
morphological processing is conducted on the color images, the circle center and the
radius of each
mushroom are calculated, whether picking is needed or not is judged according to the
radius, and picking and sorting of the
agaricus bisporus are achieved; mapping the circle center and
radius information of the mushrooms into the 3D
point cloud through the depth image, performing rapid neighbor search by using a KD tree, and segmenting the mushrooms in each
mushroom cluster; a global picking
sequence planning strategy and a local picking
sequence planning strategy are provided, the global picking sequence strategy is used for carrying out classification and priority
ranking on different types of
agaricus bisporus clusters, and the local picking sequence strategy is used for planning the picking sequence of each
mushroom in the mushroom clusters. The picking sequence can be adjusted according to the overlapping degree of
agaricus bisporus.