The invention discloses a
robot unstacking grabbing
pose estimation method based on an
image segmentation model, and relates to the technical field of
image processing, and the method mainly comprises the steps: taking a two-dimensional detection frame as a positioning basis, inputting an
image segmentation model, generating a pixel-level
mask of a grabbing target, mapping the pixel-level
mask to a three-dimensional
point cloud which is registered with the pixel-level
mask, and carrying out the positioning of the three-dimensional
point cloud; extracting a
point cloud subset of the captured target according to a mapping result; normal vector
estimation and direction consistency
processing are carried out on the point cloud subsets, and division of point cloud clusters corresponding to each independent surface of the grabbing target is carried out by taking direction consistency as a clustering segmentation basis; calculating the
mass center position of each independent surface of the grabbed target according to the divided point cloud clusters, and extracting a local point cloud within a preset
radius range of the
mass center; and the average point of the local point cloud serves as a grabbing point, the average normal vector of the local point cloud serves as the grabbing direction, and the grabbing
pose of the
robot is generated. According to the invention, when the object is inclined, stacked tightly or shaped irregularly, the point cloud subset mapped by the mask can still accurately eliminate the interference of the background and the adjacent object.