The invention discloses a neighbor soft
package two-dimensional segmentation and three-dimensional positioning
combined method, which comprises the following steps of: segmenting a two-dimensional picture by using a Segment Anything
algorithm and carrying out preliminary screening according to the contour area of a segmented object; performing coordinate range screening, determining and calculating an external rectangle and an area thereof through
processing of a two-dimensional minimum compact bounding box, and outputting a minimum area by rotating a line to be greater than 90 degrees; obtaining an included angle between an object center coordinate and x and y through a bounding box, calculating a result through a formula, and performing range screening to segment a recognition object;
processing the soft
package by using a two-dimensional
minimum bounding box algorithm to obtain a center coordinate and an included angle; acquiring internal and external parameter matrixes, two-dimensional coordinates and depth of the camera, and converting two-dimensional image coordinates into three-dimensional coordinates in a camera coordinate
system and a world coordinate
system; and calculating a neighbor
point cloud normal vector to obtain a three-dimensional attitude of the soft
package center point. According to the positioning method disclosed by the invention, the problem of low positioning precision of the soft package is solved by a minimum compact bounding box
algorithm, and a more accurate grabbing
pose is conveniently provided for the
robot.