The application provides a flexible deformable part visual tracking and
robot pose control method, and belongs to the field of
robot vision and automatic
assembly. First, an ASLIC
superpixel segmentation algorithm is proposed by fusing edge
perception, adaptive compactness and adaptive grid step, and combined with
feature fusion and
global topology constraint optimization
path search, a two-dimensional center line is accurately extracted. Secondly, a three-dimensional
pose structured representation is constructed by projection error compensation and adaptive cylindrical constraint. Finally, in the
deformation control stage, the stiffness decreasing mechanism is revealed, the bending and torsion deformation is decoupled based on the parallel transmission of the Frenet
moving frame, and the torsion angle is estimated, and finally a bending and torsion coupled total
potential energy model is constructed, the
pose prediction is converted into a
nonlinear optimization problem, and through a hierarchical controller, the position and torsion of the flexible deformable part under the
robot control are cooperatively and high-precision closed-loop controlled. The application can realize stable
visual capture, accurate three-dimensional reconstruction and bending and torsion cooperative control of the flexible deformable part.