The invention discloses a multi-
point cloud view angle mechanical arm grabbing
system based on
deep learning. The
system comprises the following steps that S1,
point cloud data of
multiple view angles are obtained through a depth camera according to a
graph optimization algorithm; s2, performing high-precision splicing on the
point cloud data by adopting a
deep learning method to generate a complete object three-dimensional model; s3, calculating an optimal grabbing
pose of the object by utilizing a GraspNet grabbing
estimation network; s4, the estimated grabbing
pose information is transmitted to a
robotic arm through an ROS service communication mechanism; s5, MoveIt! The function
package plans and optimizes the grabbing path of the
robotic arm; and S6, subscribing the joint state information, and driving the
robotic arm to complete the actual grabbing action. According to the method, the multi-view point cloud splicing technology and
deep learning are combined, the point cloud registration precision is remarkably improved, and therefore the grabbing precision and stability of the robotic arm are improved. Through communication between the ROS and the Windows
system, the point
cloud data are processed at the Windows end, and the grabbing
pose is output, so that the problem of system
instability caused by insufficient computing power of edge equipment is effectively solved. According to the method, the flexibility and
usability of the system are further enhanced, so that the system can adapt to various complex grabbing scenes.