The invention provides a wall building
robot grabbing identification method and
system fusing BIM and
visual observation information, and belongs to the field of
robot grabbing, and the method comprises the steps that S1, a wall building
robot obtains building instruction information, determines a to-be-built
brick type and the position of the to-be-built
brick type in an overall building task, obtains a BIM model of the to-be-built
brick type from a BIM model
library, and stores the BIM model of the to-be-built brick type in the overall building task; extracting geometric and
semantic information of the to-be-built brick type; s2, building a brick
layout undirected graph based on the BIM model of the overall masonry task, carrying out a
collision test, and determining candidate grabbing positions meeting masonry requirements according to a result of the
collision test; s3, the wall building robot collects three-dimensional
point cloud data of the target scene, analyzes the three-dimensional
point cloud data and determines the main axis direction and size characteristics of the target brick; s4, performing
information fusion analysis on the geometric and
semantic information of the to-be-built brick type and the main axis direction and size characteristics of the target brick to obtain a grabbing rectangular frame of the target brick; and S5, the grabbing rectangular frame is projected to a two-dimensional image screen, grabbing
pose parameters of the wall building robot are calculated, and the wall building robot executes brick grabbing according to the grabbing
pose parameters. By constructing the brick
layout undirected graph and the
collision test, the reasonability and the safety of the grabbing position are ensured, and meanwhile, the autonomy, the flexibility and the working efficiency of the wall building robot are remarkably improved.