Control method and system for construction placement robot designed based on vlas model

Abstract

The present invention discloses a control method and system for a construction placement robot designed based on a VLAS model, including: receiving a voice command, verifying an identity of a construction worker, and generating a voice command embedding vector; aligning the voice command embedding vector with an RGB image in a shared semantic space, and fusing visual and speech features to generate a joint representation; performing task decomposition according to the joint representation; collecting image data of a construction site and identifying a target object, while acquiring point cloud data and extracting coordinates of the target object; generating a movement trajectory of the target object according to the coordinates of the target object, movement control parameters of the placement robot, and joint positions; converting the movement trajectory into a plurality of action instructions to drive the placement robot to perform actions; detecting a distance between the construction worker and a robotic arm of the placement robot in real-time, and triggering an emergency stop when the distance falls below a safety distance threshold; and collecting operation status information of the placement robot in real-time to dynamically adjust the movement trajectory and a pouring speed. The present invention enables the robot to perform automatic placement.